Nov 30 12:27:25 user nova-compute[75672]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75672) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75672) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75672) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 12:27:25 user nova-compute[75672]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:27:25 user nova-compute[75672]: INFO nova.virt.driver [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 30 12:27:25 user nova-compute[75672]: INFO nova.compute.provider_config [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] Acquiring lock "singleton_lock" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] Acquired lock "singleton_lock" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] Releasing lock "singleton_lock" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] Full set of CONF: {{(pid=75672) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ******************************************************************************** {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] Configuration options gathered from: {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ================================================================================ {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] allow_resize_to_same_host      = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] arq_binding_timeout            = 300 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] backdoor_port                  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] backdoor_socket                = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] block_device_allocate_retries  = 300 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] block_device_allocate_retries_interval = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cert                           = self.pem {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] compute_monitors               = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] config_dir                     = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] config_drive_format            = iso9660 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] config_source                  = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] console_host                   = user {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] control_exchange               = nova {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cpu_allocation_ratio           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] daemon                         = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] debug                          = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] default_access_ip_network_name = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] default_availability_zone      = nova {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] default_ephemeral_format       = ext4 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] default_green_pool_size        = 1000 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] default_schedule_zone          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] disk_allocation_ratio          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] enable_new_services            = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] enabled_ssl_apis               = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] flat_injected                  = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] force_config_drive             = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] force_raw_images               = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] graceful_shutdown_timeout      = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] heal_instance_info_cache_interval = 60 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] host                           = user {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] instance_build_timeout         = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] instance_delete_interval       = 300 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] instance_name_template         = instance-%08x {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] instance_usage_audit           = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] instance_usage_audit_period    = month {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] internal_service_availability_zone = internal {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] key                            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] live_migration_retry_count     = 30 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] log_config_append              = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] log_dir                        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] log_file                       = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] log_options                    = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] log_rotate_interval            = 1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] log_rotate_interval_type       = days {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] log_rotation_type              = none {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] long_rpc_timeout               = 1800 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] max_concurrent_builds          = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] max_concurrent_live_migrations = 1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] max_concurrent_snapshots       = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] max_local_block_devices        = 3 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] max_logfile_count              = 30 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] max_logfile_size_mb            = 200 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] maximum_instance_delete_attempts = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] metadata_listen                = 0.0.0.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] metadata_listen_port           = 8775 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] metadata_workers               = 3 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] migrate_max_retries            = -1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] mkisofs_cmd                    = genisoimage {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] my_ip                          = 10.0.0.210 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] network_allocate_retries       = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] osapi_compute_listen_port      = 8774 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] osapi_compute_unique_server_name_scope =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] osapi_compute_workers          = 3 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] password_length                = 12 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] periodic_enable                = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] periodic_fuzzy_delay           = 60 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] pointer_model                  = ps2mouse {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] preallocate_images             = none {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] publish_errors                 = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] pybasedir                      = /opt/stack/nova {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ram_allocation_ratio           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] rate_limit_burst               = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] rate_limit_except_level        = CRITICAL {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] rate_limit_interval            = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] reboot_timeout                 = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] reclaim_instance_interval      = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] record                         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] reimage_timeout_per_gb         = 60 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] report_interval                = 120 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] rescue_timeout                 = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] reserved_host_cpus             = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] reserved_host_disk_mb          = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] reserved_host_memory_mb        = 512 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] reserved_huge_pages            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] resize_confirm_window          = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] resize_fs_using_block_device   = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] resume_guests_state_on_host_boot = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] rpc_response_timeout           = 60 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] run_external_periodic_tasks    = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] running_deleted_instance_action = reap {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] running_deleted_instance_timeout = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] scheduler_instance_sync_interval = 120 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] service_down_time              = 720 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] servicegroup_driver            = db {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] shelved_offload_time           = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] shelved_poll_interval          = 3600 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] shutdown_timeout               = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] source_is_ipv6                 = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ssl_only                       = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] state_path                     = /opt/stack/data/nova {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] sync_power_state_interval      = 600 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] sync_power_state_pool_size     = 1000 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] syslog_log_facility            = LOG_USER {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] tempdir                        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] timeout_nbd                    = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] transport_url                  = **** {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] update_resources_interval      = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] use_cow_images                 = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] use_eventlog                   = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] use_journal                    = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] use_json                       = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] use_rootwrap_daemon            = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] use_stderr                     = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] use_syslog                     = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vcpu_pin_set                   = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vif_plugging_is_fatal          = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vif_plugging_timeout           = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] virt_mkfs                      = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] volume_usage_poll_interval     = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] watch_log_file                 = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] web                            = /usr/share/spice-html5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_concurrency.disable_process_locking = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.auth_strategy              = keystone {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.compute_link_prefix        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.dhcp_domain                = novalocal {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.enable_instance_password   = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.glance_link_prefix         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.instance_list_per_project_cells = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.list_records_by_skipping_down_cells = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.local_metadata_per_cell    = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.max_limit                  = 1000 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.metadata_cache_expiration  = 15 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.neutron_default_tenant_id  = default {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.use_forwarded_for          = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.use_neutron_default_nets   = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.vendordata_dynamic_targets = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.vendordata_jsonfile_path   = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.backend_argument         = **** {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.config_prefix            = cache.oslo {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.dead_timeout             = 60.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.debug_cache_backend      = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.enable_retry_client      = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.enable_socket_keepalive  = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.enabled                  = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.expiration_time          = 600 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.hashclient_retry_attempts = 2 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.memcache_dead_retry      = 300 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.memcache_password        =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.memcache_sasl_enabled    = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.memcache_username        =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.proxies                  = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.retry_attempts           = 2 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.retry_delay              = 0.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.socket_keepalive_count   = 1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.socket_keepalive_idle    = 1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.socket_keepalive_interval = 1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.tls_allowed_ciphers      = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.tls_cafile               = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.tls_certfile             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.tls_enabled              = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cache.tls_keyfile              = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.auth_section            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.auth_type               = password {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.cafile                  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.certfile                = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.collect_timing          = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.cross_az_attach         = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.debug                   = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.endpoint_template       = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.http_retries            = 3 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.insecure                = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.keyfile                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.os_region_name          = RegionOne {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.split_loggers           = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cinder.timeout                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] compute.cpu_dedicated_set      = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] compute.cpu_shared_set         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] compute.image_type_exclude_list = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] compute.resource_provider_association_refresh = 300 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] compute.shutdown_retry_interval = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] conductor.workers              = 3 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] console.allowed_origins        = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] console.ssl_ciphers            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] console.ssl_minimum_version    = default {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] consoleauth.token_ttl          = 600 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.cafile                  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.certfile                = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.collect_timing          = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.connect_retries         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.connect_retry_delay     = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.endpoint_override       = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.insecure                = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.keyfile                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.max_version             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.min_version             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.region_name             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.service_name            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.service_type            = accelerator {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.split_loggers           = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.status_code_retries     = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.status_code_retry_delay = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.timeout                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] cyborg.version                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.backend               = sqlalchemy {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.connection            = **** {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.connection_debug      = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.connection_parameters =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.connection_recycle_time = 3600 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.connection_trace      = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.db_inc_retry_interval = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.db_max_retries        = 20 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.db_max_retry_interval = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.db_retry_interval     = 1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.max_overflow          = 50 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.max_pool_size         = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.max_retries           = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.mysql_wsrep_sync_wait = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.pool_timeout          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.retry_interval        = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.slave_connection      = **** {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] database.sqlite_synchronous    = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.backend           = sqlalchemy {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.connection        = **** {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.connection_debug  = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.connection_parameters =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.connection_recycle_time = 3600 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.connection_trace  = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.db_inc_retry_interval = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.db_max_retries    = 20 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.db_max_retry_interval = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.db_retry_interval = 1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.max_overflow      = 50 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.max_pool_size     = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.max_retries       = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.pool_timeout      = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.retry_interval    = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.slave_connection  = **** {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] api_database.sqlite_synchronous = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] devices.enabled_mdev_types     = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ephemeral_storage_encryption.enabled = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.api_servers             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.cafile                  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.certfile                = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.collect_timing          = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.connect_retries         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.connect_retry_delay     = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.debug                   = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.default_trusted_certificate_ids = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.enable_certificate_validation = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.enable_rbd_download     = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.endpoint_override       = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.insecure                = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.keyfile                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.max_version             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.min_version             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.num_retries             = 3 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.rbd_ceph_conf           =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.rbd_connect_timeout     = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.rbd_pool                =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.rbd_user                =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.region_name             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.service_name            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.service_type            = image {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.split_loggers           = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.status_code_retries     = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.status_code_retry_delay = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.timeout                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.verify_glance_signatures = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] glance.version                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] guestfs.debug                  = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.config_drive_cdrom      = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.config_drive_inject_password = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.enable_remotefx         = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.instances_path_share    =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.limit_cpu_features      = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.use_multipath_io        = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.vswitch_name            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] mks.enabled                    = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] image_cache.manager_interval   = 2400 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] image_cache.precache_concurrency = 1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] image_cache.remove_unused_base_images = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] image_cache.subdirectory_name  = _base {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.api_max_retries         = 60 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.api_retry_interval      = 2 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.auth_section            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.auth_type               = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.cafile                  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.certfile                = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.collect_timing          = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.conductor_group         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.connect_retries         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.connect_retry_delay     = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.endpoint_override       = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.insecure                = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.keyfile                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.max_version             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.min_version             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.peer_list               = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.region_name             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.serial_console_state_timeout = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.service_name            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.service_type            = baremetal {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.split_loggers           = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.status_code_retries     = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.status_code_retry_delay = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.timeout                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ironic.version                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] key_manager.fixed_key          = **** {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.barbican_api_version  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.barbican_endpoint     = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.barbican_endpoint_type = public {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.barbican_region_name  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.cafile                = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.certfile              = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.collect_timing        = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.insecure              = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.keyfile               = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.number_of_retries     = 60 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.retry_delay           = 1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.send_service_user_token = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.split_loggers         = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.timeout               = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.verify_ssl            = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican.verify_ssl_path       = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican_service_user.auth_section = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican_service_user.auth_type = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican_service_user.cafile   = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican_service_user.certfile = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican_service_user.collect_timing = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican_service_user.insecure = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican_service_user.keyfile  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican_service_user.split_loggers = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] barbican_service_user.timeout  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.approle_role_id          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.approle_secret_id        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.cafile                   = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.certfile                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.collect_timing           = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.insecure                 = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.keyfile                  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.kv_mountpoint            = secret {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.kv_path                  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.kv_version               = 2 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.namespace                = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.root_token_id            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.split_loggers            = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.ssl_ca_crt_file          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.timeout                  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.use_ssl                  = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.auth_section          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.auth_type             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.cafile                = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.certfile              = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.collect_timing        = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.connect_retries       = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.connect_retry_delay   = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.endpoint_override     = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.insecure              = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.keyfile               = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.max_version           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.min_version           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.region_name           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.service_name          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.service_type          = identity {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.split_loggers         = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.status_code_retries   = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.status_code_retry_delay = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.timeout               = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] keystone.version               = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.connection_uri         =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.cpu_mode               = custom {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: WARNING oslo_config.cfg [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.cpu_power_governor_high = performance {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.cpu_power_management   = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.device_detach_attempts = 8 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.device_detach_timeout  = 20 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.disk_cachemodes        = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.disk_prefix            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.enabled_perf_events    = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.file_backed_memory     = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.gid_maps               = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.hw_disk_discard        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.hw_machine_type        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.images_rbd_pool        = rbd {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.images_type            = default {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.images_volume_group    = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.inject_key             = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.inject_partition       = -2 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.inject_password        = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.iscsi_iface            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.iser_use_multipath     = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.live_migration_downtime = 500 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.live_migration_inbound_addr = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.live_migration_scheme  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.live_migration_timeout_action = abort {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.live_migration_tunnelled = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: WARNING oslo_config.cfg [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 30 12:27:25 user nova-compute[75672]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 30 12:27:25 user nova-compute[75672]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 30 12:27:25 user nova-compute[75672]: and ``live_migration_inbound_addr`` respectively.
Nov 30 12:27:25 user nova-compute[75672]: ).  Its value may be silently ignored in the future.
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.live_migration_with_native_tls = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.max_queues             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.nfs_mount_options      = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.num_pcie_ports         = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.pmem_namespaces        = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.quobyte_client_cfg     = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.rbd_secret_uuid        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.rbd_user               = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.rescue_image_id        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.rescue_kernel_id       = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:25 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.rx_queue_size          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.smbfs_mount_options    =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.snapshot_compression   = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.snapshot_image_format  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.sparse_logical_volumes = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.swtpm_enabled          = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.swtpm_group            = tss {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.swtpm_user             = tss {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.sysinfo_serial         = unique {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.tb_cache_size          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.tx_queue_size          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.uid_maps               = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.use_virtio_for_bridges = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.virt_type              = kvm {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.volume_clear           = zero {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.volume_clear_size      = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.volume_use_multipath   = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.vzstorage_cache_path   = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.auth_section           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.auth_type              = password {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.cafile                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.certfile               = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.collect_timing         = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.connect_retries        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.connect_retry_delay    = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.default_floating_pool  = public {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.endpoint_override      = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.extension_sync_interval = 600 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.http_retries           = 3 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.insecure               = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.keyfile                = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.max_version            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.min_version            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.ovs_bridge             = br-int {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.physnets               = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.region_name            = RegionOne {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.service_metadata_proxy = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.service_name           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.service_type           = network {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.split_loggers          = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.status_code_retries    = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.status_code_retry_delay = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.timeout                = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] neutron.version                = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] notifications.bdms_in_notifications = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] notifications.default_level    = INFO {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] notifications.notification_format = unversioned {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] notifications.notify_on_state_change = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] pci.alias                      = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] pci.device_spec                = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] pci.report_in_placement        = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.auth_section         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.auth_type            = password {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.cafile               = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.certfile             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.collect_timing       = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.connect_retries      = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.connect_retry_delay  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.default_domain_id    = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.default_domain_name  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.domain_id            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.domain_name          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.endpoint_override    = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.insecure             = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.keyfile              = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.max_version          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.min_version          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.password             = **** {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.project_domain_id    = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.project_domain_name  = Default {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.project_id           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.project_name         = service {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.region_name          = RegionOne {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.service_name         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.service_type         = placement {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.split_loggers        = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.status_code_retries  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.status_code_retry_delay = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.system_scope         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.timeout              = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.trust_id             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.user_domain_id       = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.user_domain_name     = Default {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.user_id              = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.username             = placement {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] placement.version              = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] quota.cores                    = 20 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] quota.count_usage_from_placement = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] quota.injected_file_content_bytes = 10240 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] quota.injected_file_path_length = 255 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] quota.injected_files           = 5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] quota.instances                = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] quota.key_pairs                = 100 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] quota.metadata_items           = 128 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] quota.ram                      = 51200 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] quota.recheck_quota            = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] quota.server_group_members     = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] quota.server_groups            = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] rdp.enabled                    = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] scheduler.image_metadata_prefilter = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] scheduler.max_attempts         = 3 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] scheduler.max_placement_results = 1000 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] scheduler.workers              = 3 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.host_subset_size = 1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.isolated_hosts = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.isolated_images = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.pci_in_placement = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.track_instance_changes = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] metrics.required               = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] metrics.weight_multiplier      = 1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] metrics.weight_setting         = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] serial_console.enabled         = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] serial_console.port_range      = 10000:20000 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] serial_console.serialproxy_port = 6083 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] service_user.auth_section      = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] service_user.auth_type         = password {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] service_user.cafile            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] service_user.certfile          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] service_user.collect_timing    = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] service_user.insecure          = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] service_user.keyfile           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] service_user.send_service_user_token = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] service_user.split_loggers     = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] service_user.timeout           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] spice.agent_enabled            = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] spice.enabled                  = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] spice.html5proxy_port          = 6082 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] spice.image_compression        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] spice.jpeg_compression         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] spice.playback_compression     = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] spice.server_listen            = 127.0.0.1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] spice.streaming_mode           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] spice.zlib_compression         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] upgrade_levels.baseapi         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] upgrade_levels.compute         = auto {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] upgrade_levels.conductor       = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] upgrade_levels.scheduler       = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vendordata_dynamic_auth.cafile = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vendordata_dynamic_auth.certfile = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vendordata_dynamic_auth.insecure = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vendordata_dynamic_auth.timeout = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.api_retry_count         = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.ca_file                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.cache_prefix            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.cluster_name            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.connection_pool_size    = 10 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.console_delay_seconds   = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.datastore_regex         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.host_ip                 = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.host_password           = **** {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.host_port               = 443 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.host_username           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.insecure                = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.integration_bridge      = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.maximum_objects         = 100 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.pbm_default_policy      = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.pbm_enabled             = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.pbm_wsdl_location       = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.serial_port_proxy_uri   = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.serial_port_service_uri = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.task_poll_interval      = 0.5 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.use_linked_clone        = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.vnc_keymap              = en-us {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.vnc_port                = 5900 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vmware.vnc_port_total          = 10000 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vnc.auth_schemes               = ['none'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vnc.enabled                    = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vnc.novncproxy_port            = 6080 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vnc.vencrypt_ca_certs          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vnc.vencrypt_client_cert       = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vnc.vencrypt_client_key        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.disable_rootwrap   = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.enable_numa_live_migration = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.libvirt_disable_apic = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] wsgi.client_socket_timeout     = 900 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] wsgi.default_pool_size         = 1000 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] wsgi.keep_alive                = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] wsgi.max_header_line           = 16384 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] wsgi.ssl_ca_file               = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] wsgi.ssl_cert_file             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] wsgi.ssl_key_file              = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] wsgi.tcp_keepidle              = 600 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] zvm.ca_file                    = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] zvm.cloud_connector_url        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] zvm.reachable_timeout          = 300 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_policy.enforce_new_defaults = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_policy.enforce_scope      = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_policy.policy_default_rule = default {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] profiler.connection_string     = messaging:// {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] profiler.enabled               = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] profiler.es_doc_type           = notification {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] profiler.es_scroll_size        = 10000 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] profiler.es_scroll_time        = 2m {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] profiler.filter_error_trace    = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] profiler.hmac_keys             = **** {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] profiler.sentinel_service_name = mymaster {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] profiler.socket_timeout        = 0.1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] profiler.trace_requests        = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] profiler.trace_sqlalchemy      = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] profiler_jaeger.process_tags   = {} {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] profiler_jaeger.service_name_prefix = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] profiler_otlp.service_name_prefix = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] remote_debug.host              = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] remote_debug.port              = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_notifications.retry = -1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.auth_section        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.auth_type           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.cafile              = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.certfile            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.collect_timing      = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.connect_retries     = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.connect_retry_delay = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.endpoint_id         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.endpoint_override   = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.insecure            = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.keyfile             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.max_version         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.min_version         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.region_name         = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.service_name        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.service_type        = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.split_loggers       = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.status_code_retries = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.status_code_retry_delay = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.timeout             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.valid_interfaces    = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_limit.version             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_reports.file_event_handler = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] oslo_reports.log_dir           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vif_plug_ovs_privileged.group  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] vif_plug_ovs_privileged.user   = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_ovs.isolate_vif         = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] os_brick.lock_path             = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] privsep_osbrick.capabilities   = [21] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] privsep_osbrick.group          = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] privsep_osbrick.helper_command = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] privsep_osbrick.user           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] nova_sys_admin.group           = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] nova_sys_admin.helper_command  = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] nova_sys_admin.user            = None {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG oslo_service.service [None req-46a512e6-6ef6-4199-a28d-f34cb5f826c7 None None] ******************************************************************************** {{(pid=75672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 30 12:27:26 user nova-compute[75672]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 30 12:27:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Connecting to libvirt: qemu:///system {{(pid=75672) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fdcf7f1e650> {{(pid=75672) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 30 12:27:26 user nova-compute[75672]: libvirt:  error : internal error: could not initialize domain event timer
Nov 30 12:27:26 user nova-compute[75672]: WARNING nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 30 12:27:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fdcf7f1e650> {{(pid=75672) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Starting native event thread {{(pid=75672) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Starting green dispatch thread {{(pid=75672) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 30 12:27:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Starting connection event dispatch thread {{(pid=75672) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 30 12:27:26 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Connection event '1' reason 'None'
Nov 30 12:27:26 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 30 12:27:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.mount [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Initialising _HostMountState generation 0 {{(pid=75672) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 30 12:27:33 user nova-compute[75672]: INFO nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Libvirt host capabilities <capabilities>
Nov 30 12:27:33 user nova-compute[75672]:   <host>
Nov 30 12:27:33 user nova-compute[75672]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 30 12:27:33 user nova-compute[75672]:     <cpu>
Nov 30 12:27:33 user nova-compute[75672]:       <arch>x86_64</arch>
Nov 30 12:27:33 user nova-compute[75672]:       <model>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <vendor>Intel</vendor>
Nov 30 12:27:33 user nova-compute[75672]:       <microcode version='1070'/>
Nov 30 12:27:33 user nova-compute[75672]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 30 12:27:33 user nova-compute[75672]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature name='ss'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature name='vmx'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature name='pcid'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature name='osxsave'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature name='hypervisor'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature name='arat'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature name='tsc_adjust'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature name='md-clear'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature name='stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature name='arch-capabilities'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature name='ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature name='invtsc'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature name='rsba'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature name='skip-l1dfl-vmentry'/>
Nov 30 12:27:33 user nova-compute[75672]:       <pages unit='KiB' size='4'/>
Nov 30 12:27:33 user nova-compute[75672]:       <pages unit='KiB' size='2048'/>
Nov 30 12:27:33 user nova-compute[75672]:     </cpu>
Nov 30 12:27:33 user nova-compute[75672]:     <power_management>
Nov 30 12:27:33 user nova-compute[75672]:       <suspend_mem/>
Nov 30 12:27:33 user nova-compute[75672]:       <suspend_disk/>
Nov 30 12:27:33 user nova-compute[75672]:       <suspend_hybrid/>
Nov 30 12:27:33 user nova-compute[75672]:     </power_management>
Nov 30 12:27:33 user nova-compute[75672]:     <iommu support='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     <migration_features>
Nov 30 12:27:33 user nova-compute[75672]:       <live/>
Nov 30 12:27:33 user nova-compute[75672]:       <uri_transports>
Nov 30 12:27:33 user nova-compute[75672]:         <uri_transport>tcp</uri_transport>
Nov 30 12:27:33 user nova-compute[75672]:         <uri_transport>rdma</uri_transport>
Nov 30 12:27:33 user nova-compute[75672]:       </uri_transports>
Nov 30 12:27:33 user nova-compute[75672]:     </migration_features>
Nov 30 12:27:33 user nova-compute[75672]:     <topology>
Nov 30 12:27:33 user nova-compute[75672]:       <cells num='2'>
Nov 30 12:27:33 user nova-compute[75672]:         <cell id='0'>
Nov 30 12:27:33 user nova-compute[75672]:           <memory unit='KiB'>8140616</memory>
Nov 30 12:27:33 user nova-compute[75672]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 30 12:27:33 user nova-compute[75672]:           <pages unit='KiB' size='2048'>0</pages>
Nov 30 12:27:33 user nova-compute[75672]:           <distances>
Nov 30 12:27:33 user nova-compute[75672]:             <sibling id='0' value='10'/>
Nov 30 12:27:33 user nova-compute[75672]:             <sibling id='1' value='20'/>
Nov 30 12:27:33 user nova-compute[75672]:           </distances>
Nov 30 12:27:33 user nova-compute[75672]:           <cpus num='6'>
Nov 30 12:27:33 user nova-compute[75672]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 30 12:27:33 user nova-compute[75672]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 30 12:27:33 user nova-compute[75672]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 30 12:27:33 user nova-compute[75672]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 30 12:27:33 user nova-compute[75672]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 30 12:27:33 user nova-compute[75672]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 30 12:27:33 user nova-compute[75672]:           </cpus>
Nov 30 12:27:33 user nova-compute[75672]:         </cell>
Nov 30 12:27:33 user nova-compute[75672]:         <cell id='1'>
Nov 30 12:27:33 user nova-compute[75672]:           <memory unit='KiB'>8255068</memory>
Nov 30 12:27:33 user nova-compute[75672]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 30 12:27:33 user nova-compute[75672]:           <pages unit='KiB' size='2048'>0</pages>
Nov 30 12:27:33 user nova-compute[75672]:           <distances>
Nov 30 12:27:33 user nova-compute[75672]:             <sibling id='0' value='20'/>
Nov 30 12:27:33 user nova-compute[75672]:             <sibling id='1' value='10'/>
Nov 30 12:27:33 user nova-compute[75672]:           </distances>
Nov 30 12:27:33 user nova-compute[75672]:           <cpus num='6'>
Nov 30 12:27:33 user nova-compute[75672]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 30 12:27:33 user nova-compute[75672]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 30 12:27:33 user nova-compute[75672]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 30 12:27:33 user nova-compute[75672]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 30 12:27:33 user nova-compute[75672]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 30 12:27:33 user nova-compute[75672]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 30 12:27:33 user nova-compute[75672]:           </cpus>
Nov 30 12:27:33 user nova-compute[75672]:         </cell>
Nov 30 12:27:33 user nova-compute[75672]:       </cells>
Nov 30 12:27:33 user nova-compute[75672]:     </topology>
Nov 30 12:27:33 user nova-compute[75672]:     <cache>
Nov 30 12:27:33 user nova-compute[75672]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 30 12:27:33 user nova-compute[75672]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 30 12:27:33 user nova-compute[75672]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 30 12:27:33 user nova-compute[75672]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 30 12:27:33 user nova-compute[75672]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 30 12:27:33 user nova-compute[75672]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 30 12:27:33 user nova-compute[75672]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 30 12:27:33 user nova-compute[75672]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 30 12:27:33 user nova-compute[75672]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 30 12:27:33 user nova-compute[75672]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 30 12:27:33 user nova-compute[75672]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 30 12:27:33 user nova-compute[75672]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 30 12:27:33 user nova-compute[75672]:     </cache>
Nov 30 12:27:33 user nova-compute[75672]:     <secmodel>
Nov 30 12:27:33 user nova-compute[75672]:       <model>apparmor</model>
Nov 30 12:27:33 user nova-compute[75672]:       <doi>0</doi>
Nov 30 12:27:33 user nova-compute[75672]:     </secmodel>
Nov 30 12:27:33 user nova-compute[75672]:     <secmodel>
Nov 30 12:27:33 user nova-compute[75672]:       <model>dac</model>
Nov 30 12:27:33 user nova-compute[75672]:       <doi>0</doi>
Nov 30 12:27:33 user nova-compute[75672]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 30 12:27:33 user nova-compute[75672]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 30 12:27:33 user nova-compute[75672]:     </secmodel>
Nov 30 12:27:33 user nova-compute[75672]:   </host>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='alpha'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>64</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>clipper</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='armv6l'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>spitz</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>nuri</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>kzm</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sx1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>z2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>tosa</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>n810</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>n800</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>terrier</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>midway</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>microbit</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>verdex</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>highbank</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>akita</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>connex</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>collie</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='armv7l'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>spitz</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>nuri</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>kzm</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sx1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>z2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>tosa</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>n810</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>n800</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>terrier</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>midway</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>microbit</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>verdex</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>highbank</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>akita</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>connex</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>collie</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='aarch64'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>64</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>spitz</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>nuri</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>kzm</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sx1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>z2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>tosa</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>n810</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>n800</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>terrier</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>midway</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>microbit</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>verdex</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>raspi3b</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>highbank</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>akita</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>connex</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>collie</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <acpi default='on' toggle='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='cris'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='i686'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>x-remote</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>isapc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>microvm</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='kvm'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <pae/>
Nov 30 12:27:33 user nova-compute[75672]:       <nonpae/>
Nov 30 12:27:33 user nova-compute[75672]:       <acpi default='on' toggle='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:       <apic default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='m68k'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>an5206</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>q800</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>next-cube</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='microblaze'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='microblazeel'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='mips'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='16'>malta</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='mipsel'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='16'>malta</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='mips64'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>64</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='16'>malta</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>pica61</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>magnum</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='mips64el'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>64</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='16'>malta</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>pica61</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>magnum</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='16'>boston</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='ppc'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mac99</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>40p</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>taihu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='ppc64'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>64</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2048'>powernv9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>taihu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2048'>powernv10</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>40p</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mac99</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2048'>powernv8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='ppc64le'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>64</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2048'>powernv9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>taihu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2048'>powernv10</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>40p</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>mac99</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2048'>powernv8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='riscv32'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='8'>spike</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>opentitan</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='5'>sifive_u</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sifive_e</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='8'>virt</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='riscv64'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>64</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='8'>spike</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='5'>sifive_u</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>shakti_c</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sifive_e</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='8'>virt</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='s390x'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>64</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='sh4'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>shix</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>r2d</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='sh4eb'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>64</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>shix</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>r2d</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='sparc'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>SS-5</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>SS-20</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>LX</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>SS-4</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>SS-10</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>Voyager</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='sparc64'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>64</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sun4u</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>niagara</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>sun4v</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='x86_64'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>64</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>x-remote</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='1'>isapc</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>microvm</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='kvm'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <acpi default='on' toggle='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:       <apic default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='xtensa'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>sim</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>kc705</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>ml605</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>virt</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>lx200</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>lx60</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]:   <guest>
Nov 30 12:27:33 user nova-compute[75672]:     <os_type>hvm</os_type>
Nov 30 12:27:33 user nova-compute[75672]:     <arch name='xtensaeb'>
Nov 30 12:27:33 user nova-compute[75672]:       <wordsize>32</wordsize>
Nov 30 12:27:33 user nova-compute[75672]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='4'>sim</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>kc705</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>ml605</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>virt</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>lx200</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>lx60</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 30 12:27:33 user nova-compute[75672]:       <domain type='qemu'/>
Nov 30 12:27:33 user nova-compute[75672]:     </arch>
Nov 30 12:27:33 user nova-compute[75672]:     <features>
Nov 30 12:27:33 user nova-compute[75672]:       <cpuselection/>
Nov 30 12:27:33 user nova-compute[75672]:       <deviceboot/>
Nov 30 12:27:33 user nova-compute[75672]:       <disksnapshot default='on' toggle='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     </features>
Nov 30 12:27:33 user nova-compute[75672]:   </guest>
Nov 30 12:27:33 user nova-compute[75672]: </capabilities>
Nov 30 12:27:33 user nova-compute[75672]: 
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 30 12:27:33 user nova-compute[75672]: <domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 12:27:33 user nova-compute[75672]:   <domain>kvm</domain>
Nov 30 12:27:33 user nova-compute[75672]:   <machine>pc-q35-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:   <arch>i686</arch>
Nov 30 12:27:33 user nova-compute[75672]:   <vcpu max='288'/>
Nov 30 12:27:33 user nova-compute[75672]:   <iothreads supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:   <os supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='firmware'/>
Nov 30 12:27:33 user nova-compute[75672]:     <loader supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>rom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pflash</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='readonly'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>yes</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='secure'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </loader>
Nov 30 12:27:33 user nova-compute[75672]:   </os>
Nov 30 12:27:33 user nova-compute[75672]:   <cpu>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-passthrough' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='hostPassthroughMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='maximum' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='maximumMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>on</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-model' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <vendor>Intel</vendor>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ss'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='vmx'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='pcid'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='hypervisor'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arat'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='umip'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='md-clear'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibpb'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibrs'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='erms'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='lm'/>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='custom' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>qemu64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>qemu32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>phenom</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>n270</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>kvm64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>kvm32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>coreduo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>core2duo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>athlon</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Westmere</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Snowridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Penryn</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G5</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G4</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G1</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Nehalem</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Rome</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Milan</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Dhyana</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cooperlake</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Conroe</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>486</model>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:   </cpu>
Nov 30 12:27:33 user nova-compute[75672]:   <memoryBacking supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='sourceType'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>file</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>anonymous</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>memfd</value>
Nov 30 12:27:33 user nova-compute[75672]:     </enum>
Nov 30 12:27:33 user nova-compute[75672]:   </memoryBacking>
Nov 30 12:27:33 user nova-compute[75672]:   <devices>
Nov 30 12:27:33 user nova-compute[75672]:     <disk supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='diskDevice'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>disk</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cdrom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>floppy</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>lun</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='bus'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>fdc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sata</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </disk>
Nov 30 12:27:33 user nova-compute[75672]:     <graphics supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sdl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vnc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>spice</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egl-headless</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </graphics>
Nov 30 12:27:33 user nova-compute[75672]:     <video supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='modelType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cirrus</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vmvga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>qxl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>none</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>bochs</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>ramfb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </video>
Nov 30 12:27:33 user nova-compute[75672]:     <hostdev supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='mode'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>subsystem</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='startupPolicy'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>default</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>mandatory</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>requisite</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>optional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='subsysType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pci</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='capsType'/>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='pciBackend'/>
Nov 30 12:27:33 user nova-compute[75672]:     </hostdev>
Nov 30 12:27:33 user nova-compute[75672]:     <rng supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>random</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egd</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>builtin</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </rng>
Nov 30 12:27:33 user nova-compute[75672]:     <filesystem supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='driverType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>path</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>handle</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtiofs</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </filesystem>
Nov 30 12:27:33 user nova-compute[75672]:     <tpm supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-tis</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-crb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>passthrough</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>emulator</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </tpm>
Nov 30 12:27:33 user nova-compute[75672]:   </devices>
Nov 30 12:27:33 user nova-compute[75672]:   <features>
Nov 30 12:27:33 user nova-compute[75672]:     <gic supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     <vmcoreinfo supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <genid supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backingStoreInput supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backup supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <sev supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:   </features>
Nov 30 12:27:33 user nova-compute[75672]: </domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:  {{(pid=75672) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 30 12:27:33 user nova-compute[75672]: <domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 12:27:33 user nova-compute[75672]:   <domain>kvm</domain>
Nov 30 12:27:33 user nova-compute[75672]:   <machine>pc-i440fx-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:   <arch>i686</arch>
Nov 30 12:27:33 user nova-compute[75672]:   <vcpu max='255'/>
Nov 30 12:27:33 user nova-compute[75672]:   <iothreads supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:   <os supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='firmware'/>
Nov 30 12:27:33 user nova-compute[75672]:     <loader supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>rom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pflash</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='readonly'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>yes</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='secure'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </loader>
Nov 30 12:27:33 user nova-compute[75672]:   </os>
Nov 30 12:27:33 user nova-compute[75672]:   <cpu>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-passthrough' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='hostPassthroughMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='maximum' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='maximumMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>on</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-model' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <vendor>Intel</vendor>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ss'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='vmx'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='pcid'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='hypervisor'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arat'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='umip'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='md-clear'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibpb'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibrs'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='erms'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='lm'/>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='custom' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>qemu64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>qemu32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>phenom</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>n270</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>kvm64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>kvm32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>coreduo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>core2duo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>athlon</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Westmere</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Snowridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Penryn</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G5</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G4</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G1</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Nehalem</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Rome</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Milan</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Dhyana</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cooperlake</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Conroe</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>486</model>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:   </cpu>
Nov 30 12:27:33 user nova-compute[75672]:   <memoryBacking supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='sourceType'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>file</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>anonymous</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>memfd</value>
Nov 30 12:27:33 user nova-compute[75672]:     </enum>
Nov 30 12:27:33 user nova-compute[75672]:   </memoryBacking>
Nov 30 12:27:33 user nova-compute[75672]:   <devices>
Nov 30 12:27:33 user nova-compute[75672]:     <disk supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='diskDevice'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>disk</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cdrom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>floppy</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>lun</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='bus'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>ide</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>fdc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sata</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </disk>
Nov 30 12:27:33 user nova-compute[75672]:     <graphics supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sdl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vnc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>spice</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egl-headless</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </graphics>
Nov 30 12:27:33 user nova-compute[75672]:     <video supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='modelType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cirrus</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vmvga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>qxl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>none</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>bochs</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>ramfb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </video>
Nov 30 12:27:33 user nova-compute[75672]:     <hostdev supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='mode'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>subsystem</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='startupPolicy'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>default</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>mandatory</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>requisite</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>optional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='subsysType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pci</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='capsType'/>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='pciBackend'/>
Nov 30 12:27:33 user nova-compute[75672]:     </hostdev>
Nov 30 12:27:33 user nova-compute[75672]:     <rng supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>random</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egd</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>builtin</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </rng>
Nov 30 12:27:33 user nova-compute[75672]:     <filesystem supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='driverType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>path</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>handle</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtiofs</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </filesystem>
Nov 30 12:27:33 user nova-compute[75672]:     <tpm supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-tis</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-crb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>passthrough</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>emulator</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </tpm>
Nov 30 12:27:33 user nova-compute[75672]:   </devices>
Nov 30 12:27:33 user nova-compute[75672]:   <features>
Nov 30 12:27:33 user nova-compute[75672]:     <gic supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     <vmcoreinfo supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <genid supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backingStoreInput supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backup supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <sev supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:   </features>
Nov 30 12:27:33 user nova-compute[75672]: </domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:  {{(pid=75672) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 30 12:27:33 user nova-compute[75672]: <domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 12:27:33 user nova-compute[75672]:   <domain>kvm</domain>
Nov 30 12:27:33 user nova-compute[75672]:   <machine>pc-q35-jammy</machine>
Nov 30 12:27:33 user nova-compute[75672]:   <arch>i686</arch>
Nov 30 12:27:33 user nova-compute[75672]:   <vcpu max='288'/>
Nov 30 12:27:33 user nova-compute[75672]:   <iothreads supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:   <os supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='firmware'/>
Nov 30 12:27:33 user nova-compute[75672]:     <loader supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>rom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pflash</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='readonly'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>yes</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='secure'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </loader>
Nov 30 12:27:33 user nova-compute[75672]:   </os>
Nov 30 12:27:33 user nova-compute[75672]:   <cpu>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-passthrough' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='hostPassthroughMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='maximum' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='maximumMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>on</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-model' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <vendor>Intel</vendor>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ss'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='vmx'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='pcid'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='hypervisor'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arat'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='umip'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='md-clear'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibpb'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibrs'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='erms'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='lm'/>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='custom' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>qemu64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>qemu32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>phenom</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>n270</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>kvm64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>kvm32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>coreduo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>core2duo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>athlon</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Westmere</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Snowridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Penryn</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G5</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G4</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G1</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Nehalem</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Rome</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Milan</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Dhyana</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cooperlake</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Conroe</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>486</model>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:   </cpu>
Nov 30 12:27:33 user nova-compute[75672]:   <memoryBacking supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='sourceType'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>file</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>anonymous</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>memfd</value>
Nov 30 12:27:33 user nova-compute[75672]:     </enum>
Nov 30 12:27:33 user nova-compute[75672]:   </memoryBacking>
Nov 30 12:27:33 user nova-compute[75672]:   <devices>
Nov 30 12:27:33 user nova-compute[75672]:     <disk supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='diskDevice'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>disk</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cdrom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>floppy</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>lun</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='bus'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>fdc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sata</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </disk>
Nov 30 12:27:33 user nova-compute[75672]:     <graphics supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sdl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vnc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>spice</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egl-headless</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </graphics>
Nov 30 12:27:33 user nova-compute[75672]:     <video supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='modelType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cirrus</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vmvga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>qxl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>none</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>bochs</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>ramfb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </video>
Nov 30 12:27:33 user nova-compute[75672]:     <hostdev supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='mode'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>subsystem</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='startupPolicy'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>default</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>mandatory</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>requisite</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>optional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='subsysType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pci</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='capsType'/>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='pciBackend'/>
Nov 30 12:27:33 user nova-compute[75672]:     </hostdev>
Nov 30 12:27:33 user nova-compute[75672]:     <rng supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>random</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egd</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>builtin</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </rng>
Nov 30 12:27:33 user nova-compute[75672]:     <filesystem supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='driverType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>path</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>handle</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtiofs</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </filesystem>
Nov 30 12:27:33 user nova-compute[75672]:     <tpm supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-tis</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-crb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>passthrough</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>emulator</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </tpm>
Nov 30 12:27:33 user nova-compute[75672]:   </devices>
Nov 30 12:27:33 user nova-compute[75672]:   <features>
Nov 30 12:27:33 user nova-compute[75672]:     <gic supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     <vmcoreinfo supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <genid supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backingStoreInput supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backup supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <sev supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:   </features>
Nov 30 12:27:33 user nova-compute[75672]: </domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:  {{(pid=75672) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 30 12:27:33 user nova-compute[75672]: <domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 12:27:33 user nova-compute[75672]:   <domain>kvm</domain>
Nov 30 12:27:33 user nova-compute[75672]:   <machine>pc-i440fx-jammy</machine>
Nov 30 12:27:33 user nova-compute[75672]:   <arch>i686</arch>
Nov 30 12:27:33 user nova-compute[75672]:   <vcpu max='255'/>
Nov 30 12:27:33 user nova-compute[75672]:   <iothreads supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:   <os supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='firmware'/>
Nov 30 12:27:33 user nova-compute[75672]:     <loader supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>rom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pflash</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='readonly'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>yes</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='secure'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </loader>
Nov 30 12:27:33 user nova-compute[75672]:   </os>
Nov 30 12:27:33 user nova-compute[75672]:   <cpu>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-passthrough' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='hostPassthroughMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='maximum' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='maximumMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>on</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-model' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <vendor>Intel</vendor>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ss'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='vmx'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='pcid'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='hypervisor'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arat'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='umip'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='md-clear'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibpb'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibrs'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='erms'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='lm'/>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='custom' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>qemu64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>qemu32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>phenom</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>n270</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>kvm64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>kvm32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>coreduo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>core2duo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>athlon</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Westmere</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Snowridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Penryn</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G5</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G4</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G1</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Nehalem</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Rome</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Milan</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Dhyana</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cooperlake</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Conroe</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>486</model>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:   </cpu>
Nov 30 12:27:33 user nova-compute[75672]:   <memoryBacking supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='sourceType'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>file</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>anonymous</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>memfd</value>
Nov 30 12:27:33 user nova-compute[75672]:     </enum>
Nov 30 12:27:33 user nova-compute[75672]:   </memoryBacking>
Nov 30 12:27:33 user nova-compute[75672]:   <devices>
Nov 30 12:27:33 user nova-compute[75672]:     <disk supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='diskDevice'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>disk</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cdrom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>floppy</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>lun</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='bus'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>ide</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>fdc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sata</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </disk>
Nov 30 12:27:33 user nova-compute[75672]:     <graphics supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sdl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vnc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>spice</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egl-headless</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </graphics>
Nov 30 12:27:33 user nova-compute[75672]:     <video supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='modelType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cirrus</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vmvga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>qxl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>none</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>bochs</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>ramfb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </video>
Nov 30 12:27:33 user nova-compute[75672]:     <hostdev supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='mode'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>subsystem</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='startupPolicy'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>default</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>mandatory</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>requisite</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>optional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='subsysType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pci</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='capsType'/>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='pciBackend'/>
Nov 30 12:27:33 user nova-compute[75672]:     </hostdev>
Nov 30 12:27:33 user nova-compute[75672]:     <rng supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>random</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egd</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>builtin</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </rng>
Nov 30 12:27:33 user nova-compute[75672]:     <filesystem supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='driverType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>path</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>handle</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtiofs</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </filesystem>
Nov 30 12:27:33 user nova-compute[75672]:     <tpm supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-tis</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-crb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>passthrough</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>emulator</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </tpm>
Nov 30 12:27:33 user nova-compute[75672]:   </devices>
Nov 30 12:27:33 user nova-compute[75672]:   <features>
Nov 30 12:27:33 user nova-compute[75672]:     <gic supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     <vmcoreinfo supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <genid supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backingStoreInput supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backup supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <sev supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:   </features>
Nov 30 12:27:33 user nova-compute[75672]: </domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:  {{(pid=75672) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 30 12:27:33 user nova-compute[75672]: <domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 12:27:33 user nova-compute[75672]:   <domain>kvm</domain>
Nov 30 12:27:33 user nova-compute[75672]:   <machine>pc-q35-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:   <arch>x86_64</arch>
Nov 30 12:27:33 user nova-compute[75672]:   <vcpu max='288'/>
Nov 30 12:27:33 user nova-compute[75672]:   <iothreads supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:   <os supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='firmware'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>efi</value>
Nov 30 12:27:33 user nova-compute[75672]:     </enum>
Nov 30 12:27:33 user nova-compute[75672]:     <loader supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>rom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pflash</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='readonly'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>yes</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='secure'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>yes</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </loader>
Nov 30 12:27:33 user nova-compute[75672]:   </os>
Nov 30 12:27:33 user nova-compute[75672]:   <cpu>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-passthrough' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='hostPassthroughMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>on</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='maximum' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='maximumMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>on</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-model' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <vendor>Intel</vendor>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ss'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='vmx'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='pcid'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='hypervisor'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arat'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='umip'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='md-clear'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='invtsc'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibpb'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibrs'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='rsba'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='erms'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='custom' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>qemu64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>qemu32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>phenom</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>n270</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>kvm64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>kvm32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>coreduo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>core2duo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>athlon</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Westmere</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Snowridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Penryn</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G5</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G4</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Opteron_G1</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Nehalem</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Rome</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Milan</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Dhyana</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cooperlake</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Conroe</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>486</model>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:   </cpu>
Nov 30 12:27:33 user nova-compute[75672]:   <memoryBacking supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='sourceType'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>file</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>anonymous</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>memfd</value>
Nov 30 12:27:33 user nova-compute[75672]:     </enum>
Nov 30 12:27:33 user nova-compute[75672]:   </memoryBacking>
Nov 30 12:27:33 user nova-compute[75672]:   <devices>
Nov 30 12:27:33 user nova-compute[75672]:     <disk supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='diskDevice'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>disk</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cdrom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>floppy</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>lun</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='bus'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>fdc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sata</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </disk>
Nov 30 12:27:33 user nova-compute[75672]:     <graphics supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sdl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vnc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>spice</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egl-headless</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </graphics>
Nov 30 12:27:33 user nova-compute[75672]:     <video supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='modelType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cirrus</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vmvga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>qxl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>none</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>bochs</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>ramfb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </video>
Nov 30 12:27:33 user nova-compute[75672]:     <hostdev supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='mode'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>subsystem</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='startupPolicy'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>default</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>mandatory</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>requisite</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>optional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='subsysType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pci</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='capsType'/>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='pciBackend'/>
Nov 30 12:27:33 user nova-compute[75672]:     </hostdev>
Nov 30 12:27:33 user nova-compute[75672]:     <rng supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>random</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egd</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>builtin</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </rng>
Nov 30 12:27:33 user nova-compute[75672]:     <filesystem supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='driverType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>path</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>handle</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtiofs</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </filesystem>
Nov 30 12:27:33 user nova-compute[75672]:     <tpm supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-tis</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-crb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>passthrough</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>emulator</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </tpm>
Nov 30 12:27:33 user nova-compute[75672]:   </devices>
Nov 30 12:27:33 user nova-compute[75672]:   <features>
Nov 30 12:27:33 user nova-compute[75672]:     <gic supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     <vmcoreinfo supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <genid supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backingStoreInput supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backup supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <sev supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:   </features>
Nov 30 12:27:33 user nova-compute[75672]: </domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:  {{(pid=75672) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 30 12:27:33 user nova-compute[75672]: <domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 12:27:33 user nova-compute[75672]:   <domain>kvm</domain>
Nov 30 12:27:33 user nova-compute[75672]:   <machine>pc-i440fx-6.2</machine>
Nov 30 12:27:33 user nova-compute[75672]:   <arch>x86_64</arch>
Nov 30 12:27:33 user nova-compute[75672]:   <vcpu max='255'/>
Nov 30 12:27:33 user nova-compute[75672]:   <iothreads supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:   <os supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='firmware'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>efi</value>
Nov 30 12:27:33 user nova-compute[75672]:     </enum>
Nov 30 12:27:33 user nova-compute[75672]:     <loader supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>rom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pflash</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='readonly'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>yes</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='secure'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </loader>
Nov 30 12:27:33 user nova-compute[75672]:   </os>
Nov 30 12:27:33 user nova-compute[75672]:   <cpu>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-passthrough' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='hostPassthroughMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>on</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='maximum' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='maximumMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>on</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-model' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <vendor>Intel</vendor>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ss'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='vmx'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='pcid'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='hypervisor'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arat'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='umip'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='md-clear'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='invtsc'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibpb'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibrs'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='rsba'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='erms'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='custom' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>qemu64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>qemu32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>phenom</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>n270</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>kvm64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>kvm32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>coreduo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>core2duo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>athlon</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Westmere</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Snowridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Penryn</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G5</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G4</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Opteron_G1</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Nehalem</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Rome</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Milan</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Dhyana</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cooperlake</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Conroe</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>486</model>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:   </cpu>
Nov 30 12:27:33 user nova-compute[75672]:   <memoryBacking supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='sourceType'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>file</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>anonymous</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>memfd</value>
Nov 30 12:27:33 user nova-compute[75672]:     </enum>
Nov 30 12:27:33 user nova-compute[75672]:   </memoryBacking>
Nov 30 12:27:33 user nova-compute[75672]:   <devices>
Nov 30 12:27:33 user nova-compute[75672]:     <disk supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='diskDevice'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>disk</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cdrom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>floppy</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>lun</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='bus'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>ide</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>fdc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sata</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </disk>
Nov 30 12:27:33 user nova-compute[75672]:     <graphics supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sdl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vnc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>spice</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egl-headless</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </graphics>
Nov 30 12:27:33 user nova-compute[75672]:     <video supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='modelType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cirrus</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vmvga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>qxl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>none</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>bochs</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>ramfb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </video>
Nov 30 12:27:33 user nova-compute[75672]:     <hostdev supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='mode'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>subsystem</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='startupPolicy'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>default</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>mandatory</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>requisite</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>optional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='subsysType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pci</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='capsType'/>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='pciBackend'/>
Nov 30 12:27:33 user nova-compute[75672]:     </hostdev>
Nov 30 12:27:33 user nova-compute[75672]:     <rng supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>random</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egd</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>builtin</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </rng>
Nov 30 12:27:33 user nova-compute[75672]:     <filesystem supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='driverType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>path</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>handle</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtiofs</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </filesystem>
Nov 30 12:27:33 user nova-compute[75672]:     <tpm supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-tis</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-crb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>passthrough</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>emulator</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </tpm>
Nov 30 12:27:33 user nova-compute[75672]:   </devices>
Nov 30 12:27:33 user nova-compute[75672]:   <features>
Nov 30 12:27:33 user nova-compute[75672]:     <gic supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     <vmcoreinfo supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <genid supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backingStoreInput supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backup supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <sev supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:   </features>
Nov 30 12:27:33 user nova-compute[75672]: </domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:  {{(pid=75672) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 30 12:27:33 user nova-compute[75672]: <domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 12:27:33 user nova-compute[75672]:   <domain>kvm</domain>
Nov 30 12:27:33 user nova-compute[75672]:   <machine>pc-q35-jammy</machine>
Nov 30 12:27:33 user nova-compute[75672]:   <arch>x86_64</arch>
Nov 30 12:27:33 user nova-compute[75672]:   <vcpu max='288'/>
Nov 30 12:27:33 user nova-compute[75672]:   <iothreads supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:   <os supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='firmware'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>efi</value>
Nov 30 12:27:33 user nova-compute[75672]:     </enum>
Nov 30 12:27:33 user nova-compute[75672]:     <loader supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>rom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pflash</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='readonly'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>yes</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='secure'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>yes</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </loader>
Nov 30 12:27:33 user nova-compute[75672]:   </os>
Nov 30 12:27:33 user nova-compute[75672]:   <cpu>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-passthrough' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='hostPassthroughMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>on</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='maximum' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='maximumMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>on</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-model' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <vendor>Intel</vendor>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ss'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='vmx'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='pcid'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='hypervisor'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arat'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='umip'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='md-clear'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='invtsc'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibpb'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibrs'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='rsba'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='erms'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='custom' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>qemu64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>qemu32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>phenom</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>n270</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>kvm64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>kvm32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>coreduo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>core2duo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>athlon</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Westmere</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Snowridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Penryn</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G5</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G4</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Opteron_G1</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Nehalem</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Rome</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Milan</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Dhyana</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cooperlake</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Conroe</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>486</model>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:   </cpu>
Nov 30 12:27:33 user nova-compute[75672]:   <memoryBacking supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='sourceType'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>file</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>anonymous</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>memfd</value>
Nov 30 12:27:33 user nova-compute[75672]:     </enum>
Nov 30 12:27:33 user nova-compute[75672]:   </memoryBacking>
Nov 30 12:27:33 user nova-compute[75672]:   <devices>
Nov 30 12:27:33 user nova-compute[75672]:     <disk supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='diskDevice'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>disk</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cdrom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>floppy</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>lun</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='bus'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>fdc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sata</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </disk>
Nov 30 12:27:33 user nova-compute[75672]:     <graphics supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sdl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vnc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>spice</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egl-headless</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </graphics>
Nov 30 12:27:33 user nova-compute[75672]:     <video supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='modelType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cirrus</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vmvga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>qxl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>none</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>bochs</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>ramfb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </video>
Nov 30 12:27:33 user nova-compute[75672]:     <hostdev supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='mode'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>subsystem</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='startupPolicy'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>default</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>mandatory</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>requisite</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>optional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='subsysType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pci</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='capsType'/>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='pciBackend'/>
Nov 30 12:27:33 user nova-compute[75672]:     </hostdev>
Nov 30 12:27:33 user nova-compute[75672]:     <rng supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>random</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egd</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>builtin</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </rng>
Nov 30 12:27:33 user nova-compute[75672]:     <filesystem supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='driverType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>path</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>handle</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtiofs</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </filesystem>
Nov 30 12:27:33 user nova-compute[75672]:     <tpm supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-tis</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-crb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>passthrough</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>emulator</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </tpm>
Nov 30 12:27:33 user nova-compute[75672]:   </devices>
Nov 30 12:27:33 user nova-compute[75672]:   <features>
Nov 30 12:27:33 user nova-compute[75672]:     <gic supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     <vmcoreinfo supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <genid supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backingStoreInput supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backup supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <sev supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:   </features>
Nov 30 12:27:33 user nova-compute[75672]: </domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:  {{(pid=75672) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 30 12:27:33 user nova-compute[75672]: <domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 12:27:33 user nova-compute[75672]:   <domain>kvm</domain>
Nov 30 12:27:33 user nova-compute[75672]:   <machine>pc-i440fx-jammy</machine>
Nov 30 12:27:33 user nova-compute[75672]:   <arch>x86_64</arch>
Nov 30 12:27:33 user nova-compute[75672]:   <vcpu max='255'/>
Nov 30 12:27:33 user nova-compute[75672]:   <iothreads supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:   <os supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='firmware'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>efi</value>
Nov 30 12:27:33 user nova-compute[75672]:     </enum>
Nov 30 12:27:33 user nova-compute[75672]:     <loader supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>rom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pflash</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='readonly'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>yes</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='secure'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>no</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </loader>
Nov 30 12:27:33 user nova-compute[75672]:   </os>
Nov 30 12:27:33 user nova-compute[75672]:   <cpu>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-passthrough' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='hostPassthroughMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>on</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='maximum' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='maximumMigratable'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>on</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>off</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='host-model' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <vendor>Intel</vendor>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ss'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='vmx'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='pcid'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='hypervisor'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arat'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='umip'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='md-clear'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='invtsc'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibpb'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='ibrs'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-stibp'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='rsba'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='erms'/>
Nov 30 12:27:33 user nova-compute[75672]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:     <mode name='custom' supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>qemu64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>qemu32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>phenom</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>pentium</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>n270</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>kvm64</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>kvm32</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>coreduo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>core2duo</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>athlon</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Westmere</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Snowridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Skylake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>SandyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Penryn</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G5</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G4</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G3</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Opteron_G2</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Opteron_G1</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Nehalem</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>IvyBridge</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Icelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Haswell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Rome</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-Milan</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>EPYC</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Dhyana</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cooperlake</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>Conroe</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='no'>Broadwell</model>
Nov 30 12:27:33 user nova-compute[75672]:       <model usable='yes'>486</model>
Nov 30 12:27:33 user nova-compute[75672]:     </mode>
Nov 30 12:27:33 user nova-compute[75672]:   </cpu>
Nov 30 12:27:33 user nova-compute[75672]:   <memoryBacking supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:     <enum name='sourceType'>
Nov 30 12:27:33 user nova-compute[75672]:       <value>file</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>anonymous</value>
Nov 30 12:27:33 user nova-compute[75672]:       <value>memfd</value>
Nov 30 12:27:33 user nova-compute[75672]:     </enum>
Nov 30 12:27:33 user nova-compute[75672]:   </memoryBacking>
Nov 30 12:27:33 user nova-compute[75672]:   <devices>
Nov 30 12:27:33 user nova-compute[75672]:     <disk supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='diskDevice'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>disk</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cdrom</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>floppy</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>lun</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='bus'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>ide</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>fdc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sata</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </disk>
Nov 30 12:27:33 user nova-compute[75672]:     <graphics supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='type'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>sdl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vnc</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>spice</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egl-headless</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </graphics>
Nov 30 12:27:33 user nova-compute[75672]:     <video supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='modelType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>cirrus</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>vmvga</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>qxl</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>none</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>bochs</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>ramfb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </video>
Nov 30 12:27:33 user nova-compute[75672]:     <hostdev supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='mode'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>subsystem</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='startupPolicy'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>default</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>mandatory</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>requisite</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>optional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='subsysType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>usb</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>pci</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>scsi</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='capsType'/>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='pciBackend'/>
Nov 30 12:27:33 user nova-compute[75672]:     </hostdev>
Nov 30 12:27:33 user nova-compute[75672]:     <rng supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtio-non-transitional</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>random</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>egd</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>builtin</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </rng>
Nov 30 12:27:33 user nova-compute[75672]:     <filesystem supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='driverType'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>path</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>handle</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>virtiofs</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </filesystem>
Nov 30 12:27:33 user nova-compute[75672]:     <tpm supported='yes'>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='model'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-tis</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>tpm-crb</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:       <enum name='backendModel'>
Nov 30 12:27:33 user nova-compute[75672]:         <value>passthrough</value>
Nov 30 12:27:33 user nova-compute[75672]:         <value>emulator</value>
Nov 30 12:27:33 user nova-compute[75672]:       </enum>
Nov 30 12:27:33 user nova-compute[75672]:     </tpm>
Nov 30 12:27:33 user nova-compute[75672]:   </devices>
Nov 30 12:27:33 user nova-compute[75672]:   <features>
Nov 30 12:27:33 user nova-compute[75672]:     <gic supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:     <vmcoreinfo supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <genid supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backingStoreInput supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <backup supported='yes'/>
Nov 30 12:27:33 user nova-compute[75672]:     <sev supported='no'/>
Nov 30 12:27:33 user nova-compute[75672]:   </features>
Nov 30 12:27:33 user nova-compute[75672]: </domainCapabilities>
Nov 30 12:27:33 user nova-compute[75672]:  {{(pid=75672) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75672) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75672) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Checking secure boot support for host arch (x86_64) {{(pid=75672) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 30 12:27:33 user nova-compute[75672]: INFO nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Secure Boot support detected
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] cpu compare xml: <cpu match="exact">
Nov 30 12:27:33 user nova-compute[75672]:   <model>Nehalem</model>
Nov 30 12:27:33 user nova-compute[75672]: </cpu>
Nov 30 12:27:33 user nova-compute[75672]:  {{(pid=75672) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10017}}
Nov 30 12:27:33 user nova-compute[75672]: INFO nova.virt.node [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Generated node identity 9d360ecf-be43-4c84-93ca-abc6f9902098
Nov 30 12:27:33 user nova-compute[75672]: INFO nova.virt.node [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Wrote node identity 9d360ecf-be43-4c84-93ca-abc6f9902098 to /opt/stack/data/nova/compute_id
Nov 30 12:27:33 user nova-compute[75672]: WARNING nova.compute.manager [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Compute nodes ['9d360ecf-be43-4c84-93ca-abc6f9902098'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 30 12:27:33 user nova-compute[75672]: INFO nova.compute.manager [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 30 12:27:33 user nova-compute[75672]: WARNING nova.compute.manager [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 30 12:27:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:27:33 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:27:34 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:27:34 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Hypervisor/Node resource view: name=user free_ram=10950MB free_disk=26.102935791015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:27:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:27:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:27:34 user nova-compute[75672]: WARNING nova.compute.resource_tracker [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] No compute node record for user:9d360ecf-be43-4c84-93ca-abc6f9902098: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 9d360ecf-be43-4c84-93ca-abc6f9902098 could not be found.
Nov 30 12:27:34 user nova-compute[75672]: INFO nova.compute.resource_tracker [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Compute node record created for user:user with uuid: 9d360ecf-be43-4c84-93ca-abc6f9902098
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:27:34 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] [req-aec5edc8-5c8d-435b-b98d-7e24978b145c] Created resource provider record via placement API for resource provider with UUID 9d360ecf-be43-4c84-93ca-abc6f9902098 and name user.
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75672) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 30 12:27:34 user nova-compute[75672]: INFO nova.virt.libvirt.host [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] kernel doesn't support AMD SEV
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Updating inventory in ProviderTree for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Libvirt baseline CPU <cpu>
Nov 30 12:27:34 user nova-compute[75672]:   <arch>x86_64</arch>
Nov 30 12:27:34 user nova-compute[75672]:   <model>Nehalem</model>
Nov 30 12:27:34 user nova-compute[75672]:   <vendor>Intel</vendor>
Nov 30 12:27:34 user nova-compute[75672]:   <topology sockets="6" cores="1" threads="1"/>
Nov 30 12:27:34 user nova-compute[75672]: </cpu>
Nov 30 12:27:34 user nova-compute[75672]:  {{(pid=75672) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12515}}
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Updated inventory for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Updating resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098 generation from 0 to 1 during operation: update_inventory {{(pid=75672) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Updating inventory in ProviderTree for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Updating resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098 generation from 1 to 2 during operation: update_traits {{(pid=75672) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:27:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.service [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Creating RPC server for service compute {{(pid=75672) start /opt/stack/nova/nova/service.py:182}}
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.service [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] Join ServiceGroup membership for this service compute {{(pid=75672) start /opt/stack/nova/nova/service.py:199}}
Nov 30 12:27:34 user nova-compute[75672]: DEBUG nova.servicegroup.drivers.db [None req-ca3c192c-78e8-446f-89af-2be32e2a369f None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75672) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 30 12:27:43 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_power_states {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:27:43 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Didn't find any instances for network info cache update. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:28:25 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:28:25 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:28:25 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=10392MB free_disk=26.006790161132812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:28:25 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:28:26 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:28:26 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:28:26 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:28:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:29:26 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:29:26 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:29:26 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=10307MB free_disk=26.07196044921875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:29:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 12:29:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Didn't find any instances for network info cache update. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 12:29:27 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:29:27 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:29:27 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:29:27 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:29:27 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:29:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:30:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:30:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:30:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:30:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:30:25 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:30:25 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:30:25 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:30:25 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=10288MB free_disk=25.82569122314453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:30:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:30:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:30:26 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:30:26 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:30:26 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:30:26 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:30:26 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:30:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:30:27 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:30:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:30:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 12:30:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Didn't find any instances for network info cache update. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 12:30:27 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:30:27 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:30:27 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:30:27 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:30:28 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:30:28 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:30:28 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:30:29 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:31:26 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:31:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:31:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 12:31:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Didn't find any instances for network info cache update. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 12:31:26 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:31:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:26 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:31:26 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:31:26 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:31:26 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=9646MB free_disk=25.852825164794922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:31:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:26 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:31:26 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:31:27 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:31:27 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:31:27 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:31:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:28 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:31:28 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:31:28 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:31:28 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:31:29 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:31:29 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:31:30 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:31:30 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:31:30 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:31:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:40 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:31:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:40 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:31:40 user nova-compute[75672]: INFO nova.compute.claims [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Claim successful on node user
Nov 30 12:31:40 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:31:40 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:31:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:40 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:31:40 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:31:40 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:31:40 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:31:40 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:31:41 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:31:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:31:41 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Creating image(s)
Nov 30 12:31:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "/opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "/opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "/opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:42 user nova-compute[75672]: DEBUG nova.policy [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61c6bf770dfe4eadba28f371b29f1d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d2f3e56844b68b3a0c71f8a7f5454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:31:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211.part --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:42 user nova-compute[75672]: DEBUG nova.virt.images [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] f1bddb75-c432-42ad-9253-e3e4a10e804c was qcow2, converting to raw {{(pid=75672) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 12:31:42 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:31:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211.part /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211.converted {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "62555959-6271-47e1-920c-b6333de4cca4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "62555959-6271-47e1-920c-b6333de4cca4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:31:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211.part /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211.converted" returned: 0 in 0.537s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211.converted --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:43 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:31:43 user nova-compute[75672]: INFO nova.compute.claims [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Claim successful on node user
Nov 30 12:31:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211.converted --force-share --output=json" returned: 0 in 0.330s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.464s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:43 user nova-compute[75672]: INFO oslo.privsep.daemon [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmqfcub7a/privsep.sock']
Nov 30 12:31:43 user sudo[84918]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmqfcub7a/privsep.sock
Nov 30 12:31:43 user sudo[84918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 12:31:43 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:31:43 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:31:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:31:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:31:43 user nova-compute[75672]: DEBUG nova.network.neutron [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:31:43 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:31:44 user nova-compute[75672]: DEBUG nova.compute.manager [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:31:44 user nova-compute[75672]: DEBUG nova.compute.manager [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:31:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:31:44 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Creating image(s)
Nov 30 12:31:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "/opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "/opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "/opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:44 user nova-compute[75672]: DEBUG nova.policy [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61c6bf770dfe4eadba28f371b29f1d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d2f3e56844b68b3a0c71f8a7f5454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:31:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:44 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:31:45 user nova-compute[75672]: INFO nova.compute.claims [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Claim successful on node user
Nov 30 12:31:45 user sudo[84918]: pam_unix(sudo:session): session closed for user root
Nov 30 12:31:45 user nova-compute[75672]: INFO oslo.privsep.daemon [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Spawned new privsep daemon via rootwrap
Nov 30 12:31:45 user nova-compute[75672]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 12:31:45 user nova-compute[75672]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 12:31:45 user nova-compute[75672]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 30 12:31:45 user nova-compute[75672]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84929
Nov 30 12:31:45 user nova-compute[75672]: WARNING oslo_privsep.priv_context [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] privsep daemon already running
Nov 30 12:31:45 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:31:45 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:31:45 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.168s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.230s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:31:45 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Creating image(s)
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "/opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "/opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG nova.policy [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3166f2b3dee4aa4aa738f1f15ca7d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f07019e3584771af197e865b6877cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk 1073741824" returned: 0 in 0.054s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.232s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.236s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.161s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:31:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.167s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk 1073741824" returned: 0 in 0.046s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.220s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Successfully created port: fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Cannot resize image /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Ensure instance console log exists: /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.188s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:31:46 user nova-compute[75672]: INFO nova.compute.claims [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Claim successful on node user
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk 1073741824" returned: 0 in 0.104s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Cannot resize image /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Ensure instance console log exists: /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Successfully created port: eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.193s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Cannot resize image /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Ensure instance console log exists: /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:31:46 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:31:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:31:47 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Creating image(s)
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "/opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "/opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG nova.policy [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e98ee9bd3b604b39a3f6013a40398642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0ca8eb58644e058b2019a4faa41a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.204s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk 1073741824" returned: 0 in 0.266s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.474s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.206s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:31:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:48 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Cannot resize image /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:31:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:31:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Ensure instance console log exists: /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:31:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:48 user nova-compute[75672]: DEBUG nova.network.neutron [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Successfully updated port: eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:31:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:31:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquired lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:31:48 user nova-compute[75672]: DEBUG nova.network.neutron [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:31:48 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Successfully created port: 890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:31:49 user nova-compute[75672]: DEBUG nova.network.neutron [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:31:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-0aa51905-5668-4c2d-8dec-b16b1d9c6900 req-e44c8cc6-d88c-4930-ad0e-cbb2e20448f5 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received event network-changed-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:31:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-0aa51905-5668-4c2d-8dec-b16b1d9c6900 req-e44c8cc6-d88c-4930-ad0e-cbb2e20448f5 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Refreshing instance network info cache due to event network-changed-eb326ae3-464f-42bf-8e4d-ca951d6115a0. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:31:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0aa51905-5668-4c2d-8dec-b16b1d9c6900 req-e44c8cc6-d88c-4930-ad0e-cbb2e20448f5 service nova] Acquiring lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:31:49 user nova-compute[75672]: DEBUG nova.network.neutron [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Updating instance_info_cache with network_info: [{"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Releasing lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Instance network_info: |[{"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0aa51905-5668-4c2d-8dec-b16b1d9c6900 req-e44c8cc6-d88c-4930-ad0e-cbb2e20448f5 service nova] Acquired lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.network.neutron [req-0aa51905-5668-4c2d-8dec-b16b1d9c6900 req-e44c8cc6-d88c-4930-ad0e-cbb2e20448f5 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Refreshing network info cache for port eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Start _get_guest_xml network_info=[{"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:31:50 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:31:50 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-197576731',display_name='tempest-ServerRescueNegativeTestJSON-server-197576731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-197576731',id=2,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='601d2f3e56844b68b3a0c71f8a7f5454',ramdisk_id='',reservation_id='r-n98vn0nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-928198583',owner_user_name='tempest-ServerRescueNegativeTestJSON-928198583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:31:44Z,user_data=None,user_id='61c6bf770dfe4eadba28f371b29f1d79',uuid=62555959-6271-47e1-920c-b6333de4cca4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converting VIF {"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:41:41,bridge_name='br-int',has_traffic_filtering=True,id=eb326ae3-464f-42bf-8e4d-ca951d6115a0,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb326ae3-46') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.objects.instance [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'pci_devices' on Instance uuid 62555959-6271-47e1-920c-b6333de4cca4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:31:50 user nova-compute[75672]:   <uuid>62555959-6271-47e1-920c-b6333de4cca4</uuid>
Nov 30 12:31:50 user nova-compute[75672]:   <name>instance-00000002</name>
Nov 30 12:31:50 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:31:50 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:31:50 user nova-compute[75672]:   <metadata>
Nov 30 12:31:50 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:31:50 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:31:50 user nova-compute[75672]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-197576731</nova:name>
Nov 30 12:31:50 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:31:50</nova:creationTime>
Nov 30 12:31:50 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:31:50 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:31:50 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:31:50 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:31:50 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:31:50 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:31:50 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:31:50 user nova-compute[75672]:       <nova:owner>
Nov 30 12:31:50 user nova-compute[75672]:         <nova:user uuid="61c6bf770dfe4eadba28f371b29f1d79">tempest-ServerRescueNegativeTestJSON-928198583-project-member</nova:user>
Nov 30 12:31:50 user nova-compute[75672]:         <nova:project uuid="601d2f3e56844b68b3a0c71f8a7f5454">tempest-ServerRescueNegativeTestJSON-928198583</nova:project>
Nov 30 12:31:50 user nova-compute[75672]:       </nova:owner>
Nov 30 12:31:50 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:31:50 user nova-compute[75672]:       <nova:ports>
Nov 30 12:31:50 user nova-compute[75672]:         <nova:port uuid="eb326ae3-464f-42bf-8e4d-ca951d6115a0">
Nov 30 12:31:50 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 12:31:50 user nova-compute[75672]:         </nova:port>
Nov 30 12:31:50 user nova-compute[75672]:       </nova:ports>
Nov 30 12:31:50 user nova-compute[75672]:     </nova:instance>
Nov 30 12:31:50 user nova-compute[75672]:   </metadata>
Nov 30 12:31:50 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:31:50 user nova-compute[75672]:     <system>
Nov 30 12:31:50 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:31:50 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:31:50 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:31:50 user nova-compute[75672]:       <entry name="serial">62555959-6271-47e1-920c-b6333de4cca4</entry>
Nov 30 12:31:50 user nova-compute[75672]:       <entry name="uuid">62555959-6271-47e1-920c-b6333de4cca4</entry>
Nov 30 12:31:50 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:31:50 user nova-compute[75672]:     </system>
Nov 30 12:31:50 user nova-compute[75672]:   </sysinfo>
Nov 30 12:31:50 user nova-compute[75672]:   <os>
Nov 30 12:31:50 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:31:50 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:31:50 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:31:50 user nova-compute[75672]:   </os>
Nov 30 12:31:50 user nova-compute[75672]:   <features>
Nov 30 12:31:50 user nova-compute[75672]:     <acpi/>
Nov 30 12:31:50 user nova-compute[75672]:     <apic/>
Nov 30 12:31:50 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:31:50 user nova-compute[75672]:   </features>
Nov 30 12:31:50 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:31:50 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:31:50 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:31:50 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:31:50 user nova-compute[75672]:   </clock>
Nov 30 12:31:50 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:31:50 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:31:50 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:31:50 user nova-compute[75672]:   </cpu>
Nov 30 12:31:50 user nova-compute[75672]:   <devices>
Nov 30 12:31:50 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:31:50 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:31:50 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk"/>
Nov 30 12:31:50 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:31:50 user nova-compute[75672]:     </disk>
Nov 30 12:31:50 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:31:50 user nova-compute[75672]:       <mac address="fa:16:3e:63:41:41"/>
Nov 30 12:31:50 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:31:50 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:31:50 user nova-compute[75672]:       <target dev="tapeb326ae3-46"/>
Nov 30 12:31:50 user nova-compute[75672]:     </interface>
Nov 30 12:31:50 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:31:50 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/console.log" append="off"/>
Nov 30 12:31:50 user nova-compute[75672]:     </serial>
Nov 30 12:31:50 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:31:50 user nova-compute[75672]:     <video>
Nov 30 12:31:50 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:31:50 user nova-compute[75672]:     </video>
Nov 30 12:31:50 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:31:50 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:31:50 user nova-compute[75672]:     </rng>
Nov 30 12:31:50 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:31:50 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:31:50 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:31:50 user nova-compute[75672]:     </memballoon>
Nov 30 12:31:50 user nova-compute[75672]:   </devices>
Nov 30 12:31:50 user nova-compute[75672]: </domain>
Nov 30 12:31:50 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-197576731',display_name='tempest-ServerRescueNegativeTestJSON-server-197576731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-197576731',id=2,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='601d2f3e56844b68b3a0c71f8a7f5454',ramdisk_id='',reservation_id='r-n98vn0nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-928198583',owner_user_name='tempest-ServerRescueNegativeTestJSON-928198583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:31:44Z,user_data=None,user_id='61c6bf770dfe4eadba28f371b29f1d79',uuid=62555959-6271-47e1-920c-b6333de4cca4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converting VIF {"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:41:41,bridge_name='br-int',has_traffic_filtering=True,id=eb326ae3-464f-42bf-8e4d-ca951d6115a0,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb326ae3-46') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG os_vif [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:41:41,bridge_name='br-int',has_traffic_filtering=True,id=eb326ae3-464f-42bf-8e4d-ca951d6115a0,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb326ae3-46') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Created schema index Interface.name {{(pid=75672) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Created schema index Port.name {{(pid=75672) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Created schema index Bridge.name {{(pid=75672) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [POLLOUT] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Successfully updated port: fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6e13461-4708-5cac-a1a0-d3edc3ba6d69', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:50 user nova-compute[75672]: INFO oslo.privsep.daemon [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpkxkvsw4z/privsep.sock']
Nov 30 12:31:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquired lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:31:50 user sudo[84996]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpkxkvsw4z/privsep.sock
Nov 30 12:31:50 user sudo[84996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.compute.manager [req-fbbec61b-597e-43b7-b801-0b30d6cd0b8d req-6015054a-76c9-4025-8c82-5e1be0e50d84 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-changed-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG nova.compute.manager [req-fbbec61b-597e-43b7-b801-0b30d6cd0b8d req-6015054a-76c9-4025-8c82-5e1be0e50d84 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Refreshing instance network info cache due to event network-changed-fbe1de56-aab3-47e7-914b-e51e070c8679. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:31:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fbbec61b-597e-43b7-b801-0b30d6cd0b8d req-6015054a-76c9-4025-8c82-5e1be0e50d84 service nova] Acquiring lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:31:51 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Successfully created port: 5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:31:51 user nova-compute[75672]: DEBUG nova.network.neutron [req-0aa51905-5668-4c2d-8dec-b16b1d9c6900 req-e44c8cc6-d88c-4930-ad0e-cbb2e20448f5 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Updated VIF entry in instance network info cache for port eb326ae3-464f-42bf-8e4d-ca951d6115a0. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:31:51 user nova-compute[75672]: DEBUG nova.network.neutron [req-0aa51905-5668-4c2d-8dec-b16b1d9c6900 req-e44c8cc6-d88c-4930-ad0e-cbb2e20448f5 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Updating instance_info_cache with network_info: [{"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:31:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0aa51905-5668-4c2d-8dec-b16b1d9c6900 req-e44c8cc6-d88c-4930-ad0e-cbb2e20448f5 service nova] Releasing lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:31:51 user sudo[84996]: pam_unix(sudo:session): session closed for user root
Nov 30 12:31:51 user nova-compute[75672]: INFO oslo.privsep.daemon [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Spawned new privsep daemon via rootwrap
Nov 30 12:31:51 user nova-compute[75672]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 12:31:51 user nova-compute[75672]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 12:31:51 user nova-compute[75672]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 30 12:31:51 user nova-compute[75672]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84999
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb326ae3-46, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb326ae3-46, col_values=(('qos', UUID('8e75ac0a-5375-43a3-9db6-80f623e530fc')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb326ae3-46, col_values=(('external_ids', {'iface-id': 'eb326ae3-464f-42bf-8e4d-ca951d6115a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:41:41', 'vm-uuid': '62555959-6271-47e1-920c-b6333de4cca4'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:52 user nova-compute[75672]: INFO os_vif [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:41:41,bridge_name='br-int',has_traffic_filtering=True,id=eb326ae3-464f-42bf-8e4d-ca951d6115a0,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb326ae3-46')
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Updating instance_info_cache with network_info: [{"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No VIF found with MAC fa:16:3e:63:41:41, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Releasing lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Instance network_info: |[{"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fbbec61b-597e-43b7-b801-0b30d6cd0b8d req-6015054a-76c9-4025-8c82-5e1be0e50d84 service nova] Acquired lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.network.neutron [req-fbbec61b-597e-43b7-b801-0b30d6cd0b8d req-6015054a-76c9-4025-8c82-5e1be0e50d84 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Refreshing network info cache for port fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Start _get_guest_xml network_info=[{"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:31:52 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:31:52 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-599375833',display_name='tempest-ServerRescueNegativeTestJSON-server-599375833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-599375833',id=1,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='601d2f3e56844b68b3a0c71f8a7f5454',ramdisk_id='',reservation_id='r-3q5auhoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-928198583',owner_user_name='tempest-ServerRescueNegativeTestJSON-928198583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:31:41Z,user_data=None,user_id='61c6bf770dfe4eadba28f371b29f1d79',uuid=76aeb1d1-590a-44b3-b4fd-c9ebdedf603b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converting VIF {"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:69:fe,bridge_name='br-int',has_traffic_filtering=True,id=fbe1de56-aab3-47e7-914b-e51e070c8679,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe1de56-aa') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.objects.instance [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'pci_devices' on Instance uuid 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:31:52 user nova-compute[75672]:   <uuid>76aeb1d1-590a-44b3-b4fd-c9ebdedf603b</uuid>
Nov 30 12:31:52 user nova-compute[75672]:   <name>instance-00000001</name>
Nov 30 12:31:52 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:31:52 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:31:52 user nova-compute[75672]:   <metadata>
Nov 30 12:31:52 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:31:52 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:31:52 user nova-compute[75672]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-599375833</nova:name>
Nov 30 12:31:52 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:31:52</nova:creationTime>
Nov 30 12:31:52 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:31:52 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:31:52 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:31:52 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:31:52 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:31:52 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:31:52 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:31:52 user nova-compute[75672]:       <nova:owner>
Nov 30 12:31:52 user nova-compute[75672]:         <nova:user uuid="61c6bf770dfe4eadba28f371b29f1d79">tempest-ServerRescueNegativeTestJSON-928198583-project-member</nova:user>
Nov 30 12:31:52 user nova-compute[75672]:         <nova:project uuid="601d2f3e56844b68b3a0c71f8a7f5454">tempest-ServerRescueNegativeTestJSON-928198583</nova:project>
Nov 30 12:31:52 user nova-compute[75672]:       </nova:owner>
Nov 30 12:31:52 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:31:52 user nova-compute[75672]:       <nova:ports>
Nov 30 12:31:52 user nova-compute[75672]:         <nova:port uuid="fbe1de56-aab3-47e7-914b-e51e070c8679">
Nov 30 12:31:52 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 12:31:52 user nova-compute[75672]:         </nova:port>
Nov 30 12:31:52 user nova-compute[75672]:       </nova:ports>
Nov 30 12:31:52 user nova-compute[75672]:     </nova:instance>
Nov 30 12:31:52 user nova-compute[75672]:   </metadata>
Nov 30 12:31:52 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:31:52 user nova-compute[75672]:     <system>
Nov 30 12:31:52 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:31:52 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:31:52 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:31:52 user nova-compute[75672]:       <entry name="serial">76aeb1d1-590a-44b3-b4fd-c9ebdedf603b</entry>
Nov 30 12:31:52 user nova-compute[75672]:       <entry name="uuid">76aeb1d1-590a-44b3-b4fd-c9ebdedf603b</entry>
Nov 30 12:31:52 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:31:52 user nova-compute[75672]:     </system>
Nov 30 12:31:52 user nova-compute[75672]:   </sysinfo>
Nov 30 12:31:52 user nova-compute[75672]:   <os>
Nov 30 12:31:52 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:31:52 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:31:52 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:31:52 user nova-compute[75672]:   </os>
Nov 30 12:31:52 user nova-compute[75672]:   <features>
Nov 30 12:31:52 user nova-compute[75672]:     <acpi/>
Nov 30 12:31:52 user nova-compute[75672]:     <apic/>
Nov 30 12:31:52 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:31:52 user nova-compute[75672]:   </features>
Nov 30 12:31:52 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:31:52 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:31:52 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:31:52 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:31:52 user nova-compute[75672]:   </clock>
Nov 30 12:31:52 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:31:52 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:31:52 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:31:52 user nova-compute[75672]:   </cpu>
Nov 30 12:31:52 user nova-compute[75672]:   <devices>
Nov 30 12:31:52 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:31:52 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:31:52 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk"/>
Nov 30 12:31:52 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:31:52 user nova-compute[75672]:     </disk>
Nov 30 12:31:52 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:31:52 user nova-compute[75672]:       <mac address="fa:16:3e:01:69:fe"/>
Nov 30 12:31:52 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:31:52 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:31:52 user nova-compute[75672]:       <target dev="tapfbe1de56-aa"/>
Nov 30 12:31:52 user nova-compute[75672]:     </interface>
Nov 30 12:31:52 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:31:52 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/console.log" append="off"/>
Nov 30 12:31:52 user nova-compute[75672]:     </serial>
Nov 30 12:31:52 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:31:52 user nova-compute[75672]:     <video>
Nov 30 12:31:52 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:31:52 user nova-compute[75672]:     </video>
Nov 30 12:31:52 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:31:52 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:31:52 user nova-compute[75672]:     </rng>
Nov 30 12:31:52 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:31:52 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:31:52 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:31:52 user nova-compute[75672]:     </memballoon>
Nov 30 12:31:52 user nova-compute[75672]:   </devices>
Nov 30 12:31:52 user nova-compute[75672]: </domain>
Nov 30 12:31:52 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-599375833',display_name='tempest-ServerRescueNegativeTestJSON-server-599375833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-599375833',id=1,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='601d2f3e56844b68b3a0c71f8a7f5454',ramdisk_id='',reservation_id='r-3q5auhoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-928198583',owner_user_name='tempest-ServerRescueNegativeTestJSON-928198583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:31:41Z,user_data=None,user_id='61c6bf770dfe4eadba28f371b29f1d79',uuid=76aeb1d1-590a-44b3-b4fd-c9ebdedf603b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converting VIF {"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:69:fe,bridge_name='br-int',has_traffic_filtering=True,id=fbe1de56-aab3-47e7-914b-e51e070c8679,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe1de56-aa') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG os_vif [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:69:fe,bridge_name='br-int',has_traffic_filtering=True,id=fbe1de56-aab3-47e7-914b-e51e070c8679,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe1de56-aa') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbdb5f48-5d8f-546a-a9f8-1ac88de88b64', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbe1de56-aa, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbe1de56-aa, col_values=(('qos', UUID('9d46c5cf-b476-47f9-83ab-ca7e8c697743')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbe1de56-aa, col_values=(('external_ids', {'iface-id': 'fbe1de56-aab3-47e7-914b-e51e070c8679', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:69:fe', 'vm-uuid': '76aeb1d1-590a-44b3-b4fd-c9ebdedf603b'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:52 user nova-compute[75672]: INFO os_vif [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:69:fe,bridge_name='br-int',has_traffic_filtering=True,id=fbe1de56-aab3-47e7-914b-e51e070c8679,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe1de56-aa')
Nov 30 12:31:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No VIF found with MAC fa:16:3e:01:69:fe, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:31:52 user nova-compute[75672]: INFO nova.compute.claims [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Claim successful on node user
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Successfully updated port: 890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-f2205947-3ec2-41cd-9aee-1e420489c218 req-591c95b3-ac7a-4cd8-a292-6065d8c86f26 service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Received event network-changed-890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-f2205947-3ec2-41cd-9aee-1e420489c218 req-591c95b3-ac7a-4cd8-a292-6065d8c86f26 service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Refreshing instance network info cache due to event network-changed-890df6ae-1036-4cfd-b155-04a5c16f093c. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f2205947-3ec2-41cd-9aee-1e420489c218 req-591c95b3-ac7a-4cd8-a292-6065d8c86f26 service nova] Acquiring lock "refresh_cache-dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f2205947-3ec2-41cd-9aee-1e420489c218 req-591c95b3-ac7a-4cd8-a292-6065d8c86f26 service nova] Acquired lock "refresh_cache-dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.network.neutron [req-f2205947-3ec2-41cd-9aee-1e420489c218 req-591c95b3-ac7a-4cd8-a292-6065d8c86f26 service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Refreshing network info cache for port 890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "refresh_cache-dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:31:53 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.network.neutron [req-f2205947-3ec2-41cd-9aee-1e420489c218 req-591c95b3-ac7a-4cd8-a292-6065d8c86f26 service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:31:53 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Creating image(s)
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "/opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "/opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.policy [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15791a052aef4d7a9bc79c97075cbdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51606113e3d1460894fdc500924cb37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.network.neutron [req-fbbec61b-597e-43b7-b801-0b30d6cd0b8d req-6015054a-76c9-4025-8c82-5e1be0e50d84 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Updated VIF entry in instance network info cache for port fbe1de56-aab3-47e7-914b-e51e070c8679. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG nova.network.neutron [req-fbbec61b-597e-43b7-b801-0b30d6cd0b8d req-6015054a-76c9-4025-8c82-5e1be0e50d84 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Updating instance_info_cache with network_info: [{"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fbbec61b-597e-43b7-b801-0b30d6cd0b8d req-6015054a-76c9-4025-8c82-5e1be0e50d84 service nova] Releasing lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.206s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk 1073741824" returned: 0 in 0.044s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG nova.network.neutron [req-f2205947-3ec2-41cd-9aee-1e420489c218 req-591c95b3-ac7a-4cd8-a292-6065d8c86f26 service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.197s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f2205947-3ec2-41cd-9aee-1e420489c218 req-591c95b3-ac7a-4cd8-a292-6065d8c86f26 service nova] Releasing lock "refresh_cache-dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquired lock "refresh_cache-dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Successfully updated port: 5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquired lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Cannot resize image /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Ensure instance console log exists: /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-328099e8-ca22-4d44-89b1-66e4a97761ad req-702b1d37-5e50-4d59-89dc-ee3548eda543 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-changed-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-328099e8-ca22-4d44-89b1-66e4a97761ad req-702b1d37-5e50-4d59-89dc-ee3548eda543 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Refreshing instance network info cache due to event network-changed-5bfc6970-5d97-4f13-8603-d508342c282a. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-328099e8-ca22-4d44-89b1-66e4a97761ad req-702b1d37-5e50-4d59-89dc-ee3548eda543 service nova] Acquiring lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Successfully created port: 7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Updating instance_info_cache with network_info: [{"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Releasing lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Instance network_info: |[{"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-328099e8-ca22-4d44-89b1-66e4a97761ad req-702b1d37-5e50-4d59-89dc-ee3548eda543 service nova] Acquired lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.network.neutron [req-328099e8-ca22-4d44-89b1-66e4a97761ad req-702b1d37-5e50-4d59-89dc-ee3548eda543 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Refreshing network info cache for port 5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Start _get_guest_xml network_info=[{"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:31:55 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:31:55 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1561719818',display_name='tempest-AttachVolumeTestJSON-server-1561719818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1561719818',id=4,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdea+lvE9UsOmP6FYZGbGByAYyZUFyR2cvDgR8GqqqfKWiRxkUCGs+K9HROvIA5wapQ0MyZOJSLL3feZaXU9b6HVLyibqADHJmmyyoRAcM/oJWT1i+VE463gQZDjaPsHw==',key_name='tempest-keypair-145731974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a0ca8eb58644e058b2019a4faa41a46',ramdisk_id='',reservation_id='r-crpjd40b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2004678694',owner_user_name='tempest-AttachVolumeTestJSON-2004678694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:31:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98ee9bd3b604b39a3f6013a40398642',uuid=1fba8af1-8074-4ce8-be23-912e9850fc41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converting VIF {"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.objects.instance [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:31:55 user nova-compute[75672]:   <uuid>1fba8af1-8074-4ce8-be23-912e9850fc41</uuid>
Nov 30 12:31:55 user nova-compute[75672]:   <name>instance-00000004</name>
Nov 30 12:31:55 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:31:55 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:31:55 user nova-compute[75672]:   <metadata>
Nov 30 12:31:55 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:31:55 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:31:55 user nova-compute[75672]:       <nova:name>tempest-AttachVolumeTestJSON-server-1561719818</nova:name>
Nov 30 12:31:55 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:31:55</nova:creationTime>
Nov 30 12:31:55 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:31:55 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:31:55 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:31:55 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:31:55 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:31:55 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:31:55 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:31:55 user nova-compute[75672]:       <nova:owner>
Nov 30 12:31:55 user nova-compute[75672]:         <nova:user uuid="e98ee9bd3b604b39a3f6013a40398642">tempest-AttachVolumeTestJSON-2004678694-project-member</nova:user>
Nov 30 12:31:55 user nova-compute[75672]:         <nova:project uuid="7a0ca8eb58644e058b2019a4faa41a46">tempest-AttachVolumeTestJSON-2004678694</nova:project>
Nov 30 12:31:55 user nova-compute[75672]:       </nova:owner>
Nov 30 12:31:55 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:31:55 user nova-compute[75672]:       <nova:ports>
Nov 30 12:31:55 user nova-compute[75672]:         <nova:port uuid="5bfc6970-5d97-4f13-8603-d508342c282a">
Nov 30 12:31:55 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 12:31:55 user nova-compute[75672]:         </nova:port>
Nov 30 12:31:55 user nova-compute[75672]:       </nova:ports>
Nov 30 12:31:55 user nova-compute[75672]:     </nova:instance>
Nov 30 12:31:55 user nova-compute[75672]:   </metadata>
Nov 30 12:31:55 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:31:55 user nova-compute[75672]:     <system>
Nov 30 12:31:55 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:31:55 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:31:55 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:31:55 user nova-compute[75672]:       <entry name="serial">1fba8af1-8074-4ce8-be23-912e9850fc41</entry>
Nov 30 12:31:55 user nova-compute[75672]:       <entry name="uuid">1fba8af1-8074-4ce8-be23-912e9850fc41</entry>
Nov 30 12:31:55 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:31:55 user nova-compute[75672]:     </system>
Nov 30 12:31:55 user nova-compute[75672]:   </sysinfo>
Nov 30 12:31:55 user nova-compute[75672]:   <os>
Nov 30 12:31:55 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:31:55 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:31:55 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:31:55 user nova-compute[75672]:   </os>
Nov 30 12:31:55 user nova-compute[75672]:   <features>
Nov 30 12:31:55 user nova-compute[75672]:     <acpi/>
Nov 30 12:31:55 user nova-compute[75672]:     <apic/>
Nov 30 12:31:55 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:31:55 user nova-compute[75672]:   </features>
Nov 30 12:31:55 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:31:55 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:31:55 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:31:55 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:31:55 user nova-compute[75672]:   </clock>
Nov 30 12:31:55 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:31:55 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:31:55 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:31:55 user nova-compute[75672]:   </cpu>
Nov 30 12:31:55 user nova-compute[75672]:   <devices>
Nov 30 12:31:55 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:31:55 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:31:55 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk"/>
Nov 30 12:31:55 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:31:55 user nova-compute[75672]:     </disk>
Nov 30 12:31:55 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:31:55 user nova-compute[75672]:       <mac address="fa:16:3e:99:e9:ab"/>
Nov 30 12:31:55 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:31:55 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:31:55 user nova-compute[75672]:       <target dev="tap5bfc6970-5d"/>
Nov 30 12:31:55 user nova-compute[75672]:     </interface>
Nov 30 12:31:55 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:31:55 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/console.log" append="off"/>
Nov 30 12:31:55 user nova-compute[75672]:     </serial>
Nov 30 12:31:55 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:31:55 user nova-compute[75672]:     <video>
Nov 30 12:31:55 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:31:55 user nova-compute[75672]:     </video>
Nov 30 12:31:55 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:31:55 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:31:55 user nova-compute[75672]:     </rng>
Nov 30 12:31:55 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:31:55 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:31:55 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:31:55 user nova-compute[75672]:     </memballoon>
Nov 30 12:31:55 user nova-compute[75672]:   </devices>
Nov 30 12:31:55 user nova-compute[75672]: </domain>
Nov 30 12:31:55 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1561719818',display_name='tempest-AttachVolumeTestJSON-server-1561719818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1561719818',id=4,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdea+lvE9UsOmP6FYZGbGByAYyZUFyR2cvDgR8GqqqfKWiRxkUCGs+K9HROvIA5wapQ0MyZOJSLL3feZaXU9b6HVLyibqADHJmmyyoRAcM/oJWT1i+VE463gQZDjaPsHw==',key_name='tempest-keypair-145731974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a0ca8eb58644e058b2019a4faa41a46',ramdisk_id='',reservation_id='r-crpjd40b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2004678694',owner_user_name='tempest-AttachVolumeTestJSON-2004678694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:31:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98ee9bd3b604b39a3f6013a40398642',uuid=1fba8af1-8074-4ce8-be23-912e9850fc41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converting VIF {"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG os_vif [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5487a777-6857-54ac-86e5-c2478f878475', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bfc6970-5d, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bfc6970-5d, col_values=(('qos', UUID('8e40ab38-74a5-4dbe-ac52-4a9411ad577f')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bfc6970-5d, col_values=(('external_ids', {'iface-id': '5bfc6970-5d97-4f13-8603-d508342c282a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:e9:ab', 'vm-uuid': '1fba8af1-8074-4ce8-be23-912e9850fc41'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:55 user nova-compute[75672]: INFO os_vif [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d')
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] No VIF found with MAC fa:16:3e:99:e9:ab, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Updating instance_info_cache with network_info: [{"id": "890df6ae-1036-4cfd-b155-04a5c16f093c", "address": "fa:16:3e:9e:f7:d3", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890df6ae-10", "ovs_interfaceid": "890df6ae-1036-4cfd-b155-04a5c16f093c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Releasing lock "refresh_cache-dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Instance network_info: |[{"id": "890df6ae-1036-4cfd-b155-04a5c16f093c", "address": "fa:16:3e:9e:f7:d3", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890df6ae-10", "ovs_interfaceid": "890df6ae-1036-4cfd-b155-04a5c16f093c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:31:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Start _get_guest_xml network_info=[{"id": "890df6ae-1036-4cfd-b155-04a5c16f093c", "address": "fa:16:3e:9e:f7:d3", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890df6ae-10", "ovs_interfaceid": "890df6ae-1036-4cfd-b155-04a5c16f093c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:31:56 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:31:56 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2035650168',display_name='tempest-AttachVolumeNegativeTest-server-2035650168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2035650168',id=3,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvwa69budcC+O3KRetpHknkddPlXz9FOhlpMfvHilEsy/pcuVLdEh7P74ai+2PVmLrj6NKz7mDZGvVY7Vzr/Q7C6mC9R4ojWlxTTE5WJ1Vtr6BWDnnCgpODmJdqKNPllA==',key_name='tempest-keypair-124273081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f07019e3584771af197e865b6877cc',ramdisk_id='',reservation_id='r-7az41u58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1224349538',owner_user_name='tempest-AttachVolumeNegativeTest-1224349538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3166f2b3dee4aa4aa738f1f15ca7d19',uuid=dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "890df6ae-1036-4cfd-b155-04a5c16f093c", "address": "fa:16:3e:9e:f7:d3", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890df6ae-10", "ovs_interfaceid": "890df6ae-1036-4cfd-b155-04a5c16f093c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converting VIF {"id": "890df6ae-1036-4cfd-b155-04a5c16f093c", "address": "fa:16:3e:9e:f7:d3", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890df6ae-10", "ovs_interfaceid": "890df6ae-1036-4cfd-b155-04a5c16f093c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f7:d3,bridge_name='br-int',has_traffic_filtering=True,id=890df6ae-1036-4cfd-b155-04a5c16f093c,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890df6ae-10') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.objects.instance [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'pci_devices' on Instance uuid dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:31:56 user nova-compute[75672]:   <uuid>dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6</uuid>
Nov 30 12:31:56 user nova-compute[75672]:   <name>instance-00000003</name>
Nov 30 12:31:56 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:31:56 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:31:56 user nova-compute[75672]:   <metadata>
Nov 30 12:31:56 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:31:56 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:31:56 user nova-compute[75672]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2035650168</nova:name>
Nov 30 12:31:56 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:31:56</nova:creationTime>
Nov 30 12:31:56 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:31:56 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:31:56 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:31:56 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:31:56 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:31:56 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:31:56 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:31:56 user nova-compute[75672]:       <nova:owner>
Nov 30 12:31:56 user nova-compute[75672]:         <nova:user uuid="e3166f2b3dee4aa4aa738f1f15ca7d19">tempest-AttachVolumeNegativeTest-1224349538-project-member</nova:user>
Nov 30 12:31:56 user nova-compute[75672]:         <nova:project uuid="04f07019e3584771af197e865b6877cc">tempest-AttachVolumeNegativeTest-1224349538</nova:project>
Nov 30 12:31:56 user nova-compute[75672]:       </nova:owner>
Nov 30 12:31:56 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:31:56 user nova-compute[75672]:       <nova:ports>
Nov 30 12:31:56 user nova-compute[75672]:         <nova:port uuid="890df6ae-1036-4cfd-b155-04a5c16f093c">
Nov 30 12:31:56 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 12:31:56 user nova-compute[75672]:         </nova:port>
Nov 30 12:31:56 user nova-compute[75672]:       </nova:ports>
Nov 30 12:31:56 user nova-compute[75672]:     </nova:instance>
Nov 30 12:31:56 user nova-compute[75672]:   </metadata>
Nov 30 12:31:56 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:31:56 user nova-compute[75672]:     <system>
Nov 30 12:31:56 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:31:56 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:31:56 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:31:56 user nova-compute[75672]:       <entry name="serial">dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6</entry>
Nov 30 12:31:56 user nova-compute[75672]:       <entry name="uuid">dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6</entry>
Nov 30 12:31:56 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:31:56 user nova-compute[75672]:     </system>
Nov 30 12:31:56 user nova-compute[75672]:   </sysinfo>
Nov 30 12:31:56 user nova-compute[75672]:   <os>
Nov 30 12:31:56 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:31:56 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:31:56 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:31:56 user nova-compute[75672]:   </os>
Nov 30 12:31:56 user nova-compute[75672]:   <features>
Nov 30 12:31:56 user nova-compute[75672]:     <acpi/>
Nov 30 12:31:56 user nova-compute[75672]:     <apic/>
Nov 30 12:31:56 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:31:56 user nova-compute[75672]:   </features>
Nov 30 12:31:56 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:31:56 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:31:56 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:31:56 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:31:56 user nova-compute[75672]:   </clock>
Nov 30 12:31:56 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:31:56 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:31:56 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:31:56 user nova-compute[75672]:   </cpu>
Nov 30 12:31:56 user nova-compute[75672]:   <devices>
Nov 30 12:31:56 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:31:56 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:31:56 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk"/>
Nov 30 12:31:56 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:31:56 user nova-compute[75672]:     </disk>
Nov 30 12:31:56 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:31:56 user nova-compute[75672]:       <mac address="fa:16:3e:9e:f7:d3"/>
Nov 30 12:31:56 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:31:56 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:31:56 user nova-compute[75672]:       <target dev="tap890df6ae-10"/>
Nov 30 12:31:56 user nova-compute[75672]:     </interface>
Nov 30 12:31:56 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:31:56 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/console.log" append="off"/>
Nov 30 12:31:56 user nova-compute[75672]:     </serial>
Nov 30 12:31:56 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:31:56 user nova-compute[75672]:     <video>
Nov 30 12:31:56 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:31:56 user nova-compute[75672]:     </video>
Nov 30 12:31:56 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:31:56 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:31:56 user nova-compute[75672]:     </rng>
Nov 30 12:31:56 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:31:56 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:31:56 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:31:56 user nova-compute[75672]:     </memballoon>
Nov 30 12:31:56 user nova-compute[75672]:   </devices>
Nov 30 12:31:56 user nova-compute[75672]: </domain>
Nov 30 12:31:56 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2035650168',display_name='tempest-AttachVolumeNegativeTest-server-2035650168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2035650168',id=3,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvwa69budcC+O3KRetpHknkddPlXz9FOhlpMfvHilEsy/pcuVLdEh7P74ai+2PVmLrj6NKz7mDZGvVY7Vzr/Q7C6mC9R4ojWlxTTE5WJ1Vtr6BWDnnCgpODmJdqKNPllA==',key_name='tempest-keypair-124273081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f07019e3584771af197e865b6877cc',ramdisk_id='',reservation_id='r-7az41u58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1224349538',owner_user_name='tempest-AttachVolumeNegativeTest-1224349538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3166f2b3dee4aa4aa738f1f15ca7d19',uuid=dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "890df6ae-1036-4cfd-b155-04a5c16f093c", "address": "fa:16:3e:9e:f7:d3", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890df6ae-10", "ovs_interfaceid": "890df6ae-1036-4cfd-b155-04a5c16f093c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converting VIF {"id": "890df6ae-1036-4cfd-b155-04a5c16f093c", "address": "fa:16:3e:9e:f7:d3", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890df6ae-10", "ovs_interfaceid": "890df6ae-1036-4cfd-b155-04a5c16f093c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f7:d3,bridge_name='br-int',has_traffic_filtering=True,id=890df6ae-1036-4cfd-b155-04a5c16f093c,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890df6ae-10') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG os_vif [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f7:d3,bridge_name='br-int',has_traffic_filtering=True,id=890df6ae-1036-4cfd-b155-04a5c16f093c,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890df6ae-10') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '542ba71e-c55b-54f9-ad42-0e0d9b9f1fbf', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap890df6ae-10, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap890df6ae-10, col_values=(('qos', UUID('7bbed484-bb86-47f6-8a2b-f58c6d6e08a6')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap890df6ae-10, col_values=(('external_ids', {'iface-id': '890df6ae-1036-4cfd-b155-04a5c16f093c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:f7:d3', 'vm-uuid': 'dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:56 user nova-compute[75672]: INFO os_vif [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f7:d3,bridge_name='br-int',has_traffic_filtering=True,id=890df6ae-1036-4cfd-b155-04a5c16f093c,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890df6ae-10')
Nov 30 12:31:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:31:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No VIF found with MAC fa:16:3e:9e:f7:d3, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:31:57 user nova-compute[75672]: DEBUG nova.network.neutron [req-328099e8-ca22-4d44-89b1-66e4a97761ad req-702b1d37-5e50-4d59-89dc-ee3548eda543 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Updated VIF entry in instance network info cache for port 5bfc6970-5d97-4f13-8603-d508342c282a. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:31:57 user nova-compute[75672]: DEBUG nova.network.neutron [req-328099e8-ca22-4d44-89b1-66e4a97761ad req-702b1d37-5e50-4d59-89dc-ee3548eda543 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Updating instance_info_cache with network_info: [{"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:31:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-328099e8-ca22-4d44-89b1-66e4a97761ad req-702b1d37-5e50-4d59-89dc-ee3548eda543 service nova] Releasing lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:31:57 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Successfully updated port: 7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:31:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:31:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquired lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:31:57 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-cc4007df-bbe2-4739-a79f-197c92509b03 req-fddb88e2-c8da-4973-83e0-e81052e9b666 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Received event network-changed-7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-cc4007df-bbe2-4739-a79f-197c92509b03 req-fddb88e2-c8da-4973-83e0-e81052e9b666 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Refreshing instance network info cache due to event network-changed-7513ca6e-ee52-47e2-a2cb-428f6013ca40. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cc4007df-bbe2-4739-a79f-197c92509b03 req-fddb88e2-c8da-4973-83e0-e81052e9b666 service nova] Acquiring lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Instance spawned successfully.
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:31:58 user nova-compute[75672]: INFO nova.compute.manager [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Took 14.37 seconds to spawn the instance on the hypervisor.
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:31:58 user nova-compute[75672]: INFO nova.compute.manager [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Took 15.57 seconds to build instance.
Nov 30 12:31:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Instance spawned successfully.
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:31:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-451c3fd7-1b1a-4c8f-b4b7-0ba34bee197d tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "62555959-6271-47e1-920c-b6333de4cca4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.016s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:58 user nova-compute[75672]: INFO nova.compute.manager [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Took 17.83 seconds to spawn the instance on the hypervisor.
Nov 30 12:31:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:31:59 user nova-compute[75672]: INFO nova.compute.manager [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Took 18.89 seconds to build instance.
Nov 30 12:31:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a81137c0-559d-4719-aa75-75f0739f5b9f tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.151s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updating instance_info_cache with network_info: [{"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Releasing lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Instance network_info: |[{"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cc4007df-bbe2-4739-a79f-197c92509b03 req-fddb88e2-c8da-4973-83e0-e81052e9b666 service nova] Acquired lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.network.neutron [req-cc4007df-bbe2-4739-a79f-197c92509b03 req-fddb88e2-c8da-4973-83e0-e81052e9b666 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Refreshing network info cache for port 7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Start _get_guest_xml network_info=[{"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:31:59 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:31:59 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1491886481',display_name='tempest-ServerActionsTestOtherA-server-1491886481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1491886481',id=5,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAGYYp9gmKcKQU/0AhKXIKN1vmmULr4112gYCMQNfGJmVLFUNJpr/fRLeXt2uFTxy9c+sqp7OE8Rgl3bMk88M8K66f/jnDNBbOBQMv+K2V48Kq8w3CudXAVm+CT4wTJ5Q==',key_name='tempest-keypair-1875335252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-trekqyuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:31:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=d5a6266a-af9e-4050-bba8-92eae9ac28bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:3d:a3,bridge_name='br-int',has_traffic_filtering=True,id=7513ca6e-ee52-47e2-a2cb-428f6013ca40,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7513ca6e-ee') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.objects.instance [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lazy-loading 'pci_devices' on Instance uuid d5a6266a-af9e-4050-bba8-92eae9ac28bf {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:31:59 user nova-compute[75672]:   <uuid>d5a6266a-af9e-4050-bba8-92eae9ac28bf</uuid>
Nov 30 12:31:59 user nova-compute[75672]:   <name>instance-00000005</name>
Nov 30 12:31:59 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:31:59 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:31:59 user nova-compute[75672]:   <metadata>
Nov 30 12:31:59 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:31:59 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:31:59 user nova-compute[75672]:       <nova:name>tempest-ServerActionsTestOtherA-server-1491886481</nova:name>
Nov 30 12:31:59 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:31:59</nova:creationTime>
Nov 30 12:31:59 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:31:59 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:31:59 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:31:59 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:31:59 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:31:59 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:31:59 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:31:59 user nova-compute[75672]:       <nova:owner>
Nov 30 12:31:59 user nova-compute[75672]:         <nova:user uuid="15791a052aef4d7a9bc79c97075cbdc9">tempest-ServerActionsTestOtherA-2076465849-project-member</nova:user>
Nov 30 12:31:59 user nova-compute[75672]:         <nova:project uuid="51606113e3d1460894fdc500924cb37a">tempest-ServerActionsTestOtherA-2076465849</nova:project>
Nov 30 12:31:59 user nova-compute[75672]:       </nova:owner>
Nov 30 12:31:59 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:31:59 user nova-compute[75672]:       <nova:ports>
Nov 30 12:31:59 user nova-compute[75672]:         <nova:port uuid="7513ca6e-ee52-47e2-a2cb-428f6013ca40">
Nov 30 12:31:59 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 12:31:59 user nova-compute[75672]:         </nova:port>
Nov 30 12:31:59 user nova-compute[75672]:       </nova:ports>
Nov 30 12:31:59 user nova-compute[75672]:     </nova:instance>
Nov 30 12:31:59 user nova-compute[75672]:   </metadata>
Nov 30 12:31:59 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:31:59 user nova-compute[75672]:     <system>
Nov 30 12:31:59 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:31:59 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:31:59 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:31:59 user nova-compute[75672]:       <entry name="serial">d5a6266a-af9e-4050-bba8-92eae9ac28bf</entry>
Nov 30 12:31:59 user nova-compute[75672]:       <entry name="uuid">d5a6266a-af9e-4050-bba8-92eae9ac28bf</entry>
Nov 30 12:31:59 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:31:59 user nova-compute[75672]:     </system>
Nov 30 12:31:59 user nova-compute[75672]:   </sysinfo>
Nov 30 12:31:59 user nova-compute[75672]:   <os>
Nov 30 12:31:59 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:31:59 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:31:59 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:31:59 user nova-compute[75672]:   </os>
Nov 30 12:31:59 user nova-compute[75672]:   <features>
Nov 30 12:31:59 user nova-compute[75672]:     <acpi/>
Nov 30 12:31:59 user nova-compute[75672]:     <apic/>
Nov 30 12:31:59 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:31:59 user nova-compute[75672]:   </features>
Nov 30 12:31:59 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:31:59 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:31:59 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:31:59 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:31:59 user nova-compute[75672]:   </clock>
Nov 30 12:31:59 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:31:59 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:31:59 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:31:59 user nova-compute[75672]:   </cpu>
Nov 30 12:31:59 user nova-compute[75672]:   <devices>
Nov 30 12:31:59 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:31:59 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:31:59 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk"/>
Nov 30 12:31:59 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:31:59 user nova-compute[75672]:     </disk>
Nov 30 12:31:59 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:31:59 user nova-compute[75672]:       <mac address="fa:16:3e:e3:3d:a3"/>
Nov 30 12:31:59 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:31:59 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:31:59 user nova-compute[75672]:       <target dev="tap7513ca6e-ee"/>
Nov 30 12:31:59 user nova-compute[75672]:     </interface>
Nov 30 12:31:59 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:31:59 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/console.log" append="off"/>
Nov 30 12:31:59 user nova-compute[75672]:     </serial>
Nov 30 12:31:59 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:31:59 user nova-compute[75672]:     <video>
Nov 30 12:31:59 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:31:59 user nova-compute[75672]:     </video>
Nov 30 12:31:59 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:31:59 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:31:59 user nova-compute[75672]:     </rng>
Nov 30 12:31:59 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:31:59 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:31:59 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:31:59 user nova-compute[75672]:     </memballoon>
Nov 30 12:31:59 user nova-compute[75672]:   </devices>
Nov 30 12:31:59 user nova-compute[75672]: </domain>
Nov 30 12:31:59 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1491886481',display_name='tempest-ServerActionsTestOtherA-server-1491886481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1491886481',id=5,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAGYYp9gmKcKQU/0AhKXIKN1vmmULr4112gYCMQNfGJmVLFUNJpr/fRLeXt2uFTxy9c+sqp7OE8Rgl3bMk88M8K66f/jnDNBbOBQMv+K2V48Kq8w3CudXAVm+CT4wTJ5Q==',key_name='tempest-keypair-1875335252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-trekqyuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:31:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=d5a6266a-af9e-4050-bba8-92eae9ac28bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:3d:a3,bridge_name='br-int',has_traffic_filtering=True,id=7513ca6e-ee52-47e2-a2cb-428f6013ca40,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7513ca6e-ee') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG os_vif [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:3d:a3,bridge_name='br-int',has_traffic_filtering=True,id=7513ca6e-ee52-47e2-a2cb-428f6013ca40,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7513ca6e-ee') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db2bedd8-074f-53f2-95ad-6bf07a43ab39', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7513ca6e-ee, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7513ca6e-ee, col_values=(('qos', UUID('9aec4fad-08e0-4379-a576-fb1e6111d87d')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7513ca6e-ee, col_values=(('external_ids', {'iface-id': '7513ca6e-ee52-47e2-a2cb-428f6013ca40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:3d:a3', 'vm-uuid': 'd5a6266a-af9e-4050-bba8-92eae9ac28bf'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:31:59 user nova-compute[75672]: INFO os_vif [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:3d:a3,bridge_name='br-int',has_traffic_filtering=True,id=7513ca6e-ee52-47e2-a2cb-428f6013ca40,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7513ca6e-ee')
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] No VIF found with MAC fa:16:3e:e3:3d:a3, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:31:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG nova.network.neutron [req-cc4007df-bbe2-4739-a79f-197c92509b03 req-fddb88e2-c8da-4973-83e0-e81052e9b666 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updated VIF entry in instance network info cache for port 7513ca6e-ee52-47e2-a2cb-428f6013ca40. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG nova.network.neutron [req-cc4007df-bbe2-4739-a79f-197c92509b03 req-fddb88e2-c8da-4973-83e0-e81052e9b666 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updating instance_info_cache with network_info: [{"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cc4007df-bbe2-4739-a79f-197c92509b03 req-fddb88e2-c8da-4973-83e0-e81052e9b666 service nova] Releasing lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:32:01 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Instance spawned successfully.
Nov 30 12:32:01 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:01 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:02 user nova-compute[75672]: INFO nova.compute.manager [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Took 15.11 seconds to spawn the instance on the hypervisor.
Nov 30 12:32:02 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:32:02 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:32:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:32:02 user nova-compute[75672]: INFO nova.compute.manager [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Took 16.07 seconds to build instance.
Nov 30 12:32:02 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Instance spawned successfully.
Nov 30 12:32:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:32:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ff4400cc-a016-451a-8cfe-d4ba1a30563e tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.237s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:02 user nova-compute[75672]: INFO nova.compute.manager [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Took 16.96 seconds to spawn the instance on the hypervisor.
Nov 30 12:32:02 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:32:02 user nova-compute[75672]: INFO nova.compute.manager [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Took 17.85 seconds to build instance.
Nov 30 12:32:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9fa2d551-16a9-418d-ad38-1d4d3c9fbaa7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.044s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "85f7c21c-b973-422f-a10c-8fb3635879f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:03 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:32:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:03 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:32:03 user nova-compute[75672]: INFO nova.compute.claims [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Claim successful on node user
Nov 30 12:32:03 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:32:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:03 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.849s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.network.neutron [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:04 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:32:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:32:04 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Creating image(s)
Nov 30 12:32:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "/opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "/opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "/opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.policy [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fe27c1bb48c454082be1109311db96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a602a0e3614e5bafc9d70e26368f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:32:04 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Instance spawned successfully.
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.320s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:05 user nova-compute[75672]: INFO nova.compute.manager [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Took 11.52 seconds to spawn the instance on the hypervisor.
Nov 30 12:32:05 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.322s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk 1073741824" returned: 0 in 0.145s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.474s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:05 user nova-compute[75672]: INFO nova.compute.manager [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Took 12.58 seconds to build instance.
Nov 30 12:32:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ddbf500c-5660-4f0b-b5bb-242f276d8d5c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.759s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:32:05 user nova-compute[75672]: INFO nova.compute.claims [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Claim successful on node user
Nov 30 12:32:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.336s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json" returned: 0 in 0.556s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:06 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Cannot resize image /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:32:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:32:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Ensure instance console log exists: /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:32:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:06 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:32:06 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:32:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.088s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:06 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:32:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:32:07 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:32:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:32:07 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Creating image(s)
Nov 30 12:32:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "/opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "/opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "/opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG nova.policy [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '743a7b7ec097405a936c7ae01f870d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39eae439dda0405e84c7e37b768e28a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.251s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.306s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk 1073741824" returned: 0 in 0.081s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.395s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.278s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:08 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:32:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:08 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Cannot resize image /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:32:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:32:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Ensure instance console log exists: /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:32:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Successfully created port: f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:10 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Successfully created port: 19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:11 user nova-compute[75672]: DEBUG nova.network.neutron [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Successfully updated port: f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:32:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "refresh_cache-85f7c21c-b973-422f-a10c-8fb3635879f4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:32:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquired lock "refresh_cache-85f7c21c-b973-422f-a10c-8fb3635879f4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:32:11 user nova-compute[75672]: DEBUG nova.network.neutron [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:32:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-2fc6c1b7-4ae2-48f5-8f2a-3b5b2406f34c req-26d4198e-d458-40cf-9a64-de4e72e5c72b service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Received event network-changed-f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-2fc6c1b7-4ae2-48f5-8f2a-3b5b2406f34c req-26d4198e-d458-40cf-9a64-de4e72e5c72b service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Refreshing instance network info cache due to event network-changed-f63d8e51-e821-4448-8d86-ca8c90e5b382. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:32:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2fc6c1b7-4ae2-48f5-8f2a-3b5b2406f34c req-26d4198e-d458-40cf-9a64-de4e72e5c72b service nova] Acquiring lock "refresh_cache-85f7c21c-b973-422f-a10c-8fb3635879f4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:32:12 user nova-compute[75672]: DEBUG nova.network.neutron [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:32:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:12 user nova-compute[75672]: DEBUG nova.network.neutron [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Updating instance_info_cache with network_info: [{"id": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "address": "fa:16:3e:30:a9:02", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63d8e51-e8", "ovs_interfaceid": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:32:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Releasing lock "refresh_cache-85f7c21c-b973-422f-a10c-8fb3635879f4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:32:12 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Instance network_info: |[{"id": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "address": "fa:16:3e:30:a9:02", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63d8e51-e8", "ovs_interfaceid": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:32:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2fc6c1b7-4ae2-48f5-8f2a-3b5b2406f34c req-26d4198e-d458-40cf-9a64-de4e72e5c72b service nova] Acquired lock "refresh_cache-85f7c21c-b973-422f-a10c-8fb3635879f4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:32:12 user nova-compute[75672]: DEBUG nova.network.neutron [req-2fc6c1b7-4ae2-48f5-8f2a-3b5b2406f34c req-26d4198e-d458-40cf-9a64-de4e72e5c72b service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Refreshing network info cache for port f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:32:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Start _get_guest_xml network_info=[{"id": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "address": "fa:16:3e:30:a9:02", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63d8e51-e8", "ovs_interfaceid": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:32:12 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:32:12 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:32:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2017965800',display_name='tempest-VolumesAdminNegativeTest-server-2017965800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2017965800',id=6,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJcH0gwFEstePdALiSy5UkA0+LOFQRY4qNejpbiYXyUscDIJ9YMWhj3yiIg+yn0y6hAhSZZOLs+RONnzFb8f2L1ZMq5BSRQlnwb3C9j7oRtDbh9hs5UoQlW2TklkcH1mQ==',key_name='tempest-keypair-216264897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36a602a0e3614e5bafc9d70e26368f66',ramdisk_id='',reservation_id='r-n1kmxc0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1737879306',owner_user_name='tempest-VolumesAdminNegativeTest-1737879306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fe27c1bb48c454082be1109311db96f',uuid=85f7c21c-b973-422f-a10c-8fb3635879f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "address": "fa:16:3e:30:a9:02", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63d8e51-e8", "ovs_interfaceid": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Converting VIF {"id": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "address": "fa:16:3e:30:a9:02", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63d8e51-e8", "ovs_interfaceid": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:a9:02,bridge_name='br-int',has_traffic_filtering=True,id=f63d8e51-e821-4448-8d86-ca8c90e5b382,network=Network(6c45d0f0-6bba-476f-8c7b-83f86f13ff55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63d8e51-e8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.objects.instance [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lazy-loading 'pci_devices' on Instance uuid 85f7c21c-b973-422f-a10c-8fb3635879f4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:32:13 user nova-compute[75672]:   <uuid>85f7c21c-b973-422f-a10c-8fb3635879f4</uuid>
Nov 30 12:32:13 user nova-compute[75672]:   <name>instance-00000006</name>
Nov 30 12:32:13 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:32:13 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:32:13 user nova-compute[75672]:   <metadata>
Nov 30 12:32:13 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:32:13 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:32:13 user nova-compute[75672]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2017965800</nova:name>
Nov 30 12:32:13 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:32:12</nova:creationTime>
Nov 30 12:32:13 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:32:13 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:32:13 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:32:13 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:32:13 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:32:13 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:32:13 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:32:13 user nova-compute[75672]:       <nova:owner>
Nov 30 12:32:13 user nova-compute[75672]:         <nova:user uuid="1fe27c1bb48c454082be1109311db96f">tempest-VolumesAdminNegativeTest-1737879306-project-member</nova:user>
Nov 30 12:32:13 user nova-compute[75672]:         <nova:project uuid="36a602a0e3614e5bafc9d70e26368f66">tempest-VolumesAdminNegativeTest-1737879306</nova:project>
Nov 30 12:32:13 user nova-compute[75672]:       </nova:owner>
Nov 30 12:32:13 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:32:13 user nova-compute[75672]:       <nova:ports>
Nov 30 12:32:13 user nova-compute[75672]:         <nova:port uuid="f63d8e51-e821-4448-8d86-ca8c90e5b382">
Nov 30 12:32:13 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 12:32:13 user nova-compute[75672]:         </nova:port>
Nov 30 12:32:13 user nova-compute[75672]:       </nova:ports>
Nov 30 12:32:13 user nova-compute[75672]:     </nova:instance>
Nov 30 12:32:13 user nova-compute[75672]:   </metadata>
Nov 30 12:32:13 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:32:13 user nova-compute[75672]:     <system>
Nov 30 12:32:13 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:32:13 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:32:13 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:32:13 user nova-compute[75672]:       <entry name="serial">85f7c21c-b973-422f-a10c-8fb3635879f4</entry>
Nov 30 12:32:13 user nova-compute[75672]:       <entry name="uuid">85f7c21c-b973-422f-a10c-8fb3635879f4</entry>
Nov 30 12:32:13 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:32:13 user nova-compute[75672]:     </system>
Nov 30 12:32:13 user nova-compute[75672]:   </sysinfo>
Nov 30 12:32:13 user nova-compute[75672]:   <os>
Nov 30 12:32:13 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:32:13 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:32:13 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:32:13 user nova-compute[75672]:   </os>
Nov 30 12:32:13 user nova-compute[75672]:   <features>
Nov 30 12:32:13 user nova-compute[75672]:     <acpi/>
Nov 30 12:32:13 user nova-compute[75672]:     <apic/>
Nov 30 12:32:13 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:32:13 user nova-compute[75672]:   </features>
Nov 30 12:32:13 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:32:13 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:32:13 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:32:13 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:32:13 user nova-compute[75672]:   </clock>
Nov 30 12:32:13 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:32:13 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:32:13 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:32:13 user nova-compute[75672]:   </cpu>
Nov 30 12:32:13 user nova-compute[75672]:   <devices>
Nov 30 12:32:13 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:32:13 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:32:13 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk"/>
Nov 30 12:32:13 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:32:13 user nova-compute[75672]:     </disk>
Nov 30 12:32:13 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:32:13 user nova-compute[75672]:       <mac address="fa:16:3e:30:a9:02"/>
Nov 30 12:32:13 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:32:13 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:32:13 user nova-compute[75672]:       <target dev="tapf63d8e51-e8"/>
Nov 30 12:32:13 user nova-compute[75672]:     </interface>
Nov 30 12:32:13 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:32:13 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/console.log" append="off"/>
Nov 30 12:32:13 user nova-compute[75672]:     </serial>
Nov 30 12:32:13 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:32:13 user nova-compute[75672]:     <video>
Nov 30 12:32:13 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:32:13 user nova-compute[75672]:     </video>
Nov 30 12:32:13 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:32:13 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:32:13 user nova-compute[75672]:     </rng>
Nov 30 12:32:13 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:32:13 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:32:13 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:32:13 user nova-compute[75672]:     </memballoon>
Nov 30 12:32:13 user nova-compute[75672]:   </devices>
Nov 30 12:32:13 user nova-compute[75672]: </domain>
Nov 30 12:32:13 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:32:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2017965800',display_name='tempest-VolumesAdminNegativeTest-server-2017965800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2017965800',id=6,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJcH0gwFEstePdALiSy5UkA0+LOFQRY4qNejpbiYXyUscDIJ9YMWhj3yiIg+yn0y6hAhSZZOLs+RONnzFb8f2L1ZMq5BSRQlnwb3C9j7oRtDbh9hs5UoQlW2TklkcH1mQ==',key_name='tempest-keypair-216264897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36a602a0e3614e5bafc9d70e26368f66',ramdisk_id='',reservation_id='r-n1kmxc0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1737879306',owner_user_name='tempest-VolumesAdminNegativeTest-1737879306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fe27c1bb48c454082be1109311db96f',uuid=85f7c21c-b973-422f-a10c-8fb3635879f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "address": "fa:16:3e:30:a9:02", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63d8e51-e8", "ovs_interfaceid": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Converting VIF {"id": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "address": "fa:16:3e:30:a9:02", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63d8e51-e8", "ovs_interfaceid": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:a9:02,bridge_name='br-int',has_traffic_filtering=True,id=f63d8e51-e821-4448-8d86-ca8c90e5b382,network=Network(6c45d0f0-6bba-476f-8c7b-83f86f13ff55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63d8e51-e8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG os_vif [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a9:02,bridge_name='br-int',has_traffic_filtering=True,id=f63d8e51-e821-4448-8d86-ca8c90e5b382,network=Network(6c45d0f0-6bba-476f-8c7b-83f86f13ff55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63d8e51-e8') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ab7ccb2-42a2-59d0-aff4-7b49431526d3', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf63d8e51-e8, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf63d8e51-e8, col_values=(('qos', UUID('3de297b0-269d-4624-8062-2287c4a4b899')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf63d8e51-e8, col_values=(('external_ids', {'iface-id': 'f63d8e51-e821-4448-8d86-ca8c90e5b382', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:a9:02', 'vm-uuid': '85f7c21c-b973-422f-a10c-8fb3635879f4'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:13 user nova-compute[75672]: INFO os_vif [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a9:02,bridge_name='br-int',has_traffic_filtering=True,id=f63d8e51-e821-4448-8d86-ca8c90e5b382,network=Network(6c45d0f0-6bba-476f-8c7b-83f86f13ff55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63d8e51-e8')
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] No VIF found with MAC fa:16:3e:30:a9:02, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Successfully updated port: 19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "refresh_cache-84f3ca7c-05db-4714-a685-3598bc6134d3" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquired lock "refresh_cache-84f3ca7c-05db-4714-a685-3598bc6134d3" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-e74c9cfa-f80f-4d18-b451-012996437736 req-03aa9dde-3451-4666-9143-c7b28c854a92 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received event network-changed-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-e74c9cfa-f80f-4d18-b451-012996437736 req-03aa9dde-3451-4666-9143-c7b28c854a92 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Refreshing instance network info cache due to event network-changed-19ffba33-190e-4fe0-bb72-53d8e79bbbd0. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:32:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e74c9cfa-f80f-4d18-b451-012996437736 req-03aa9dde-3451-4666-9143-c7b28c854a92 service nova] Acquiring lock "refresh_cache-84f3ca7c-05db-4714-a685-3598bc6134d3" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.network.neutron [req-2fc6c1b7-4ae2-48f5-8f2a-3b5b2406f34c req-26d4198e-d458-40cf-9a64-de4e72e5c72b service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Updated VIF entry in instance network info cache for port f63d8e51-e821-4448-8d86-ca8c90e5b382. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.network.neutron [req-2fc6c1b7-4ae2-48f5-8f2a-3b5b2406f34c req-26d4198e-d458-40cf-9a64-de4e72e5c72b service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Updating instance_info_cache with network_info: [{"id": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "address": "fa:16:3e:30:a9:02", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63d8e51-e8", "ovs_interfaceid": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2fc6c1b7-4ae2-48f5-8f2a-3b5b2406f34c req-26d4198e-d458-40cf-9a64-de4e72e5c72b service nova] Releasing lock "refresh_cache-85f7c21c-b973-422f-a10c-8fb3635879f4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Updating instance_info_cache with network_info: [{"id": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "address": "fa:16:3e:36:eb:96", "network": {"id": "c905cd92-2463-450c-9c3e-6fef670e27e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1410834846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39eae439dda0405e84c7e37b768e28a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ffba33-19", "ovs_interfaceid": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Releasing lock "refresh_cache-84f3ca7c-05db-4714-a685-3598bc6134d3" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Instance network_info: |[{"id": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "address": "fa:16:3e:36:eb:96", "network": {"id": "c905cd92-2463-450c-9c3e-6fef670e27e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1410834846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39eae439dda0405e84c7e37b768e28a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ffba33-19", "ovs_interfaceid": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e74c9cfa-f80f-4d18-b451-012996437736 req-03aa9dde-3451-4666-9143-c7b28c854a92 service nova] Acquired lock "refresh_cache-84f3ca7c-05db-4714-a685-3598bc6134d3" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.network.neutron [req-e74c9cfa-f80f-4d18-b451-012996437736 req-03aa9dde-3451-4666-9143-c7b28c854a92 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Refreshing network info cache for port 19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Start _get_guest_xml network_info=[{"id": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "address": "fa:16:3e:36:eb:96", "network": {"id": "c905cd92-2463-450c-9c3e-6fef670e27e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1410834846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39eae439dda0405e84c7e37b768e28a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ffba33-19", "ovs_interfaceid": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:32:14 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:32:14 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:32:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-500770239',display_name='tempest-TestVolumeSwap-server-500770239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-500770239',id=7,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk0/7Z/SxM9DFaYc2+TMknW9VHTXmMYv1R8MjNRjbGp/rVM3jARoBr3XKwKN6Pd14IJSPOkMrpYiSTwxeAVUUqFAtDNNawDeqKd/wbQ5WLEYafztJdMtZ02+EPbi2oulg==',key_name='tempest-keypair-3013591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39eae439dda0405e84c7e37b768e28a0',ramdisk_id='',reservation_id='r-1w4tom8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1206325901',owner_user_name='tempest-TestVolumeSwap-1206325901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='743a7b7ec097405a936c7ae01f870d36',uuid=84f3ca7c-05db-4714-a685-3598bc6134d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "address": "fa:16:3e:36:eb:96", "network": {"id": "c905cd92-2463-450c-9c3e-6fef670e27e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1410834846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39eae439dda0405e84c7e37b768e28a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ffba33-19", "ovs_interfaceid": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Converting VIF {"id": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "address": "fa:16:3e:36:eb:96", "network": {"id": "c905cd92-2463-450c-9c3e-6fef670e27e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1410834846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39eae439dda0405e84c7e37b768e28a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ffba33-19", "ovs_interfaceid": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:eb:96,bridge_name='br-int',has_traffic_filtering=True,id=19ffba33-190e-4fe0-bb72-53d8e79bbbd0,network=Network(c905cd92-2463-450c-9c3e-6fef670e27e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ffba33-19') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.objects.instance [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lazy-loading 'pci_devices' on Instance uuid 84f3ca7c-05db-4714-a685-3598bc6134d3 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:32:14 user nova-compute[75672]:   <uuid>84f3ca7c-05db-4714-a685-3598bc6134d3</uuid>
Nov 30 12:32:14 user nova-compute[75672]:   <name>instance-00000007</name>
Nov 30 12:32:14 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:32:14 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:32:14 user nova-compute[75672]:   <metadata>
Nov 30 12:32:14 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:32:14 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:32:14 user nova-compute[75672]:       <nova:name>tempest-TestVolumeSwap-server-500770239</nova:name>
Nov 30 12:32:14 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:32:14</nova:creationTime>
Nov 30 12:32:14 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:32:14 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:32:14 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:32:14 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:32:14 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:32:14 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:32:14 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:32:14 user nova-compute[75672]:       <nova:owner>
Nov 30 12:32:14 user nova-compute[75672]:         <nova:user uuid="743a7b7ec097405a936c7ae01f870d36">tempest-TestVolumeSwap-1206325901-project-member</nova:user>
Nov 30 12:32:14 user nova-compute[75672]:         <nova:project uuid="39eae439dda0405e84c7e37b768e28a0">tempest-TestVolumeSwap-1206325901</nova:project>
Nov 30 12:32:14 user nova-compute[75672]:       </nova:owner>
Nov 30 12:32:14 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:32:14 user nova-compute[75672]:       <nova:ports>
Nov 30 12:32:14 user nova-compute[75672]:         <nova:port uuid="19ffba33-190e-4fe0-bb72-53d8e79bbbd0">
Nov 30 12:32:14 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 12:32:14 user nova-compute[75672]:         </nova:port>
Nov 30 12:32:14 user nova-compute[75672]:       </nova:ports>
Nov 30 12:32:14 user nova-compute[75672]:     </nova:instance>
Nov 30 12:32:14 user nova-compute[75672]:   </metadata>
Nov 30 12:32:14 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:32:14 user nova-compute[75672]:     <system>
Nov 30 12:32:14 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:32:14 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:32:14 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:32:14 user nova-compute[75672]:       <entry name="serial">84f3ca7c-05db-4714-a685-3598bc6134d3</entry>
Nov 30 12:32:14 user nova-compute[75672]:       <entry name="uuid">84f3ca7c-05db-4714-a685-3598bc6134d3</entry>
Nov 30 12:32:14 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:32:14 user nova-compute[75672]:     </system>
Nov 30 12:32:14 user nova-compute[75672]:   </sysinfo>
Nov 30 12:32:14 user nova-compute[75672]:   <os>
Nov 30 12:32:14 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:32:14 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:32:14 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:32:14 user nova-compute[75672]:   </os>
Nov 30 12:32:14 user nova-compute[75672]:   <features>
Nov 30 12:32:14 user nova-compute[75672]:     <acpi/>
Nov 30 12:32:14 user nova-compute[75672]:     <apic/>
Nov 30 12:32:14 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:32:14 user nova-compute[75672]:   </features>
Nov 30 12:32:14 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:32:14 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:32:14 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:32:14 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:32:14 user nova-compute[75672]:   </clock>
Nov 30 12:32:14 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:32:14 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:32:14 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:32:14 user nova-compute[75672]:   </cpu>
Nov 30 12:32:14 user nova-compute[75672]:   <devices>
Nov 30 12:32:14 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:32:14 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:32:14 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk"/>
Nov 30 12:32:14 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:32:14 user nova-compute[75672]:     </disk>
Nov 30 12:32:14 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:32:14 user nova-compute[75672]:       <mac address="fa:16:3e:36:eb:96"/>
Nov 30 12:32:14 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:32:14 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:32:14 user nova-compute[75672]:       <target dev="tap19ffba33-19"/>
Nov 30 12:32:14 user nova-compute[75672]:     </interface>
Nov 30 12:32:14 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:32:14 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/console.log" append="off"/>
Nov 30 12:32:14 user nova-compute[75672]:     </serial>
Nov 30 12:32:14 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:32:14 user nova-compute[75672]:     <video>
Nov 30 12:32:14 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:32:14 user nova-compute[75672]:     </video>
Nov 30 12:32:14 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:32:14 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:32:14 user nova-compute[75672]:     </rng>
Nov 30 12:32:14 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:32:14 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:32:14 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:32:14 user nova-compute[75672]:     </memballoon>
Nov 30 12:32:14 user nova-compute[75672]:   </devices>
Nov 30 12:32:14 user nova-compute[75672]: </domain>
Nov 30 12:32:14 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:32:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-500770239',display_name='tempest-TestVolumeSwap-server-500770239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-500770239',id=7,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk0/7Z/SxM9DFaYc2+TMknW9VHTXmMYv1R8MjNRjbGp/rVM3jARoBr3XKwKN6Pd14IJSPOkMrpYiSTwxeAVUUqFAtDNNawDeqKd/wbQ5WLEYafztJdMtZ02+EPbi2oulg==',key_name='tempest-keypair-3013591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39eae439dda0405e84c7e37b768e28a0',ramdisk_id='',reservation_id='r-1w4tom8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1206325901',owner_user_name='tempest-TestVolumeSwap-1206325901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='743a7b7ec097405a936c7ae01f870d36',uuid=84f3ca7c-05db-4714-a685-3598bc6134d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "address": "fa:16:3e:36:eb:96", "network": {"id": "c905cd92-2463-450c-9c3e-6fef670e27e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1410834846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39eae439dda0405e84c7e37b768e28a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ffba33-19", "ovs_interfaceid": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Converting VIF {"id": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "address": "fa:16:3e:36:eb:96", "network": {"id": "c905cd92-2463-450c-9c3e-6fef670e27e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1410834846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39eae439dda0405e84c7e37b768e28a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ffba33-19", "ovs_interfaceid": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:eb:96,bridge_name='br-int',has_traffic_filtering=True,id=19ffba33-190e-4fe0-bb72-53d8e79bbbd0,network=Network(c905cd92-2463-450c-9c3e-6fef670e27e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ffba33-19') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG os_vif [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:eb:96,bridge_name='br-int',has_traffic_filtering=True,id=19ffba33-190e-4fe0-bb72-53d8e79bbbd0,network=Network(c905cd92-2463-450c-9c3e-6fef670e27e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ffba33-19') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '758dae68-35ab-5803-b079-8699c35fd9ba', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19ffba33-19, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19ffba33-19, col_values=(('qos', UUID('6808f5cf-a9d1-4c1e-b107-15a422dcbb0c')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19ffba33-19, col_values=(('external_ids', {'iface-id': '19ffba33-190e-4fe0-bb72-53d8e79bbbd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:eb:96', 'vm-uuid': '84f3ca7c-05db-4714-a685-3598bc6134d3'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:32:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:15 user nova-compute[75672]: INFO os_vif [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:eb:96,bridge_name='br-int',has_traffic_filtering=True,id=19ffba33-190e-4fe0-bb72-53d8e79bbbd0,network=Network(c905cd92-2463-450c-9c3e-6fef670e27e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ffba33-19')
Nov 30 12:32:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:15 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:32:15 user nova-compute[75672]: INFO nova.compute.claims [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Claim successful on node user
Nov 30 12:32:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:32:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] No VIF found with MAC fa:16:3e:36:eb:96, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:32:15 user nova-compute[75672]: DEBUG nova.network.neutron [req-e74c9cfa-f80f-4d18-b451-012996437736 req-03aa9dde-3451-4666-9143-c7b28c854a92 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Updated VIF entry in instance network info cache for port 19ffba33-190e-4fe0-bb72-53d8e79bbbd0. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:32:15 user nova-compute[75672]: DEBUG nova.network.neutron [req-e74c9cfa-f80f-4d18-b451-012996437736 req-03aa9dde-3451-4666-9143-c7b28c854a92 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Updating instance_info_cache with network_info: [{"id": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "address": "fa:16:3e:36:eb:96", "network": {"id": "c905cd92-2463-450c-9c3e-6fef670e27e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1410834846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39eae439dda0405e84c7e37b768e28a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ffba33-19", "ovs_interfaceid": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:32:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e74c9cfa-f80f-4d18-b451-012996437736 req-03aa9dde-3451-4666-9143-c7b28c854a92 service nova] Releasing lock "refresh_cache-84f3ca7c-05db-4714-a685-3598bc6134d3" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:32:15 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.065s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG nova.network.neutron [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:32:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 30 12:32:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG nova.policy [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99c1de98c55f42d8833817b159df5cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e970f80ebac4746b62535ef0a437c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:32:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Creating image(s)
Nov 30 12:32:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "/opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "/opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "342f1ee9119e06497ce22204355f1d3ccc684523" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "342f1ee9119e06497ce22204355f1d3ccc684523" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523.part --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523.part --force-share --output=json" returned: 0 in 0.234s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:17 user nova-compute[75672]: DEBUG nova.virt.images [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] e62e39d9-cb91-46bc-9b6f-35627ad05b66 was qcow2, converting to raw {{(pid=75672) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 12:32:17 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:32:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523.part /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523.converted {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523.part /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523.converted" returned: 0 in 0.684s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523.converted --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523.converted --force-share --output=json" returned: 0 in 0.342s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "342f1ee9119e06497ce22204355f1d3ccc684523" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.874s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523 --force-share --output=json" returned: 0 in 0.313s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "342f1ee9119e06497ce22204355f1d3ccc684523" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "342f1ee9119e06497ce22204355f1d3ccc684523" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG nova.network.neutron [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Successfully created port: 2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523 --force-share --output=json" returned: 0 in 0.287s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523,backing_fmt=raw /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523,backing_fmt=raw /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk 1073741824" returned: 0 in 0.092s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "342f1ee9119e06497ce22204355f1d3ccc684523" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.395s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523 --force-share --output=json" returned: 0 in 0.244s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Cannot resize image /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Ensure instance console log exists: /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:19 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Instance spawned successfully.
Nov 30 12:32:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:20 user nova-compute[75672]: INFO nova.compute.manager [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Took 15.52 seconds to spawn the instance on the hypervisor.
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:32:20 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Instance spawned successfully.
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:20 user nova-compute[75672]: INFO nova.compute.manager [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Took 17.04 seconds to build instance.
Nov 30 12:32:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f3e2a45e-bd59-4473-9252-b059a43be068 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.233s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:20 user nova-compute[75672]: INFO nova.compute.manager [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Took 13.05 seconds to spawn the instance on the hypervisor.
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.network.neutron [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Successfully updated port: 2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "refresh_cache-6b34c9c2-18ab-45a5-ad54-24b830c27ac6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquired lock "refresh_cache-6b34c9c2-18ab-45a5-ad54-24b830c27ac6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.network.neutron [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-577121f5-f5fe-4275-9975-a8e67aabc63d req-dc1cb315-60e6-42a9-85e3-e5ecadb2bc6c service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Received event network-changed-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-577121f5-f5fe-4275-9975-a8e67aabc63d req-dc1cb315-60e6-42a9-85e3-e5ecadb2bc6c service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Refreshing instance network info cache due to event network-changed-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-577121f5-f5fe-4275-9975-a8e67aabc63d req-dc1cb315-60e6-42a9-85e3-e5ecadb2bc6c service nova] Acquiring lock "refresh_cache-6b34c9c2-18ab-45a5-ad54-24b830c27ac6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:32:20 user nova-compute[75672]: INFO nova.compute.manager [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Took 15.10 seconds to build instance.
Nov 30 12:32:20 user nova-compute[75672]: DEBUG nova.network.neutron [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:32:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9791e3bc-e163-4230-ad85-41569f6837f8 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.424s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.network.neutron [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Updating instance_info_cache with network_info: [{"id": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "address": "fa:16:3e:40:c9:b1", "network": {"id": "cff34241-9fea-4ea4-870c-f313e592180f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1419258086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e970f80ebac4746b62535ef0a437c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abd93a7-c3", "ovs_interfaceid": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Releasing lock "refresh_cache-6b34c9c2-18ab-45a5-ad54-24b830c27ac6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Instance network_info: |[{"id": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "address": "fa:16:3e:40:c9:b1", "network": {"id": "cff34241-9fea-4ea4-870c-f313e592180f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1419258086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e970f80ebac4746b62535ef0a437c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abd93a7-c3", "ovs_interfaceid": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-577121f5-f5fe-4275-9975-a8e67aabc63d req-dc1cb315-60e6-42a9-85e3-e5ecadb2bc6c service nova] Acquired lock "refresh_cache-6b34c9c2-18ab-45a5-ad54-24b830c27ac6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.network.neutron [req-577121f5-f5fe-4275-9975-a8e67aabc63d req-dc1cb315-60e6-42a9-85e3-e5ecadb2bc6c service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Refreshing network info cache for port 2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Start _get_guest_xml network_info=[{"id": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "address": "fa:16:3e:40:c9:b1", "network": {"id": "cff34241-9fea-4ea4-870c-f313e592180f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1419258086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e970f80ebac4746b62535ef0a437c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abd93a7-c3", "ovs_interfaceid": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:32:01Z,direct_url=<?>,disk_format='qcow2',id=e62e39d9-cb91-46bc-9b6f-35627ad05b66,min_disk=0,min_ram=0,name='',owner='70d8b086668047c7a6d28bd502ddf714',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:32:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/sda', 'boot_index': 0, 'image_id': 'e62e39d9-cb91-46bc-9b6f-35627ad05b66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:32:21 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:32:21 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:32:01Z,direct_url=<?>,disk_format='qcow2',id=e62e39d9-cb91-46bc-9b6f-35627ad05b66,min_disk=0,min_ram=0,name='',owner='70d8b086668047c7a6d28bd502ddf714',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:32:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1299844378',display_name='tempest-AttachSCSIVolumeTestJSON-server-1299844378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1299844378',id=8,image_ref='e62e39d9-cb91-46bc-9b6f-35627ad05b66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJM6zVjNA9WW1jsBNy9qDTawnAil6tcQCtrI2YbcdgAyrc3ptWNrLYd3MEqf9rWpHhU7fQViu+mUIQ+KuPbS1u6o4JwT6fDgT7dmUdpnnPQs01JilQwB34fAQWsOe8/ZCQ==',key_name='tempest-keypair-2083250103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e970f80ebac4746b62535ef0a437c90',ramdisk_id='',reservation_id='r-m4kr0d8l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e62e39d9-cb91-46bc-9b6f-35627ad05b66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1256034176',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1256034176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99c1de98c55f42d8833817b159df5cb2',uuid=6b34c9c2-18ab-45a5-ad54-24b830c27ac6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "address": "fa:16:3e:40:c9:b1", "network": {"id": "cff34241-9fea-4ea4-870c-f313e592180f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1419258086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e970f80ebac4746b62535ef0a437c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abd93a7-c3", "ovs_interfaceid": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Converting VIF {"id": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "address": "fa:16:3e:40:c9:b1", "network": {"id": "cff34241-9fea-4ea4-870c-f313e592180f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1419258086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e970f80ebac4746b62535ef0a437c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abd93a7-c3", "ovs_interfaceid": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:c9:b1,bridge_name='br-int',has_traffic_filtering=True,id=2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f,network=Network(cff34241-9fea-4ea4-870c-f313e592180f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abd93a7-c3') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.objects.instance [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:32:21 user nova-compute[75672]:   <uuid>6b34c9c2-18ab-45a5-ad54-24b830c27ac6</uuid>
Nov 30 12:32:21 user nova-compute[75672]:   <name>instance-00000008</name>
Nov 30 12:32:21 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:32:21 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:32:21 user nova-compute[75672]:   <metadata>
Nov 30 12:32:21 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:32:21 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:32:21 user nova-compute[75672]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1299844378</nova:name>
Nov 30 12:32:21 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:32:21</nova:creationTime>
Nov 30 12:32:21 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:32:21 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:32:21 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:32:21 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:32:21 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:32:21 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:32:21 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:32:21 user nova-compute[75672]:       <nova:owner>
Nov 30 12:32:21 user nova-compute[75672]:         <nova:user uuid="99c1de98c55f42d8833817b159df5cb2">tempest-AttachSCSIVolumeTestJSON-1256034176-project-member</nova:user>
Nov 30 12:32:21 user nova-compute[75672]:         <nova:project uuid="8e970f80ebac4746b62535ef0a437c90">tempest-AttachSCSIVolumeTestJSON-1256034176</nova:project>
Nov 30 12:32:21 user nova-compute[75672]:       </nova:owner>
Nov 30 12:32:21 user nova-compute[75672]:       <nova:root type="image" uuid="e62e39d9-cb91-46bc-9b6f-35627ad05b66"/>
Nov 30 12:32:21 user nova-compute[75672]:       <nova:ports>
Nov 30 12:32:21 user nova-compute[75672]:         <nova:port uuid="2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f">
Nov 30 12:32:21 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 12:32:21 user nova-compute[75672]:         </nova:port>
Nov 30 12:32:21 user nova-compute[75672]:       </nova:ports>
Nov 30 12:32:21 user nova-compute[75672]:     </nova:instance>
Nov 30 12:32:21 user nova-compute[75672]:   </metadata>
Nov 30 12:32:21 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:32:21 user nova-compute[75672]:     <system>
Nov 30 12:32:21 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:32:21 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:32:21 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:32:21 user nova-compute[75672]:       <entry name="serial">6b34c9c2-18ab-45a5-ad54-24b830c27ac6</entry>
Nov 30 12:32:21 user nova-compute[75672]:       <entry name="uuid">6b34c9c2-18ab-45a5-ad54-24b830c27ac6</entry>
Nov 30 12:32:21 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:32:21 user nova-compute[75672]:     </system>
Nov 30 12:32:21 user nova-compute[75672]:   </sysinfo>
Nov 30 12:32:21 user nova-compute[75672]:   <os>
Nov 30 12:32:21 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:32:21 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:32:21 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:32:21 user nova-compute[75672]:   </os>
Nov 30 12:32:21 user nova-compute[75672]:   <features>
Nov 30 12:32:21 user nova-compute[75672]:     <acpi/>
Nov 30 12:32:21 user nova-compute[75672]:     <apic/>
Nov 30 12:32:21 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:32:21 user nova-compute[75672]:   </features>
Nov 30 12:32:21 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:32:21 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:32:21 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:32:21 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:32:21 user nova-compute[75672]:   </clock>
Nov 30 12:32:21 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:32:21 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:32:21 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:32:21 user nova-compute[75672]:   </cpu>
Nov 30 12:32:21 user nova-compute[75672]:   <devices>
Nov 30 12:32:21 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:32:21 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:32:21 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk"/>
Nov 30 12:32:21 user nova-compute[75672]:       <target dev="sda" bus="scsi"/>
Nov 30 12:32:21 user nova-compute[75672]:       <address type="drive" controller="0" unit="0"/>
Nov 30 12:32:21 user nova-compute[75672]:     </disk>
Nov 30 12:32:21 user nova-compute[75672]:     <disk type="file" device="cdrom">
Nov 30 12:32:21 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 12:32:21 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk.config"/>
Nov 30 12:32:21 user nova-compute[75672]:       <target dev="sdb" bus="scsi"/>
Nov 30 12:32:21 user nova-compute[75672]:       <address type="drive" controller="0" unit="1"/>
Nov 30 12:32:21 user nova-compute[75672]:     </disk>
Nov 30 12:32:21 user nova-compute[75672]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 30 12:32:21 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:32:21 user nova-compute[75672]:       <mac address="fa:16:3e:40:c9:b1"/>
Nov 30 12:32:21 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:32:21 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:32:21 user nova-compute[75672]:       <target dev="tap2abd93a7-c3"/>
Nov 30 12:32:21 user nova-compute[75672]:     </interface>
Nov 30 12:32:21 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:32:21 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/console.log" append="off"/>
Nov 30 12:32:21 user nova-compute[75672]:     </serial>
Nov 30 12:32:21 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:32:21 user nova-compute[75672]:     <video>
Nov 30 12:32:21 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:32:21 user nova-compute[75672]:     </video>
Nov 30 12:32:21 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:32:21 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:32:21 user nova-compute[75672]:     </rng>
Nov 30 12:32:21 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:32:21 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:32:21 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:32:21 user nova-compute[75672]:     </memballoon>
Nov 30 12:32:21 user nova-compute[75672]:   </devices>
Nov 30 12:32:21 user nova-compute[75672]: </domain>
Nov 30 12:32:21 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1299844378',display_name='tempest-AttachSCSIVolumeTestJSON-server-1299844378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1299844378',id=8,image_ref='e62e39d9-cb91-46bc-9b6f-35627ad05b66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJM6zVjNA9WW1jsBNy9qDTawnAil6tcQCtrI2YbcdgAyrc3ptWNrLYd3MEqf9rWpHhU7fQViu+mUIQ+KuPbS1u6o4JwT6fDgT7dmUdpnnPQs01JilQwB34fAQWsOe8/ZCQ==',key_name='tempest-keypair-2083250103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e970f80ebac4746b62535ef0a437c90',ramdisk_id='',reservation_id='r-m4kr0d8l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e62e39d9-cb91-46bc-9b6f-35627ad05b66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1256034176',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1256034176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99c1de98c55f42d8833817b159df5cb2',uuid=6b34c9c2-18ab-45a5-ad54-24b830c27ac6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "address": "fa:16:3e:40:c9:b1", "network": {"id": "cff34241-9fea-4ea4-870c-f313e592180f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1419258086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e970f80ebac4746b62535ef0a437c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abd93a7-c3", "ovs_interfaceid": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Converting VIF {"id": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "address": "fa:16:3e:40:c9:b1", "network": {"id": "cff34241-9fea-4ea4-870c-f313e592180f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1419258086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e970f80ebac4746b62535ef0a437c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abd93a7-c3", "ovs_interfaceid": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:c9:b1,bridge_name='br-int',has_traffic_filtering=True,id=2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f,network=Network(cff34241-9fea-4ea4-870c-f313e592180f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abd93a7-c3') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG os_vif [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:c9:b1,bridge_name='br-int',has_traffic_filtering=True,id=2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f,network=Network(cff34241-9fea-4ea4-870c-f313e592180f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abd93a7-c3') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b06293cd-8ed3-5aca-b8a0-039f356c771f', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2abd93a7-c3, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2abd93a7-c3, col_values=(('qos', UUID('018a0cb4-80ac-4222-8aaf-c6ecd673d10a')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2abd93a7-c3, col_values=(('external_ids', {'iface-id': '2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:c9:b1', 'vm-uuid': '6b34c9c2-18ab-45a5-ad54-24b830c27ac6'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:21 user nova-compute[75672]: INFO os_vif [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:c9:b1,bridge_name='br-int',has_traffic_filtering=True,id=2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f,network=Network(cff34241-9fea-4ea4-870c-f313e592180f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abd93a7-c3')
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] No BDM found with device name sda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] No VIF found with MAC fa:16:3e:40:c9:b1, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:32:21 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Using config drive
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-4d2cc23f-25b6-4122-9ced-bd4d000247d5 req-f3a8cee1-9f1f-42d3-91d0-08ffffcf6146 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received event network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4d2cc23f-25b6-4122-9ced-bd4d000247d5 req-f3a8cee1-9f1f-42d3-91d0-08ffffcf6146 service nova] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4d2cc23f-25b6-4122-9ced-bd4d000247d5 req-f3a8cee1-9f1f-42d3-91d0-08ffffcf6146 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4d2cc23f-25b6-4122-9ced-bd4d000247d5 req-f3a8cee1-9f1f-42d3-91d0-08ffffcf6146 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-4d2cc23f-25b6-4122-9ced-bd4d000247d5 req-f3a8cee1-9f1f-42d3-91d0-08ffffcf6146 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] No waiting events found dispatching network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:21 user nova-compute[75672]: WARNING nova.compute.manager [req-4d2cc23f-25b6-4122-9ced-bd4d000247d5 req-f3a8cee1-9f1f-42d3-91d0-08ffffcf6146 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received unexpected event network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 for instance with vm_state active and task_state None.
Nov 30 12:32:22 user nova-compute[75672]: DEBUG nova.network.neutron [req-577121f5-f5fe-4275-9975-a8e67aabc63d req-dc1cb315-60e6-42a9-85e3-e5ecadb2bc6c service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Updated VIF entry in instance network info cache for port 2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:32:22 user nova-compute[75672]: DEBUG nova.network.neutron [req-577121f5-f5fe-4275-9975-a8e67aabc63d req-dc1cb315-60e6-42a9-85e3-e5ecadb2bc6c service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Updating instance_info_cache with network_info: [{"id": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "address": "fa:16:3e:40:c9:b1", "network": {"id": "cff34241-9fea-4ea4-870c-f313e592180f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1419258086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e970f80ebac4746b62535ef0a437c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abd93a7-c3", "ovs_interfaceid": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:32:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-577121f5-f5fe-4275-9975-a8e67aabc63d req-dc1cb315-60e6-42a9-85e3-e5ecadb2bc6c service nova] Releasing lock "refresh_cache-6b34c9c2-18ab-45a5-ad54-24b830c27ac6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:32:22 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Creating config drive at /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk.config
Nov 30 12:32:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnuwknhj8 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnuwknhj8" returned: 0 in 0.063s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Acquiring lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:23 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:32:23 user nova-compute[75672]: DEBUG nova.compute.manager [req-4b01b560-beda-4839-826f-3b101c120c0f req-e1d141ef-c672-4083-a5f6-0a96b0ffaca9 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received event network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4b01b560-beda-4839-826f-3b101c120c0f req-e1d141ef-c672-4083-a5f6-0a96b0ffaca9 service nova] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4b01b560-beda-4839-826f-3b101c120c0f req-e1d141ef-c672-4083-a5f6-0a96b0ffaca9 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4b01b560-beda-4839-826f-3b101c120c0f req-e1d141ef-c672-4083-a5f6-0a96b0ffaca9 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:23 user nova-compute[75672]: DEBUG nova.compute.manager [req-4b01b560-beda-4839-826f-3b101c120c0f req-e1d141ef-c672-4083-a5f6-0a96b0ffaca9 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] No waiting events found dispatching network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:23 user nova-compute[75672]: WARNING nova.compute.manager [req-4b01b560-beda-4839-826f-3b101c120c0f req-e1d141ef-c672-4083-a5f6-0a96b0ffaca9 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received unexpected event network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 for instance with vm_state active and task_state None.
Nov 30 12:32:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:32:23 user nova-compute[75672]: INFO nova.compute.claims [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Claim successful on node user
Nov 30 12:32:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.717s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG nova.network.neutron [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:32:24 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:32:24 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG nova.policy [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5deab7a4199e420490ea7c5300d4bd55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb448f77dbf143d59589139add90ff93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:32:24 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Creating image(s)
Nov 30 12:32:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Acquiring lock "/opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "/opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "/opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.216s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.213s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk 1073741824" returned: 0 in 0.136s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.359s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] There are 0 instances to clean {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75672) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.211s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Cannot resize image /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Ensure instance console log exists: /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.network.neutron [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Successfully created port: 32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Acquiring lock "e1542356-c1bb-46db-8570-94958f48ab83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "e1542356-c1bb-46db-8570-94958f48ab83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:32:26 user nova-compute[75672]: INFO nova.compute.claims [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Claim successful on node user
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:32:26 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Instance spawned successfully.
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Skipping network cache update for instance because it is Building. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Skipping network cache update for instance because it is Building. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Skipping network cache update for instance because it is Building. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 30 12:32:26 user nova-compute[75672]: INFO nova.compute.manager [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Took 10.18 seconds to spawn the instance on the hypervisor.
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.objects.instance [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lazy-loading 'info_cache' on Instance uuid 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:32:26 user nova-compute[75672]: INFO nova.compute.manager [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Took 11.99 seconds to build instance.
Nov 30 12:32:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8bccc596-50cd-4959-8695-b1057a52ed41 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.386s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:26 user nova-compute[75672]: DEBUG nova.network.neutron [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Successfully updated port: 32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Acquiring lock "refresh_cache-22619e89-6f9e-402b-9a73-2af94c1e59a5" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Acquired lock "refresh_cache-22619e89-6f9e-402b-9a73-2af94c1e59a5" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-6ec12c44-04e6-4c6f-ac14-03e89715701d req-57da22bd-afa5-41d3-8987-4f68a01d6223 service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received event network-changed-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-6ec12c44-04e6-4c6f-ac14-03e89715701d req-57da22bd-afa5-41d3-8987-4f68a01d6223 service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Refreshing instance network info cache due to event network-changed-32c6ac7e-d869-4c4a-8d1a-3419048d9a00. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6ec12c44-04e6-4c6f-ac14-03e89715701d req-57da22bd-afa5-41d3-8987-4f68a01d6223 service nova] Acquiring lock "refresh_cache-22619e89-6f9e-402b-9a73-2af94c1e59a5" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:32:27 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.policy [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d8657c2797c425a8d77f9843eec9928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce81245b66a491e9e2d180432fe23f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:32:27 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Creating image(s)
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "/opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "/opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.217s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Updating instance_info_cache with network_info: [{"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.251s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Updating instance_info_cache with network_info: [{"id": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "address": "fa:16:3e:47:90:40", "network": {"id": "4eae53c3-fc97-4624-ac91-68d53774ad23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1034722699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb448f77dbf143d59589139add90ff93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c6ac7e-d8", "ovs_interfaceid": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk 1073741824" returned: 0 in 0.063s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Releasing lock "refresh_cache-22619e89-6f9e-402b-9a73-2af94c1e59a5" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Instance network_info: |[{"id": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "address": "fa:16:3e:47:90:40", "network": {"id": "4eae53c3-fc97-4624-ac91-68d53774ad23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1034722699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb448f77dbf143d59589139add90ff93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c6ac7e-d8", "ovs_interfaceid": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6ec12c44-04e6-4c6f-ac14-03e89715701d req-57da22bd-afa5-41d3-8987-4f68a01d6223 service nova] Acquired lock "refresh_cache-22619e89-6f9e-402b-9a73-2af94c1e59a5" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.network.neutron [req-6ec12c44-04e6-4c6f-ac14-03e89715701d req-57da22bd-afa5-41d3-8987-4f68a01d6223 service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Refreshing network info cache for port 32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:32:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Start _get_guest_xml network_info=[{"id": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "address": "fa:16:3e:47:90:40", "network": {"id": "4eae53c3-fc97-4624-ac91-68d53774ad23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1034722699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb448f77dbf143d59589139add90ff93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c6ac7e-d8", "ovs_interfaceid": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:32:28 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:32:28 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:32:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1707145720',display_name='tempest-VolumesAssistedSnapshotsTest-server-1707145720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1707145720',id=9,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVaiWCW4hM4tcgYvVgf8ZayAaXqzyBdl/mUiEGOIVmNzijIpAGF+6vt+HKkFlEA5+Aonj3OwEEim0zPWRWEUM5kJyW19GURD3Ka55yMl9nWTmi3BbSvHHC4EJpjG120Og==',key_name='tempest-keypair-1737760818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb448f77dbf143d59589139add90ff93',ramdisk_id='',reservation_id='r-q2m3q64b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-313696671',owner_user_name='tempest-VolumesAssistedSnapshotsTest-313696671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5deab7a4199e420490ea7c5300d4bd55',uuid=22619e89-6f9e-402b-9a73-2af94c1e59a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "address": "fa:16:3e:47:90:40", "network": {"id": "4eae53c3-fc97-4624-ac91-68d53774ad23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1034722699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb448f77dbf143d59589139add90ff93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c6ac7e-d8", "ovs_interfaceid": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Converting VIF {"id": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "address": "fa:16:3e:47:90:40", "network": {"id": "4eae53c3-fc97-4624-ac91-68d53774ad23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1034722699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb448f77dbf143d59589139add90ff93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c6ac7e-d8", "ovs_interfaceid": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:90:40,bridge_name='br-int',has_traffic_filtering=True,id=32c6ac7e-d869-4c4a-8d1a-3419048d9a00,network=Network(4eae53c3-fc97-4624-ac91-68d53774ad23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c6ac7e-d8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.objects.instance [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lazy-loading 'pci_devices' on Instance uuid 22619e89-6f9e-402b-9a73-2af94c1e59a5 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:32:28 user nova-compute[75672]:   <uuid>22619e89-6f9e-402b-9a73-2af94c1e59a5</uuid>
Nov 30 12:32:28 user nova-compute[75672]:   <name>instance-00000009</name>
Nov 30 12:32:28 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:32:28 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:32:28 user nova-compute[75672]:   <metadata>
Nov 30 12:32:28 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:32:28 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:32:28 user nova-compute[75672]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1707145720</nova:name>
Nov 30 12:32:28 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:32:28</nova:creationTime>
Nov 30 12:32:28 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:32:28 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:32:28 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:32:28 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:32:28 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:32:28 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:32:28 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:32:28 user nova-compute[75672]:       <nova:owner>
Nov 30 12:32:28 user nova-compute[75672]:         <nova:user uuid="5deab7a4199e420490ea7c5300d4bd55">tempest-VolumesAssistedSnapshotsTest-313696671-project-member</nova:user>
Nov 30 12:32:28 user nova-compute[75672]:         <nova:project uuid="eb448f77dbf143d59589139add90ff93">tempest-VolumesAssistedSnapshotsTest-313696671</nova:project>
Nov 30 12:32:28 user nova-compute[75672]:       </nova:owner>
Nov 30 12:32:28 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:32:28 user nova-compute[75672]:       <nova:ports>
Nov 30 12:32:28 user nova-compute[75672]:         <nova:port uuid="32c6ac7e-d869-4c4a-8d1a-3419048d9a00">
Nov 30 12:32:28 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 12:32:28 user nova-compute[75672]:         </nova:port>
Nov 30 12:32:28 user nova-compute[75672]:       </nova:ports>
Nov 30 12:32:28 user nova-compute[75672]:     </nova:instance>
Nov 30 12:32:28 user nova-compute[75672]:   </metadata>
Nov 30 12:32:28 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:32:28 user nova-compute[75672]:     <system>
Nov 30 12:32:28 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:32:28 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:32:28 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:32:28 user nova-compute[75672]:       <entry name="serial">22619e89-6f9e-402b-9a73-2af94c1e59a5</entry>
Nov 30 12:32:28 user nova-compute[75672]:       <entry name="uuid">22619e89-6f9e-402b-9a73-2af94c1e59a5</entry>
Nov 30 12:32:28 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:32:28 user nova-compute[75672]:     </system>
Nov 30 12:32:28 user nova-compute[75672]:   </sysinfo>
Nov 30 12:32:28 user nova-compute[75672]:   <os>
Nov 30 12:32:28 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:32:28 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:32:28 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:32:28 user nova-compute[75672]:   </os>
Nov 30 12:32:28 user nova-compute[75672]:   <features>
Nov 30 12:32:28 user nova-compute[75672]:     <acpi/>
Nov 30 12:32:28 user nova-compute[75672]:     <apic/>
Nov 30 12:32:28 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:32:28 user nova-compute[75672]:   </features>
Nov 30 12:32:28 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:32:28 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:32:28 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:32:28 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:32:28 user nova-compute[75672]:   </clock>
Nov 30 12:32:28 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:32:28 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:32:28 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:32:28 user nova-compute[75672]:   </cpu>
Nov 30 12:32:28 user nova-compute[75672]:   <devices>
Nov 30 12:32:28 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:32:28 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:32:28 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk"/>
Nov 30 12:32:28 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:32:28 user nova-compute[75672]:     </disk>
Nov 30 12:32:28 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:32:28 user nova-compute[75672]:       <mac address="fa:16:3e:47:90:40"/>
Nov 30 12:32:28 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:32:28 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:32:28 user nova-compute[75672]:       <target dev="tap32c6ac7e-d8"/>
Nov 30 12:32:28 user nova-compute[75672]:     </interface>
Nov 30 12:32:28 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:32:28 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/console.log" append="off"/>
Nov 30 12:32:28 user nova-compute[75672]:     </serial>
Nov 30 12:32:28 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:32:28 user nova-compute[75672]:     <video>
Nov 30 12:32:28 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:32:28 user nova-compute[75672]:     </video>
Nov 30 12:32:28 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:32:28 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:32:28 user nova-compute[75672]:     </rng>
Nov 30 12:32:28 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:32:28 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:32:28 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:32:28 user nova-compute[75672]:     </memballoon>
Nov 30 12:32:28 user nova-compute[75672]:   </devices>
Nov 30 12:32:28 user nova-compute[75672]: </domain>
Nov 30 12:32:28 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:32:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1707145720',display_name='tempest-VolumesAssistedSnapshotsTest-server-1707145720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1707145720',id=9,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVaiWCW4hM4tcgYvVgf8ZayAaXqzyBdl/mUiEGOIVmNzijIpAGF+6vt+HKkFlEA5+Aonj3OwEEim0zPWRWEUM5kJyW19GURD3Ka55yMl9nWTmi3BbSvHHC4EJpjG120Og==',key_name='tempest-keypair-1737760818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb448f77dbf143d59589139add90ff93',ramdisk_id='',reservation_id='r-q2m3q64b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-313696671',owner_user_name='tempest-VolumesAssistedSnapshotsTest-313696671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5deab7a4199e420490ea7c5300d4bd55',uuid=22619e89-6f9e-402b-9a73-2af94c1e59a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "address": "fa:16:3e:47:90:40", "network": {"id": "4eae53c3-fc97-4624-ac91-68d53774ad23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1034722699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb448f77dbf143d59589139add90ff93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c6ac7e-d8", "ovs_interfaceid": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Converting VIF {"id": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "address": "fa:16:3e:47:90:40", "network": {"id": "4eae53c3-fc97-4624-ac91-68d53774ad23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1034722699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb448f77dbf143d59589139add90ff93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c6ac7e-d8", "ovs_interfaceid": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:90:40,bridge_name='br-int',has_traffic_filtering=True,id=32c6ac7e-d869-4c4a-8d1a-3419048d9a00,network=Network(4eae53c3-fc97-4624-ac91-68d53774ad23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c6ac7e-d8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG os_vif [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:90:40,bridge_name='br-int',has_traffic_filtering=True,id=32c6ac7e-d869-4c4a-8d1a-3419048d9a00,network=Network(4eae53c3-fc97-4624-ac91-68d53774ad23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c6ac7e-d8') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.network.neutron [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Successfully created port: c7416931-8e4f-4050-8639-9afe7daa7e2e {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d6a12c2-20b4-5e22-a39a-02a17bd1d0bb', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32c6ac7e-d8, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32c6ac7e-d8, col_values=(('qos', UUID('d6837795-a503-4739-a8e5-d95acf9becfd')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32c6ac7e-d8, col_values=(('external_ids', {'iface-id': '32c6ac7e-d869-4c4a-8d1a-3419048d9a00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:90:40', 'vm-uuid': '22619e89-6f9e-402b-9a73-2af94c1e59a5'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:28 user nova-compute[75672]: INFO os_vif [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:90:40,bridge_name='br-int',has_traffic_filtering=True,id=32c6ac7e-d869-4c4a-8d1a-3419048d9a00,network=Network(4eae53c3-fc97-4624-ac91-68d53774ad23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c6ac7e-d8')
Nov 30 12:32:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.284s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] No VIF found with MAC fa:16:3e:47:90:40, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Cannot resize image /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Ensure instance console log exists: /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.network.neutron [req-6ec12c44-04e6-4c6f-ac14-03e89715701d req-57da22bd-afa5-41d3-8987-4f68a01d6223 service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Updated VIF entry in instance network info cache for port 32c6ac7e-d869-4c4a-8d1a-3419048d9a00. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.network.neutron [req-6ec12c44-04e6-4c6f-ac14-03e89715701d req-57da22bd-afa5-41d3-8987-4f68a01d6223 service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Updating instance_info_cache with network_info: [{"id": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "address": "fa:16:3e:47:90:40", "network": {"id": "4eae53c3-fc97-4624-ac91-68d53774ad23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1034722699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb448f77dbf143d59589139add90ff93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c6ac7e-d8", "ovs_interfaceid": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6ec12c44-04e6-4c6f-ac14-03e89715701d req-57da22bd-afa5-41d3-8987-4f68a01d6223 service nova] Releasing lock "refresh_cache-22619e89-6f9e-402b-9a73-2af94c1e59a5" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.network.neutron [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Successfully updated port: c7416931-8e4f-4050-8639-9afe7daa7e2e {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Acquiring lock "refresh_cache-e1542356-c1bb-46db-8570-94958f48ab83" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Acquired lock "refresh_cache-e1542356-c1bb-46db-8570-94958f48ab83" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.network.neutron [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:32:28 user nova-compute[75672]: DEBUG nova.network.neutron [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-f1a985c2-c739-4ea1-8651-56b053671377 req-a3a2d1ef-bdda-456a-b2e5-6093828aef7d service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Received event network-changed-c7416931-8e4f-4050-8639-9afe7daa7e2e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-f1a985c2-c739-4ea1-8651-56b053671377 req-a3a2d1ef-bdda-456a-b2e5-6093828aef7d service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Refreshing instance network info cache due to event network-changed-c7416931-8e4f-4050-8639-9afe7daa7e2e. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f1a985c2-c739-4ea1-8651-56b053671377 req-a3a2d1ef-bdda-456a-b2e5-6093828aef7d service nova] Acquiring lock "refresh_cache-e1542356-c1bb-46db-8570-94958f48ab83" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.network.neutron [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Updating instance_info_cache with network_info: [{"id": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "address": "fa:16:3e:41:4d:11", "network": {"id": "31fd3573-37a5-4451-b7d2-1a713d5c0c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-900830365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce81245b66a491e9e2d180432fe23f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7416931-8e", "ovs_interfaceid": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Releasing lock "refresh_cache-e1542356-c1bb-46db-8570-94958f48ab83" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Instance network_info: |[{"id": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "address": "fa:16:3e:41:4d:11", "network": {"id": "31fd3573-37a5-4451-b7d2-1a713d5c0c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-900830365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce81245b66a491e9e2d180432fe23f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7416931-8e", "ovs_interfaceid": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f1a985c2-c739-4ea1-8651-56b053671377 req-a3a2d1ef-bdda-456a-b2e5-6093828aef7d service nova] Acquired lock "refresh_cache-e1542356-c1bb-46db-8570-94958f48ab83" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.network.neutron [req-f1a985c2-c739-4ea1-8651-56b053671377 req-a3a2d1ef-bdda-456a-b2e5-6093828aef7d service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Refreshing network info cache for port c7416931-8e4f-4050-8639-9afe7daa7e2e {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Start _get_guest_xml network_info=[{"id": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "address": "fa:16:3e:41:4d:11", "network": {"id": "31fd3573-37a5-4451-b7d2-1a713d5c0c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-900830365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce81245b66a491e9e2d180432fe23f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7416931-8e", "ovs_interfaceid": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:32:29 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:32:29 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-371365079',display_name='tempest-VolumesActionsTest-instance-371365079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-371365079',id=10,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce81245b66a491e9e2d180432fe23f6',ramdisk_id='',reservation_id='r-c86aqvym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-79059644',owner_user_name='tempest-VolumesActionsTest-79059644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:27Z,user_data=None,user_id='4d8657c2797c425a8d77f9843eec9928',uuid=e1542356-c1bb-46db-8570-94958f48ab83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "address": "fa:16:3e:41:4d:11", "network": {"id": "31fd3573-37a5-4451-b7d2-1a713d5c0c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-900830365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce81245b66a491e9e2d180432fe23f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7416931-8e", "ovs_interfaceid": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Converting VIF {"id": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "address": "fa:16:3e:41:4d:11", "network": {"id": "31fd3573-37a5-4451-b7d2-1a713d5c0c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-900830365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce81245b66a491e9e2d180432fe23f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7416931-8e", "ovs_interfaceid": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:4d:11,bridge_name='br-int',has_traffic_filtering=True,id=c7416931-8e4f-4050-8639-9afe7daa7e2e,network=Network(31fd3573-37a5-4451-b7d2-1a713d5c0c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7416931-8e') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lazy-loading 'pci_devices' on Instance uuid e1542356-c1bb-46db-8570-94958f48ab83 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:32:29 user nova-compute[75672]:   <uuid>e1542356-c1bb-46db-8570-94958f48ab83</uuid>
Nov 30 12:32:29 user nova-compute[75672]:   <name>instance-0000000a</name>
Nov 30 12:32:29 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:32:29 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:32:29 user nova-compute[75672]:   <metadata>
Nov 30 12:32:29 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:32:29 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:32:29 user nova-compute[75672]:       <nova:name>tempest-VolumesActionsTest-instance-371365079</nova:name>
Nov 30 12:32:29 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:32:29</nova:creationTime>
Nov 30 12:32:29 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:32:29 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:32:29 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:32:29 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:32:29 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:32:29 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:32:29 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:32:29 user nova-compute[75672]:       <nova:owner>
Nov 30 12:32:29 user nova-compute[75672]:         <nova:user uuid="4d8657c2797c425a8d77f9843eec9928">tempest-VolumesActionsTest-79059644-project-member</nova:user>
Nov 30 12:32:29 user nova-compute[75672]:         <nova:project uuid="fce81245b66a491e9e2d180432fe23f6">tempest-VolumesActionsTest-79059644</nova:project>
Nov 30 12:32:29 user nova-compute[75672]:       </nova:owner>
Nov 30 12:32:29 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:32:29 user nova-compute[75672]:       <nova:ports>
Nov 30 12:32:29 user nova-compute[75672]:         <nova:port uuid="c7416931-8e4f-4050-8639-9afe7daa7e2e">
Nov 30 12:32:29 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 12:32:29 user nova-compute[75672]:         </nova:port>
Nov 30 12:32:29 user nova-compute[75672]:       </nova:ports>
Nov 30 12:32:29 user nova-compute[75672]:     </nova:instance>
Nov 30 12:32:29 user nova-compute[75672]:   </metadata>
Nov 30 12:32:29 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:32:29 user nova-compute[75672]:     <system>
Nov 30 12:32:29 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:32:29 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:32:29 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:32:29 user nova-compute[75672]:       <entry name="serial">e1542356-c1bb-46db-8570-94958f48ab83</entry>
Nov 30 12:32:29 user nova-compute[75672]:       <entry name="uuid">e1542356-c1bb-46db-8570-94958f48ab83</entry>
Nov 30 12:32:29 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:32:29 user nova-compute[75672]:     </system>
Nov 30 12:32:29 user nova-compute[75672]:   </sysinfo>
Nov 30 12:32:29 user nova-compute[75672]:   <os>
Nov 30 12:32:29 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:32:29 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:32:29 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:32:29 user nova-compute[75672]:   </os>
Nov 30 12:32:29 user nova-compute[75672]:   <features>
Nov 30 12:32:29 user nova-compute[75672]:     <acpi/>
Nov 30 12:32:29 user nova-compute[75672]:     <apic/>
Nov 30 12:32:29 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:32:29 user nova-compute[75672]:   </features>
Nov 30 12:32:29 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:32:29 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:32:29 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:32:29 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:32:29 user nova-compute[75672]:   </clock>
Nov 30 12:32:29 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:32:29 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:32:29 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:32:29 user nova-compute[75672]:   </cpu>
Nov 30 12:32:29 user nova-compute[75672]:   <devices>
Nov 30 12:32:29 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:32:29 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:32:29 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk"/>
Nov 30 12:32:29 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:32:29 user nova-compute[75672]:     </disk>
Nov 30 12:32:29 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:32:29 user nova-compute[75672]:       <mac address="fa:16:3e:41:4d:11"/>
Nov 30 12:32:29 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:32:29 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:32:29 user nova-compute[75672]:       <target dev="tapc7416931-8e"/>
Nov 30 12:32:29 user nova-compute[75672]:     </interface>
Nov 30 12:32:29 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:32:29 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/console.log" append="off"/>
Nov 30 12:32:29 user nova-compute[75672]:     </serial>
Nov 30 12:32:29 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:32:29 user nova-compute[75672]:     <video>
Nov 30 12:32:29 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:32:29 user nova-compute[75672]:     </video>
Nov 30 12:32:29 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:32:29 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:32:29 user nova-compute[75672]:     </rng>
Nov 30 12:32:29 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:32:29 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:32:29 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:32:29 user nova-compute[75672]:     </memballoon>
Nov 30 12:32:29 user nova-compute[75672]:   </devices>
Nov 30 12:32:29 user nova-compute[75672]: </domain>
Nov 30 12:32:29 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-371365079',display_name='tempest-VolumesActionsTest-instance-371365079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-371365079',id=10,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce81245b66a491e9e2d180432fe23f6',ramdisk_id='',reservation_id='r-c86aqvym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-79059644',owner_user_name='tempest-VolumesActionsTest-79059644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:27Z,user_data=None,user_id='4d8657c2797c425a8d77f9843eec9928',uuid=e1542356-c1bb-46db-8570-94958f48ab83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "address": "fa:16:3e:41:4d:11", "network": {"id": "31fd3573-37a5-4451-b7d2-1a713d5c0c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-900830365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce81245b66a491e9e2d180432fe23f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7416931-8e", "ovs_interfaceid": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Converting VIF {"id": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "address": "fa:16:3e:41:4d:11", "network": {"id": "31fd3573-37a5-4451-b7d2-1a713d5c0c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-900830365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce81245b66a491e9e2d180432fe23f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7416931-8e", "ovs_interfaceid": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:4d:11,bridge_name='br-int',has_traffic_filtering=True,id=c7416931-8e4f-4050-8639-9afe7daa7e2e,network=Network(31fd3573-37a5-4451-b7d2-1a713d5c0c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7416931-8e') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG os_vif [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4d:11,bridge_name='br-int',has_traffic_filtering=True,id=c7416931-8e4f-4050-8639-9afe7daa7e2e,network=Network(31fd3573-37a5-4451-b7d2-1a713d5c0c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7416931-8e') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '845b3700-a41e-5add-9410-39bbe7a33121', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7416931-8e, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7416931-8e, col_values=(('qos', UUID('b54828d2-a288-4fd3-b573-482f0395768e')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7416931-8e, col_values=(('external_ids', {'iface-id': 'c7416931-8e4f-4050-8639-9afe7daa7e2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:4d:11', 'vm-uuid': 'e1542356-c1bb-46db-8570-94958f48ab83'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:29 user nova-compute[75672]: INFO os_vif [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4d:11,bridge_name='br-int',has_traffic_filtering=True,id=c7416931-8e4f-4050-8639-9afe7daa7e2e,network=Network(31fd3573-37a5-4451-b7d2-1a713d5c0c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7416931-8e')
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] No VIF found with MAC fa:16:3e:41:4d:11, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-ff0dfdd7-d594-41ca-b89c-9574fbea2032 req-4e6ff6c3-542a-4476-8a8a-70b9f9e75f19 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Received event network-vif-plugged-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ff0dfdd7-d594-41ca-b89c-9574fbea2032 req-4e6ff6c3-542a-4476-8a8a-70b9f9e75f19 service nova] Acquiring lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ff0dfdd7-d594-41ca-b89c-9574fbea2032 req-4e6ff6c3-542a-4476-8a8a-70b9f9e75f19 service nova] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ff0dfdd7-d594-41ca-b89c-9574fbea2032 req-4e6ff6c3-542a-4476-8a8a-70b9f9e75f19 service nova] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-ff0dfdd7-d594-41ca-b89c-9574fbea2032 req-4e6ff6c3-542a-4476-8a8a-70b9f9e75f19 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] No waiting events found dispatching network-vif-plugged-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:29 user nova-compute[75672]: WARNING nova.compute.manager [req-ff0dfdd7-d594-41ca-b89c-9574fbea2032 req-4e6ff6c3-542a-4476-8a8a-70b9f9e75f19 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Received unexpected event network-vif-plugged-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f for instance with vm_state active and task_state None.
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:30 user nova-compute[75672]: DEBUG nova.network.neutron [req-f1a985c2-c739-4ea1-8651-56b053671377 req-a3a2d1ef-bdda-456a-b2e5-6093828aef7d service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Updated VIF entry in instance network info cache for port c7416931-8e4f-4050-8639-9afe7daa7e2e. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:32:30 user nova-compute[75672]: DEBUG nova.network.neutron [req-f1a985c2-c739-4ea1-8651-56b053671377 req-a3a2d1ef-bdda-456a-b2e5-6093828aef7d service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Updating instance_info_cache with network_info: [{"id": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "address": "fa:16:3e:41:4d:11", "network": {"id": "31fd3573-37a5-4451-b7d2-1a713d5c0c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-900830365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce81245b66a491e9e2d180432fe23f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7416931-8e", "ovs_interfaceid": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:32:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f1a985c2-c739-4ea1-8651-56b053671377 req-a3a2d1ef-bdda-456a-b2e5-6093828aef7d service nova] Releasing lock "refresh_cache-e1542356-c1bb-46db-8570-94958f48ab83" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:32:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-ed4b08bb-217e-4d12-a190-ad4d9a4af6a3 req-ff1edde6-2ddd-4819-94f2-5f68fa097ee4 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received event network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ed4b08bb-217e-4d12-a190-ad4d9a4af6a3 req-ff1edde6-2ddd-4819-94f2-5f68fa097ee4 service nova] Acquiring lock "62555959-6271-47e1-920c-b6333de4cca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ed4b08bb-217e-4d12-a190-ad4d9a4af6a3 req-ff1edde6-2ddd-4819-94f2-5f68fa097ee4 service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ed4b08bb-217e-4d12-a190-ad4d9a4af6a3 req-ff1edde6-2ddd-4819-94f2-5f68fa097ee4 service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-ed4b08bb-217e-4d12-a190-ad4d9a4af6a3 req-ff1edde6-2ddd-4819-94f2-5f68fa097ee4 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] No waiting events found dispatching network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:31 user nova-compute[75672]: WARNING nova.compute.manager [req-ed4b08bb-217e-4d12-a190-ad4d9a4af6a3 req-ff1edde6-2ddd-4819-94f2-5f68fa097ee4 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received unexpected event network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 for instance with vm_state active and task_state None.
Nov 30 12:32:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-34ac34cc-e603-437a-bf05-8de8b2904559 req-733a6bbb-0914-46ca-8cb5-a64bece7ee65 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Received event network-vif-plugged-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-34ac34cc-e603-437a-bf05-8de8b2904559 req-733a6bbb-0914-46ca-8cb5-a64bece7ee65 service nova] Acquiring lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-34ac34cc-e603-437a-bf05-8de8b2904559 req-733a6bbb-0914-46ca-8cb5-a64bece7ee65 service nova] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-34ac34cc-e603-437a-bf05-8de8b2904559 req-733a6bbb-0914-46ca-8cb5-a64bece7ee65 service nova] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-34ac34cc-e603-437a-bf05-8de8b2904559 req-733a6bbb-0914-46ca-8cb5-a64bece7ee65 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] No waiting events found dispatching network-vif-plugged-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:31 user nova-compute[75672]: WARNING nova.compute.manager [req-34ac34cc-e603-437a-bf05-8de8b2904559 req-733a6bbb-0914-46ca-8cb5-a64bece7ee65 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Received unexpected event network-vif-plugged-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f for instance with vm_state active and task_state None.
Nov 30 12:32:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received event network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Acquiring lock "62555959-6271-47e1-920c-b6333de4cca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] No waiting events found dispatching network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:33 user nova-compute[75672]: WARNING nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received unexpected event network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 for instance with vm_state active and task_state None.
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] No waiting events found dispatching network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:33 user nova-compute[75672]: WARNING nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received unexpected event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 for instance with vm_state active and task_state None.
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] No waiting events found dispatching network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:33 user nova-compute[75672]: WARNING nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received unexpected event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 for instance with vm_state active and task_state None.
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:33 user nova-compute[75672]: WARNING nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state active and task_state None.
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:33 user nova-compute[75672]: WARNING nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state active and task_state None.
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Received event network-vif-plugged-890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Acquiring lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] No waiting events found dispatching network-vif-plugged-890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:33 user nova-compute[75672]: WARNING nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Received unexpected event network-vif-plugged-890df6ae-1036-4cfd-b155-04a5c16f093c for instance with vm_state active and task_state None.
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Received event network-vif-plugged-890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Acquiring lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] No waiting events found dispatching network-vif-plugged-890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:33 user nova-compute[75672]: WARNING nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Received unexpected event network-vif-plugged-890df6ae-1036-4cfd-b155-04a5c16f093c for instance with vm_state active and task_state None.
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Received event network-vif-plugged-7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Acquiring lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] No waiting events found dispatching network-vif-plugged-7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:33 user nova-compute[75672]: WARNING nova.compute.manager [req-15596bbd-9e26-4893-885c-89de2cefd508 req-e1378e04-247d-4892-86f4-83619183c24a service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Received unexpected event network-vif-plugged-7513ca6e-ee52-47e2-a2cb-428f6013ca40 for instance with vm_state active and task_state None.
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-ca7d96b5-864c-4208-a567-a7c44ac0f956 req-7332130b-4b49-4765-877c-c572cbdabba1 service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Received event network-vif-plugged-c7416931-8e4f-4050-8639-9afe7daa7e2e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ca7d96b5-864c-4208-a567-a7c44ac0f956 req-7332130b-4b49-4765-877c-c572cbdabba1 service nova] Acquiring lock "e1542356-c1bb-46db-8570-94958f48ab83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ca7d96b5-864c-4208-a567-a7c44ac0f956 req-7332130b-4b49-4765-877c-c572cbdabba1 service nova] Lock "e1542356-c1bb-46db-8570-94958f48ab83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ca7d96b5-864c-4208-a567-a7c44ac0f956 req-7332130b-4b49-4765-877c-c572cbdabba1 service nova] Lock "e1542356-c1bb-46db-8570-94958f48ab83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-ca7d96b5-864c-4208-a567-a7c44ac0f956 req-7332130b-4b49-4765-877c-c572cbdabba1 service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] No waiting events found dispatching network-vif-plugged-c7416931-8e4f-4050-8639-9afe7daa7e2e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:33 user nova-compute[75672]: WARNING nova.compute.manager [req-ca7d96b5-864c-4208-a567-a7c44ac0f956 req-7332130b-4b49-4765-877c-c572cbdabba1 service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Received unexpected event network-vif-plugged-c7416931-8e4f-4050-8639-9afe7daa7e2e for instance with vm_state building and task_state spawning.
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-ca7d96b5-864c-4208-a567-a7c44ac0f956 req-7332130b-4b49-4765-877c-c572cbdabba1 service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Received event network-vif-plugged-c7416931-8e4f-4050-8639-9afe7daa7e2e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ca7d96b5-864c-4208-a567-a7c44ac0f956 req-7332130b-4b49-4765-877c-c572cbdabba1 service nova] Acquiring lock "e1542356-c1bb-46db-8570-94958f48ab83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ca7d96b5-864c-4208-a567-a7c44ac0f956 req-7332130b-4b49-4765-877c-c572cbdabba1 service nova] Lock "e1542356-c1bb-46db-8570-94958f48ab83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ca7d96b5-864c-4208-a567-a7c44ac0f956 req-7332130b-4b49-4765-877c-c572cbdabba1 service nova] Lock "e1542356-c1bb-46db-8570-94958f48ab83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-ca7d96b5-864c-4208-a567-a7c44ac0f956 req-7332130b-4b49-4765-877c-c572cbdabba1 service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] No waiting events found dispatching network-vif-plugged-c7416931-8e4f-4050-8639-9afe7daa7e2e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:33 user nova-compute[75672]: WARNING nova.compute.manager [req-ca7d96b5-864c-4208-a567-a7c44ac0f956 req-7332130b-4b49-4765-877c-c572cbdabba1 service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Received unexpected event network-vif-plugged-c7416931-8e4f-4050-8639-9afe7daa7e2e for instance with vm_state building and task_state spawning.
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:34 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Instance spawned successfully.
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:34 user nova-compute[75672]: INFO nova.compute.manager [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Took 9.45 seconds to spawn the instance on the hypervisor.
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:34 user nova-compute[75672]: INFO nova.compute.manager [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Took 10.87 seconds to build instance.
Nov 30 12:32:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aba0b7fa-ccaf-45ff-9937-a90869aa02a1 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.059s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:32:34 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Instance spawned successfully.
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:34 user nova-compute[75672]: INFO nova.compute.manager [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Took 7.45 seconds to spawn the instance on the hypervisor.
Nov 30 12:32:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:35 user nova-compute[75672]: INFO nova.compute.manager [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Took 8.73 seconds to build instance.
Nov 30 12:32:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d79fbf9c-e5d6-4451-b8d5-0529365f7bb1 tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "e1542356-c1bb-46db-8570-94958f48ab83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.860s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:35 user nova-compute[75672]: DEBUG nova.compute.manager [req-8a02339c-7c9e-4ffc-bef4-33e266a974b9 req-22aae3b8-5ba0-47a4-8b5b-aa708fb29747 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Received event network-vif-plugged-7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8a02339c-7c9e-4ffc-bef4-33e266a974b9 req-22aae3b8-5ba0-47a4-8b5b-aa708fb29747 service nova] Acquiring lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8a02339c-7c9e-4ffc-bef4-33e266a974b9 req-22aae3b8-5ba0-47a4-8b5b-aa708fb29747 service nova] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8a02339c-7c9e-4ffc-bef4-33e266a974b9 req-22aae3b8-5ba0-47a4-8b5b-aa708fb29747 service nova] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:35 user nova-compute[75672]: DEBUG nova.compute.manager [req-8a02339c-7c9e-4ffc-bef4-33e266a974b9 req-22aae3b8-5ba0-47a4-8b5b-aa708fb29747 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] No waiting events found dispatching network-vif-plugged-7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:35 user nova-compute[75672]: WARNING nova.compute.manager [req-8a02339c-7c9e-4ffc-bef4-33e266a974b9 req-22aae3b8-5ba0-47a4-8b5b-aa708fb29747 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Received unexpected event network-vif-plugged-7513ca6e-ee52-47e2-a2cb-428f6013ca40 for instance with vm_state active and task_state None.
Nov 30 12:32:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:38 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:32:38 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7591MB free_disk=25.574146270751953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 1fba8af1-8074-4ce8-be23-912e9850fc41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 85f7c21c-b973-422f-a10c-8fb3635879f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 84f3ca7c-05db-4714-a685-3598bc6134d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 22619e89-6f9e-402b-9a73-2af94c1e59a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance e1542356-c1bb-46db-8570-94958f48ab83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing inventories for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating ProviderTree inventory for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating inventory in ProviderTree for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 12:32:38 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing aggregate associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, aggregates: None {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 12:32:39 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing trait associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 12:32:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-3be9593f-8cb2-4387-81c3-8ee76fe350c8 req-52e5a824-62b1-401a-a3e6-f951b79053de service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Received event network-vif-plugged-f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3be9593f-8cb2-4387-81c3-8ee76fe350c8 req-52e5a824-62b1-401a-a3e6-f951b79053de service nova] Acquiring lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3be9593f-8cb2-4387-81c3-8ee76fe350c8 req-52e5a824-62b1-401a-a3e6-f951b79053de service nova] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3be9593f-8cb2-4387-81c3-8ee76fe350c8 req-52e5a824-62b1-401a-a3e6-f951b79053de service nova] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-3be9593f-8cb2-4387-81c3-8ee76fe350c8 req-52e5a824-62b1-401a-a3e6-f951b79053de service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] No waiting events found dispatching network-vif-plugged-f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:39 user nova-compute[75672]: WARNING nova.compute.manager [req-3be9593f-8cb2-4387-81c3-8ee76fe350c8 req-52e5a824-62b1-401a-a3e6-f951b79053de service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Received unexpected event network-vif-plugged-f63d8e51-e821-4448-8d86-ca8c90e5b382 for instance with vm_state active and task_state None.
Nov 30 12:32:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:39 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:32:39 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:32:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:32:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.323s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:40 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:32:40 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:32:40 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:32:40 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:32:40 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:32:40 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:32:40 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:32:41 user nova-compute[75672]: DEBUG nova.compute.manager [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Received event network-vif-plugged-f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] Acquiring lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:41 user nova-compute[75672]: DEBUG nova.compute.manager [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] No waiting events found dispatching network-vif-plugged-f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:41 user nova-compute[75672]: WARNING nova.compute.manager [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Received unexpected event network-vif-plugged-f63d8e51-e821-4448-8d86-ca8c90e5b382 for instance with vm_state active and task_state None.
Nov 30 12:32:41 user nova-compute[75672]: DEBUG nova.compute.manager [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received event network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] Acquiring lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:41 user nova-compute[75672]: DEBUG nova.compute.manager [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] No waiting events found dispatching network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:41 user nova-compute[75672]: WARNING nova.compute.manager [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received unexpected event network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 for instance with vm_state active and task_state None.
Nov 30 12:32:41 user nova-compute[75672]: DEBUG nova.compute.manager [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received event network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] Acquiring lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:41 user nova-compute[75672]: DEBUG nova.compute.manager [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] No waiting events found dispatching network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:32:41 user nova-compute[75672]: WARNING nova.compute.manager [req-589d5ed5-639e-4423-bede-8c36ba8fc00a req-48747182-76d6-42ae-b0fa-6e56e0629b9b service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received unexpected event network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 for instance with vm_state active and task_state None.
Nov 30 12:32:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:53 user nova-compute[75672]: DEBUG nova.compute.manager [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:32:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:54 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:32:54 user nova-compute[75672]: INFO nova.compute.claims [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Claim successful on node user
Nov 30 12:32:54 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:32:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:54 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:32:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:54 user nova-compute[75672]: DEBUG nova.compute.manager [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:32:54 user nova-compute[75672]: DEBUG nova.compute.manager [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:32:54 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:32:54 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:32:54 user nova-compute[75672]: DEBUG nova.compute.manager [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:32:54 user nova-compute[75672]: INFO nova.virt.block_device [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Booting with volume 49f97df5-26e7-4dc8-a5cc-38c192302b63 at /dev/vda
Nov 30 12:32:54 user nova-compute[75672]: DEBUG nova.policy [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7ab9a7339334ee39a17b7911e2ebfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec663862ec640dcaba59b031512fe30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:32:54 user nova-compute[75672]: DEBUG os_brick.utils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:32:54 user nova-compute[75672]: INFO oslo.privsep.daemon [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpueux9kvi/privsep.sock']
Nov 30 12:32:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:55 user sudo[86957]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpueux9kvi/privsep.sock
Nov 30 12:32:55 user sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 12:32:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:32:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:32:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:32:55 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:32:55 user nova-compute[75672]: INFO nova.compute.claims [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Claim successful on node user
Nov 30 12:32:55 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Successfully created port: 2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:55 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:32:55 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:32:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:32:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:32:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:32:55 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:32:55 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:32:56 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:32:56 user nova-compute[75672]: INFO nova.virt.block_device [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Booting with volume 02ff4f1f-381a-463d-ae72-ecf5c174fd71 at /dev/vda
Nov 30 12:32:56 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Successfully created port: c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:56 user nova-compute[75672]: DEBUG nova.policy [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c8bc724a68b48eca9f210b9c875ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eff920517bb4adc87f684e992617e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:32:56 user nova-compute[75672]: DEBUG os_brick.utils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:32:56 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Successfully created port: 195140fe-5a34-44cd-a93f-cbcc015f67d0 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:56 user sudo[86957]: pam_unix(sudo:session): session closed for user root
Nov 30 12:32:56 user nova-compute[75672]: INFO oslo.privsep.daemon [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Spawned new privsep daemon via rootwrap
Nov 30 12:32:56 user nova-compute[75672]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 12:32:56 user nova-compute[75672]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 12:32:56 user nova-compute[75672]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 30 12:32:56 user nova-compute[75672]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86963
Nov 30 12:32:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac38cb3-395f-4836-944e-eb5c33dcb97e]: (2,) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:32:56 user nova-compute[75672]: WARNING oslo_privsep.priv_context [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] privsep daemon already running
Nov 30 12:32:57 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Successfully created port: 026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[440b1b2c-e7a8-4c99-aa9e-b1bc95d91d3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:32:57 user nova-compute[75672]: WARNING os_brick.initiator.connectors.nvmeof [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d1609b-3fde-45af-9433-b4b1d8bf2bdd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[887a7975-604a-4825-83d1-6005083d78e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3d243b-202e-4aba-a332-f149bd6a9f20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[770d0ef4-265e-44fb-9b5b-54e8a441943e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[772e0e18-0e8d-425a-9b43-06ca6a35697b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0571959-7ce9-4fc7-9e42-a8c3322b841a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d750d2ad-7d76-4dd1-8491-6e333fa8734a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:32:57 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba9d0bd-d8e7-4632-9169-2b9d22b3f8b1]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG os_brick.utils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] <== get_connector_properties: return (1149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating existing volume attachment record: 779bb20b-c64a-404c-b469-90b690207bb6 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:32:57 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:32:57 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e929305-2ab8-4b56-bdcd-f8ae02002a99]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG os_brick.utils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] <== get_connector_properties: return (2369ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating existing volume attachment record: 7ed0fdb1-9875-4da0-b1b1-8789b5c04a06 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Successfully created port: d9177927-6e30-497f-9080-78798e05686c {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:57 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Successfully created port: 7df92582-df3e-4666-8afc-0fa41fa10d27 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:58 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Successfully created port: 288fbe5b-c2d5-434b-9ce1-82364edc246f {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:58 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Successfully created port: 2f0976de-f44c-4de2-9eb1-4a9f98c16672 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:58 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Successfully updated port: 2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:32:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-e9057324-c71d-4aa4-83fa-99c1bbffa8b7 req-77e5ae30-21a1-4079-b80c-d0be1350e3aa service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-changed-2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:32:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-e9057324-c71d-4aa4-83fa-99c1bbffa8b7 req-77e5ae30-21a1-4079-b80c-d0be1350e3aa service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing instance network info cache due to event network-changed-2304dd64-2456-475f-bc90-16143352b18a. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:32:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e9057324-c71d-4aa4-83fa-99c1bbffa8b7 req-77e5ae30-21a1-4079-b80c-d0be1350e3aa service nova] Acquiring lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:32:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e9057324-c71d-4aa4-83fa-99c1bbffa8b7 req-77e5ae30-21a1-4079-b80c-d0be1350e3aa service nova] Acquired lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:32:58 user nova-compute[75672]: DEBUG nova.network.neutron [req-e9057324-c71d-4aa4-83fa-99c1bbffa8b7 req-77e5ae30-21a1-4079-b80c-d0be1350e3aa service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing network info cache for port 2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:32:58 user nova-compute[75672]: DEBUG nova.network.neutron [req-e9057324-c71d-4aa4-83fa-99c1bbffa8b7 req-77e5ae30-21a1-4079-b80c-d0be1350e3aa service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:32:58 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Successfully created port: 441e94f2-f857-4b09-886a-b958df41483a {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:59 user nova-compute[75672]: DEBUG nova.network.neutron [req-e9057324-c71d-4aa4-83fa-99c1bbffa8b7 req-77e5ae30-21a1-4079-b80c-d0be1350e3aa service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:32:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e9057324-c71d-4aa4-83fa-99c1bbffa8b7 req-77e5ae30-21a1-4079-b80c-d0be1350e3aa service nova] Releasing lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:32:59 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Successfully created port: 52cf6915-a26b-4126-9f42-6741a35e66c9 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:32:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:32:59 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Successfully updated port: 9f5fce50-73ed-465d-bf21-f3902157d044 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Successfully updated port: 927378ac-2059-4e53-a96b-ab629c814942 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Successfully updated port: 026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-adceb491-759f-4290-a6f8-cbdfb990047e req-b1e83ed9-89f2-492a-9a3a-13d3d31a2bf4 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-changed-026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-adceb491-759f-4290-a6f8-cbdfb990047e req-b1e83ed9-89f2-492a-9a3a-13d3d31a2bf4 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing instance network info cache due to event network-changed-026ddb45-5a8b-4434-906c-7350c6e6f878. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-adceb491-759f-4290-a6f8-cbdfb990047e req-b1e83ed9-89f2-492a-9a3a-13d3d31a2bf4 service nova] Acquiring lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-adceb491-759f-4290-a6f8-cbdfb990047e req-b1e83ed9-89f2-492a-9a3a-13d3d31a2bf4 service nova] Acquired lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG nova.network.neutron [req-adceb491-759f-4290-a6f8-cbdfb990047e req-b1e83ed9-89f2-492a-9a3a-13d3d31a2bf4 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing network info cache for port 026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG nova.network.neutron [req-adceb491-759f-4290-a6f8-cbdfb990047e req-b1e83ed9-89f2-492a-9a3a-13d3d31a2bf4 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-changed-9f5fce50-73ed-465d-bf21-f3902157d044 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing instance network info cache due to event network-changed-9f5fce50-73ed-465d-bf21-f3902157d044. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] Acquiring lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] Acquired lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG nova.network.neutron [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing network info cache for port 9f5fce50-73ed-465d-bf21-f3902157d044 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG nova.network.neutron [req-adceb491-759f-4290-a6f8-cbdfb990047e req-b1e83ed9-89f2-492a-9a3a-13d3d31a2bf4 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-adceb491-759f-4290-a6f8-cbdfb990047e req-b1e83ed9-89f2-492a-9a3a-13d3d31a2bf4 service nova] Releasing lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:01 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Successfully updated port: f50a4265-e775-4197-a5ec-5980f4cd0485 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:33:01 user nova-compute[75672]: DEBUG nova.network.neutron [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:33:01 user nova-compute[75672]: DEBUG nova.network.neutron [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] Releasing lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:01 user nova-compute[75672]: DEBUG nova.compute.manager [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-changed-927378ac-2059-4e53-a96b-ab629c814942 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:01 user nova-compute[75672]: DEBUG nova.compute.manager [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing instance network info cache due to event network-changed-927378ac-2059-4e53-a96b-ab629c814942. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] Acquiring lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] Acquired lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:01 user nova-compute[75672]: DEBUG nova.network.neutron [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing network info cache for port 927378ac-2059-4e53-a96b-ab629c814942 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:01 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Successfully updated port: c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:33:01 user nova-compute[75672]: DEBUG nova.network.neutron [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:33:01 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Successfully updated port: bffe61b1-46cc-476d-b96e-c4cb5b81fb63 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:33:01 user nova-compute[75672]: DEBUG nova.network.neutron [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7483e69a-eece-4dfa-b48a-b1d4ae77f3f6 req-0d53f01b-518b-42e0-982d-fb3711111279 service nova] Releasing lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:02 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Successfully updated port: 7df92582-df3e-4666-8afc-0fa41fa10d27 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:33:02 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Successfully updated port: 195140fe-5a34-44cd-a93f-cbcc015f67d0 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:33:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-changed-f50a4265-e775-4197-a5ec-5980f4cd0485 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing instance network info cache due to event network-changed-f50a4265-e775-4197-a5ec-5980f4cd0485. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] Acquiring lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] Acquired lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:02 user nova-compute[75672]: DEBUG nova.network.neutron [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing network info cache for port f50a4265-e775-4197-a5ec-5980f4cd0485 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:02 user nova-compute[75672]: DEBUG nova.network.neutron [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:33:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-changed-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing instance network info cache due to event network-changed-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] Acquiring lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] Acquired lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:02 user nova-compute[75672]: DEBUG nova.network.neutron [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing network info cache for port c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Successfully updated port: 2f0976de-f44c-4de2-9eb1-4a9f98c16672 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] Releasing lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.compute.manager [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-changed-bffe61b1-46cc-476d-b96e-c4cb5b81fb63 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.compute.manager [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing instance network info cache due to event network-changed-bffe61b1-46cc-476d-b96e-c4cb5b81fb63. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] Acquiring lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] Acquired lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing network info cache for port bffe61b1-46cc-476d-b96e-c4cb5b81fb63 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] Releasing lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-changed-195140fe-5a34-44cd-a93f-cbcc015f67d0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing instance network info cache due to event network-changed-195140fe-5a34-44cd-a93f-cbcc015f67d0. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] Acquiring lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] Acquired lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing network info cache for port 195140fe-5a34-44cd-a93f-cbcc015f67d0 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] Releasing lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.compute.manager [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-changed-7df92582-df3e-4666-8afc-0fa41fa10d27 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.compute.manager [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing instance network info cache due to event network-changed-7df92582-df3e-4666-8afc-0fa41fa10d27. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] Acquiring lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] Acquired lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing network info cache for port 7df92582-df3e-4666-8afc-0fa41fa10d27 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8ea5a56-7984-4582-a6fd-91eadc42b0f8 req-52a070f5-2da4-47bb-8f16-edc376dd9cbe service nova] Releasing lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Successfully updated port: d9177927-6e30-497f-9080-78798e05686c {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2a0446c6-8b3e-4586-b693-096699eb1399 req-43f55861-3be7-41a6-8a28-b64f66160b2b service nova] Releasing lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:04 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Successfully updated port: 441e94f2-f857-4b09-886a-b958df41483a {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:33:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-3227c300-0a43-48c5-8078-4aec3e3ec703 req-13c9de4f-eecb-4bcf-9643-619bfcbc2eb3 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-changed-2f0976de-f44c-4de2-9eb1-4a9f98c16672 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-3227c300-0a43-48c5-8078-4aec3e3ec703 req-13c9de4f-eecb-4bcf-9643-619bfcbc2eb3 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing instance network info cache due to event network-changed-2f0976de-f44c-4de2-9eb1-4a9f98c16672. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3227c300-0a43-48c5-8078-4aec3e3ec703 req-13c9de4f-eecb-4bcf-9643-619bfcbc2eb3 service nova] Acquiring lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3227c300-0a43-48c5-8078-4aec3e3ec703 req-13c9de4f-eecb-4bcf-9643-619bfcbc2eb3 service nova] Acquired lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:04 user nova-compute[75672]: DEBUG nova.network.neutron [req-3227c300-0a43-48c5-8078-4aec3e3ec703 req-13c9de4f-eecb-4bcf-9643-619bfcbc2eb3 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing network info cache for port 2f0976de-f44c-4de2-9eb1-4a9f98c16672 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:04 user nova-compute[75672]: DEBUG nova.network.neutron [req-3227c300-0a43-48c5-8078-4aec3e3ec703 req-13c9de4f-eecb-4bcf-9643-619bfcbc2eb3 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:33:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-changed-d9177927-6e30-497f-9080-78798e05686c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing instance network info cache due to event network-changed-d9177927-6e30-497f-9080-78798e05686c. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] Acquiring lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] Acquired lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:04 user nova-compute[75672]: DEBUG nova.network.neutron [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing network info cache for port d9177927-6e30-497f-9080-78798e05686c {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG nova.network.neutron [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG nova.network.neutron [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] Releasing lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-changed-441e94f2-f857-4b09-886a-b958df41483a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing instance network info cache due to event network-changed-441e94f2-f857-4b09-886a-b958df41483a. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] Acquiring lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG nova.network.neutron [req-3227c300-0a43-48c5-8078-4aec3e3ec703 req-13c9de4f-eecb-4bcf-9643-619bfcbc2eb3 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3227c300-0a43-48c5-8078-4aec3e3ec703 req-13c9de4f-eecb-4bcf-9643-619bfcbc2eb3 service nova] Releasing lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] Acquired lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG nova.network.neutron [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing network info cache for port 441e94f2-f857-4b09-886a-b958df41483a {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG nova.network.neutron [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Successfully updated port: 288fbe5b-c2d5-434b-9ce1-82364edc246f {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquired lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG nova.network.neutron [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-672fa682-e7ea-4b0b-bb64-dc3bad42d5dd req-d7567efd-a846-4e0a-ad50-e9fbb8f407fc service nova] Releasing lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Successfully updated port: 52cf6915-a26b-4126-9f42-6741a35e66c9 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquired lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:33:06 user nova-compute[75672]: INFO nova.virt.block_device [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Booting with volume 85a3c4e6-bb1e-4241-9004-509bbd493e5c at /dev/vdb
Nov 30 12:33:06 user nova-compute[75672]: DEBUG os_brick.utils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[862f2509-ad4e-48f9-9081-d9cbcccf0927]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e5844d-f877-4455-a574-bb1b38058a83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63fa366-0d63-438c-b580-b4c874a89b76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a74f573-698b-4752-bc8a-01f2acd4af40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:06 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:33:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[781643c6-3b14-445b-bbfb-4454d0d967f9]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG os_brick.utils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:06 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating existing volume attachment record: 5fceca3b-d96d-40b3-afd0-7584995a482f {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:33:07 user nova-compute[75672]: INFO nova.virt.block_device [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Booting with volume 31189b16-d950-46e3-ab69-6729febf2c1b at /dev/vdb
Nov 30 12:33:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-changed-288fbe5b-c2d5-434b-9ce1-82364edc246f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing instance network info cache due to event network-changed-288fbe5b-c2d5-434b-9ce1-82364edc246f. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] Acquiring lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG os_brick.utils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cde3f8d-9bf7-4b3e-b1f2-ff3376d829d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91e3881-5344-41d4-acea-039ceb8ef324]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b761a727-2ba0-4e3e-8f4c-d16926f9c772]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[712757de-df89-487e-9c98-854b5273fa08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:07 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:33:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30501a6-aa75-497d-b5d4-fa1a552ad2d9]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG os_brick.utils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:07 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating existing volume attachment record: 2211e153-8999-47e8-95dd-389db2585650 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:33:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating instance_info_cache with network_info: [{"id": "2304dd64-2456-475f-bc90-16143352b18a", "address": "fa:16:3e:6c:fe:34", "network": {"id": "82ff3f53-fea3-4dd1-9e10-f56b442ef619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-814518059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2304dd64-24", "ovs_interfaceid": "2304dd64-2456-475f-bc90-16143352b18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "address": "fa:16:3e:26:f7:c2", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4ff97-44", "ovs_interfaceid": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "address": "fa:16:3e:96:81:8b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195140fe-5a", "ovs_interfaceid": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9177927-6e30-497f-9080-78798e05686c", "address": "fa:16:3e:a4:a7:f2", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9177927-6e", "ovs_interfaceid": "d9177927-6e30-497f-9080-78798e05686c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Releasing lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:08 user nova-compute[75672]: DEBUG nova.compute.manager [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Instance network_info: |[{"id": "2304dd64-2456-475f-bc90-16143352b18a", "address": "fa:16:3e:6c:fe:34", "network": {"id": "82ff3f53-fea3-4dd1-9e10-f56b442ef619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-814518059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2304dd64-24", "ovs_interfaceid": "2304dd64-2456-475f-bc90-16143352b18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "address": "fa:16:3e:26:f7:c2", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4ff97-44", "ovs_interfaceid": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "address": "fa:16:3e:96:81:8b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195140fe-5a", "ovs_interfaceid": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9177927-6e30-497f-9080-78798e05686c", "address": "fa:16:3e:a4:a7:f2", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9177927-6e", "ovs_interfaceid": "d9177927-6e30-497f-9080-78798e05686c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:33:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] Acquired lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:08 user nova-compute[75672]: DEBUG nova.network.neutron [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing network info cache for port 288fbe5b-c2d5-434b-9ce1-82364edc246f {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updated VIF entry in instance network info cache for port 288fbe5b-c2d5-434b-9ce1-82364edc246f. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:33:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating instance_info_cache with network_info: [{"id": "2304dd64-2456-475f-bc90-16143352b18a", "address": "fa:16:3e:6c:fe:34", "network": {"id": "82ff3f53-fea3-4dd1-9e10-f56b442ef619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-814518059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2304dd64-24", "ovs_interfaceid": "2304dd64-2456-475f-bc90-16143352b18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "address": "fa:16:3e:26:f7:c2", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4ff97-44", "ovs_interfaceid": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "address": "fa:16:3e:96:81:8b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195140fe-5a", "ovs_interfaceid": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9177927-6e30-497f-9080-78798e05686c", "address": "fa:16:3e:a4:a7:f2", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9177927-6e", "ovs_interfaceid": "d9177927-6e30-497f-9080-78798e05686c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] Releasing lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-changed-52cf6915-a26b-4126-9f42-6741a35e66c9 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing instance network info cache due to event network-changed-52cf6915-a26b-4126-9f42-6741a35e66c9. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] Acquiring lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:09 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [{"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7df92582-df3e-4666-8afc-0fa41fa10d27", "address": "fa:16:3e:c0:57:d2", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df92582-df", "ovs_interfaceid": "7df92582-df3e-4666-8afc-0fa41fa10d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "address": "fa:16:3e:6a:c7:b1", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0976de-f4", "ovs_interfaceid": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "441e94f2-f857-4b09-886a-b958df41483a", "address": "fa:16:3e:00:9b:13", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441e94f2-f8", "ovs_interfaceid": "441e94f2-f857-4b09-886a-b958df41483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52cf6915-a26b-4126-9f42-6741a35e66c9", "address": "fa:16:3e:1f:66:ac", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52cf6915-a2", "ovs_interfaceid": "52cf6915-a26b-4126-9f42-6741a35e66c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Releasing lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Instance network_info: |[{"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7df92582-df3e-4666-8afc-0fa41fa10d27", "address": "fa:16:3e:c0:57:d2", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df92582-df", "ovs_interfaceid": "7df92582-df3e-4666-8afc-0fa41fa10d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "address": "fa:16:3e:6a:c7:b1", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0976de-f4", "ovs_interfaceid": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "441e94f2-f857-4b09-886a-b958df41483a", "address": "fa:16:3e:00:9b:13", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441e94f2-f8", "ovs_interfaceid": "441e94f2-f857-4b09-886a-b958df41483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52cf6915-a26b-4126-9f42-6741a35e66c9", "address": "fa:16:3e:1f:66:ac", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52cf6915-a2", "ovs_interfaceid": "52cf6915-a26b-4126-9f42-6741a35e66c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:33:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] Acquired lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing network info cache for port 52cf6915-a26b-4126-9f42-6741a35e66c9 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:10 user nova-compute[75672]: DEBUG nova.network.neutron [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updated VIF entry in instance network info cache for port 52cf6915-a26b-4126-9f42-6741a35e66c9. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:33:10 user nova-compute[75672]: DEBUG nova.network.neutron [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [{"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7df92582-df3e-4666-8afc-0fa41fa10d27", "address": "fa:16:3e:c0:57:d2", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df92582-df", "ovs_interfaceid": "7df92582-df3e-4666-8afc-0fa41fa10d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "address": "fa:16:3e:6a:c7:b1", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0976de-f4", "ovs_interfaceid": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "441e94f2-f857-4b09-886a-b958df41483a", "address": "fa:16:3e:00:9b:13", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441e94f2-f8", "ovs_interfaceid": "441e94f2-f857-4b09-886a-b958df41483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52cf6915-a26b-4126-9f42-6741a35e66c9", "address": "fa:16:3e:1f:66:ac", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52cf6915-a2", "ovs_interfaceid": "52cf6915-a26b-4126-9f42-6741a35e66c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3d9bd02b-b156-4b6c-93b2-e1f6e876cc12 req-b41774e6-49ba-4bf5-9dc1-4cd622d2075c service nova] Releasing lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:16 user nova-compute[75672]: INFO nova.virt.block_device [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Booting with volume 417630b1-4b40-4ed4-acef-5309c9f42629 at /dev/vdc
Nov 30 12:33:16 user nova-compute[75672]: DEBUG os_brick.utils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b791bfb3-5a22-42b5-9140-13880c636934]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f055874f-b5a3-4623-9dd6-a3ff483e7dcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef80c2e-e185-4a6f-9f3b-82cffbfcb7f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eb7084-ece2-4520-b277-e1bec4b20554]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:16 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fb996a-4703-4ae3-9503-4c9f83a67d91]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG os_brick.utils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating existing volume attachment record: 806b1f3a-9f94-4489-84a6-103321462a53 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:33:16 user nova-compute[75672]: INFO nova.virt.block_device [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Booting with volume 00529119-c8a8-4898-ac85-9c3f7e99da7f at /dev/vdc
Nov 30 12:33:16 user nova-compute[75672]: DEBUG os_brick.utils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f65a20-1b12-45cb-9ace-622d65dd008f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2054883b-0bb5-47b7-af5f-06868d604ff9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aab5c54-031e-4341-8ab6-b106bc1d9d56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[474dc03d-9150-44c3-9c48-851f356fd866]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:16 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:33:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[370a3fe5-fb42-44ea-890b-96a9709688d0]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG os_brick.utils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:16 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating existing volume attachment record: 9dd494de-fcb8-49b0-b4c3-8b4e23b65219 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:33:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:33:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:33:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:33:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:33:25 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Creating image(s)
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Ensure instance console log exists: /opt/stack/data/nova/instances/d8328382-e998-44b8-9c34-a1dbf74746e7/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Start _get_guest_xml network_info=[{"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7df92582-df3e-4666-8afc-0fa41fa10d27", "address": "fa:16:3e:c0:57:d2", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df92582-df", "ovs_interfaceid": "7df92582-df3e-4666-8afc-0fa41fa10d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "address": "fa:16:3e:6a:c7:b1", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0976de-f4", "ovs_interfaceid": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "441e94f2-f857-4b09-886a-b958df41483a", "address": "fa:16:3e:00:9b:13", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441e94f2-f8", "ovs_interfaceid": "441e94f2-f857-4b09-886a-b958df41483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52cf6915-a26b-4126-9f42-6741a35e66c9", "address": "fa:16:3e:1f:66:ac", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52cf6915-a2", "ovs_interfaceid": "52cf6915-a26b-4126-9f42-6741a35e66c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '779bb20b-c64a-404c-b469-90b690207bb6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MieHjUNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8328382-e998-44b8-9c34-a1dbf74746e7', 'attached_at': '', 'detached_at': '', 'volume_id': '02ff4f1f-381a-463d-ae72-ecf5c174fd71', 'serial': '02ff4f1f-381a-463d-ae72-ecf5c174fd71'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '5fceca3b-d96d-40b3-afd0-7584995a482f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aqHFfgWO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8328382-e998-44b8-9c34-a1dbf74746e7', 'attached_at': '', 'detached_at': '', 'volume_id': '85a3c4e6-bb1e-4241-9004-509bbd493e5c', 'serial': '85a3c4e6-bb1e-4241-9004-509bbd493e5c'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '806b1f3a-9f94-4489-84a6-103321462a53', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qekKBwMd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8328382-e998-44b8-9c34-a1dbf74746e7', 'attached_at': '', 'detached_at': '', 'volume_id': '417630b1-4b40-4ed4-acef-5309c9f42629', 'serial': '417630b1-4b40-4ed4-acef-5309c9f42629'}, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:33:25 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:33:25 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG os_brick.initiator.connector [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Factory for ISCSI on None {{(pid=75672) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MieHjUNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:25 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:25 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:25 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb5d062-b82f-409a-9e64-42f21707e3e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:33:25 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d868e38-f470-4795-b544-30ad3eb79388]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71] added
Nov 30 12:33:25 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5180e0d-d4dd-4cb3-b511-32b7be21b48a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcb5f57-dee8-4cbb-8009-c74283368704]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MieHjUNw {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MieHjUNw" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11e29e2-54bb-4f5c-9326-7ecfaf754c9d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MieHjUNw'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[762f4308-484f-4892-bc13-b2433c6e3eec]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd3a9ca-df09-4214-a7dd-18cec42e08ed]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 12:33:26 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 12:33:26 user nova-compute[75672]:  {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:26 user nova-compute[75672]: WARNING os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 12:33:26 user nova-compute[75672]: 
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a111cc9-5b91-430d-96da-5b99015bf289]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71, portal: 172.16.0.220,3260]
Nov 30 12:33:26 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71, portal: 172.16.0.220,3260] successful.
Nov 30 12:33:26 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dab628f-e1c4-4933-b145-a9caae9e09a0]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45b0702-42a7-4921-9825-a9743d7a4817]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:26 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:26 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb4f7af-8cb1-4b68-99f3-db3bbf3c0825]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:33:26 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Creating image(s)
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Ensure instance console log exists: /opt/stack/data/nova/instances/35ef80cd-d7d8-421b-8296-44b107b1bce4/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Start _get_guest_xml network_info=[{"id": "2304dd64-2456-475f-bc90-16143352b18a", "address": "fa:16:3e:6c:fe:34", "network": {"id": "82ff3f53-fea3-4dd1-9e10-f56b442ef619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-814518059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2304dd64-24", "ovs_interfaceid": "2304dd64-2456-475f-bc90-16143352b18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "address": "fa:16:3e:26:f7:c2", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4ff97-44", "ovs_interfaceid": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "address": "fa:16:3e:96:81:8b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195140fe-5a", "ovs_interfaceid": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9177927-6e30-497f-9080-78798e05686c", "address": "fa:16:3e:a4:a7:f2", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9177927-6e", "ovs_interfaceid": "d9177927-6e30-497f-9080-78798e05686c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '7ed0fdb1-9875-4da0-b1b1-8789b5c04a06', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iYMOquIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '35ef80cd-d7d8-421b-8296-44b107b1bce4', 'attached_at': '', 'detached_at': '', 'volume_id': '49f97df5-26e7-4dc8-a5cc-38c192302b63', 'serial': '49f97df5-26e7-4dc8-a5cc-38c192302b63'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '2211e153-8999-47e8-95dd-389db2585650', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eXPrnTvw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '35ef80cd-d7d8-421b-8296-44b107b1bce4', 'attached_at': '', 'detached_at': '', 'volume_id': '31189b16-d950-46e3-ab69-6729febf2c1b', 'serial': '31189b16-d950-46e3-ab69-6729febf2c1b'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '9dd494de-fcb8-49b0-b4c3-8b4e23b65219', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVNLUSPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '35ef80cd-d7d8-421b-8296-44b107b1bce4', 'attached_at': '', 'detached_at': '', 'volume_id': '00529119-c8a8-4898-ac85-9c3f7e99da7f', 'serial': '00529119-c8a8-4898-ac85-9c3f7e99da7f'}, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:33:26 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:33:26 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:33:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iYMOquIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:26 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MieHjUNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23437656265343336', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437656265343336', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.422s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:27 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:27 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1825f18c-fd26-4cec-afc7-c51f23f1e35d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:33:27 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aqHFfgWO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:27 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[17465825-7c4e-4e25-b35c-1fd91ba50a5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63] added
Nov 30 12:33:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b7fd64-b966-417e-ac17-4609cefe27e5]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4150de7-9abb-47e2-92db-b64471b6b6e9]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iYMOquIU {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iYMOquIU" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b24507-38ab-4819-af4a-83a4552448b9]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iYMOquIU'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce45f700-22d7-4f74-8696-6864bd6bafbc]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea494a7-306b-4acf-9463-856dfcd94094]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4c3e78-2f1d-4afc-80a5-e754be22bae3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63, portal: 172.16.0.220,3260]
Nov 30 12:33:27 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63, portal: 172.16.0.220,3260] successful.
Nov 30 12:33:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfe05e5-2cbd-4248-a946-89306bb52d99]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fae925-697a-4b4c-9bba-3b247b7d7797]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:27 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:27 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61192a0-0237-400d-bab1-e91555d9dcce]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iYMOquIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Updating instance_info_cache with network_info: [{"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] <== connect_volume: return (1731ms) {'type': 'block', 'scsi_wwn': '23662363266346164', 'path': '/dev/sdc'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662363266346164', 'path': '/dev/sdc'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.284s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:28 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:28 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c404e859-f9f7-4a84-a2bb-8684465ce034]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:33:28 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eXPrnTvw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:28 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b05f663-1240-4f5b-bf95-d6332945ba4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c] added
Nov 30 12:33:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba173ece-2175-4566-b14f-0e06b10acbc6]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[052b5132-447c-4cba-8564-9c9cccbe8c1d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aqHFfgWO {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aqHFfgWO" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a25e19c-d2b5-4c4d-bcb5-99ebb6b2b52d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aqHFfgWO'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af26d26-0307-4965-95c3-3e8a99a344e0]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fcf943-41f3-4a70-bf3a-da64e2f43d6a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:28 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:28 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a312e707-9a14-432d-958a-c49596c0fde4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c, portal: 172.16.0.220,3260]
Nov 30 12:33:28 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c, portal: 172.16.0.220,3260] successful.
Nov 30 12:33:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded280ac-4979-43f7-a84f-785bb48ba421]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c2702c-ddfe-4aa2-b6d6-ba013cd9a4cc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:28 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:28 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:28 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:28 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5c469f-6d38-474d-8afb-c6bae7937ae9]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:33:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aqHFfgWO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] <== connect_volume: return (2595ms) {'type': 'block', 'scsi_wwn': '26166393064353832', 'path': '/dev/sdd'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166393064353832', 'path': '/dev/sdd'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.286s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:29 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:29 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e53ec82-5a34-430a-b747-6fdbe9b5cff6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:33:29 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qekKBwMd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:29 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[191bf730-3ad4-432a-939f-3859ea8a58cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b] added
Nov 30 12:33:29 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd389b78-f46d-4eb6-94d3-e3c9b0816741]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[694c88a1-7ba1-4bf2-8b55-b1bc389589ac]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eXPrnTvw {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eXPrnTvw" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dec105-0fa7-48d8-8b58-8cce7a8497bc]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eXPrnTvw'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1180bc39-3967-4ff4-b496-f52847c0546c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f89aa8b-70e6-497e-be84-d777c1e7ca81]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:29 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:29 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:29 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:29 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:29 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:29 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[975919a1-a64c-4765-9862-5e4fe2bfcea2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b, portal: 172.16.0.220,3260]
Nov 30 12:33:30 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b, portal: 172.16.0.220,3260] successful.
Nov 30 12:33:30 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab24d01-53f6-4142-8214-bc10b658c011]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f843a481-0a7c-45e7-aff5-7da77b570648]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:30 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:30 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:30 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:30 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:30 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:30 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:30 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:30 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c855d702-29ff-4ee4-b20a-a4fc69408f7c]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eXPrnTvw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] <== connect_volume: return (2611ms) {'type': 'block', 'scsi_wwn': '26230343664376134', 'path': '/dev/sde'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230343664376134', 'path': '/dev/sde'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.294s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:31 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:31 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[371697ce-97ff-443d-a196-080e539f82ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:33:31 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVNLUSPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:31 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0071c226-c914-4302-ad33-89ae7d547267]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629] added
Nov 30 12:33:31 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[44652327-0c35-4168-b745-a7732f6826e3]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[03167b33-127e-420f-b178-d1e3853c95e0]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qekKBwMd {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qekKBwMd" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[890b5e6d-703e-4eb2-bf04-201b6d1d1a9e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qekKBwMd'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c513bcf8-288a-47cb-8b51-a247acf45f26]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2e82ef-e653-4790-8582-cb9c6ce4ba50]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:31 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:31 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:31 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:31 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:31 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:31 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:31 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:31 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cd142d-96db-4092-a403-5c3b8a2034d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629, portal: 172.16.0.220,3260]
Nov 30 12:33:31 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629, portal: 172.16.0.220,3260] successful.
Nov 30 12:33:31 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac6ddb4-b195-4af9-8d68-605e4eaba53f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[85112962-ca62-49d8-9440-1e58717ac492]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:31 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:31 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:31 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:31 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:33:31 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:31 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:31 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:31 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:31 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:33:31 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8eb825-3e5b-4c78-8da3-2ed81fbc9edc]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qekKBwMd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] <== connect_volume: return (2673ms) {'type': 'block', 'scsi_wwn': '23237393163643434', 'path': '/dev/sdf'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237393163643434', 'path': '/dev/sdf'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.346s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:32 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:32 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f3700a-54e3-4fcf-b7f5-469f4c6cf8e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:33:32 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:63:ab,bridge_name='br-int',has_traffic_filtering=True,id=026ddb45-5a8b-4434-906c-7350c6e6f878,network=Network(a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026ddb45-5a') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:de:b4,bridge_name='br-int',has_traffic_filtering=True,id=f50a4265-e775-4197-a5ec-5980f4cd0485,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf50a4265-e7') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:be:df,bridge_name='br-int',has_traffic_filtering=True,id=bffe61b1-46cc-476d-b96e-c4cb5b81fb63,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbffe61b1-46') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7df92582-df3e-4666-8afc-0fa41fa10d27", "address": "fa:16:3e:c0:57:d2", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df92582-df", "ovs_interfaceid": "7df92582-df3e-4666-8afc-0fa41fa10d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "7df92582-df3e-4666-8afc-0fa41fa10d27", "address": "fa:16:3e:c0:57:d2", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df92582-df", "ovs_interfaceid": "7df92582-df3e-4666-8afc-0fa41fa10d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:57:d2,bridge_name='br-int',has_traffic_filtering=True,id=7df92582-df3e-4666-8afc-0fa41fa10d27,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df92582-df') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "address": "fa:16:3e:6a:c7:b1", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0976de-f4", "ovs_interfaceid": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "address": "fa:16:3e:6a:c7:b1", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0976de-f4", "ovs_interfaceid": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c7:b1,bridge_name='br-int',has_traffic_filtering=True,id=2f0976de-f44c-4de2-9eb1-4a9f98c16672,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0976de-f4') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "441e94f2-f857-4b09-886a-b958df41483a", "address": "fa:16:3e:00:9b:13", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441e94f2-f8", "ovs_interfaceid": "441e94f2-f857-4b09-886a-b958df41483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "441e94f2-f857-4b09-886a-b958df41483a", "address": "fa:16:3e:00:9b:13", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441e94f2-f8", "ovs_interfaceid": "441e94f2-f857-4b09-886a-b958df41483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:9b:13,bridge_name='br-int',has_traffic_filtering=True,id=441e94f2-f857-4b09-886a-b958df41483a,network=Network(816f5a3b-528a-4f69-aa12-624766d6c89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441e94f2-f8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52cf6915-a26b-4126-9f42-6741a35e66c9", "address": "fa:16:3e:1f:66:ac", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52cf6915-a2", "ovs_interfaceid": "52cf6915-a26b-4126-9f42-6741a35e66c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "52cf6915-a26b-4126-9f42-6741a35e66c9", "address": "fa:16:3e:1f:66:ac", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52cf6915-a2", "ovs_interfaceid": "52cf6915-a26b-4126-9f42-6741a35e66c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:66:ac,bridge_name='br-int',has_traffic_filtering=True,id=52cf6915-a26b-4126-9f42-6741a35e66c9,network=Network(816f5a3b-528a-4f69-aa12-624766d6c89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52cf6915-a2') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.objects.instance [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lazy-loading 'pci_devices' on Instance uuid d8328382-e998-44b8-9c34-a1dbf74746e7 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9fc473-e72f-46db-81e9-54dae0d0582b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f] added
Nov 30 12:33:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8984df-ac18-4dcb-a5d0-3f2a7de8f7e9]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:33:32 user nova-compute[75672]:   <uuid>d8328382-e998-44b8-9c34-a1dbf74746e7</uuid>
Nov 30 12:33:32 user nova-compute[75672]:   <name>instance-0000000c</name>
Nov 30 12:33:32 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:33:32 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:33:32 user nova-compute[75672]:   <metadata>
Nov 30 12:33:32 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:33:32 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:33:32 user nova-compute[75672]:       <nova:name>tempest-device-tagging-server-1820842440</nova:name>
Nov 30 12:33:32 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:33:25</nova:creationTime>
Nov 30 12:33:32 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:33:32 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:33:32 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:33:32 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:33:32 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:33:32 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:33:32 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:33:32 user nova-compute[75672]:       <nova:owner>
Nov 30 12:33:32 user nova-compute[75672]:         <nova:user uuid="1c8bc724a68b48eca9f210b9c875ac80">tempest-TaggedBootDevicesTest-386009414-project-member</nova:user>
Nov 30 12:33:32 user nova-compute[75672]:         <nova:project uuid="5eff920517bb4adc87f684e992617e3c">tempest-TaggedBootDevicesTest-386009414</nova:project>
Nov 30 12:33:32 user nova-compute[75672]:       </nova:owner>
Nov 30 12:33:32 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:33:32 user nova-compute[75672]:       <nova:ports>
Nov 30 12:33:32 user nova-compute[75672]:         <nova:port uuid="026ddb45-5a8b-4434-906c-7350c6e6f878">
Nov 30 12:33:32 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 12:33:32 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:32 user nova-compute[75672]:         <nova:port uuid="f50a4265-e775-4197-a5ec-5980f4cd0485">
Nov 30 12:33:32 user nova-compute[75672]:           <nova:ip type="fixed" address="10.1.1.61" ipVersion="4"/>
Nov 30 12:33:32 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:32 user nova-compute[75672]:         <nova:port uuid="bffe61b1-46cc-476d-b96e-c4cb5b81fb63">
Nov 30 12:33:32 user nova-compute[75672]:           <nova:ip type="fixed" address="10.1.1.155" ipVersion="4"/>
Nov 30 12:33:32 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:32 user nova-compute[75672]:         <nova:port uuid="7df92582-df3e-4666-8afc-0fa41fa10d27">
Nov 30 12:33:32 user nova-compute[75672]:           <nova:ip type="fixed" address="10.1.1.184" ipVersion="4"/>
Nov 30 12:33:32 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:32 user nova-compute[75672]:         <nova:port uuid="2f0976de-f44c-4de2-9eb1-4a9f98c16672">
Nov 30 12:33:32 user nova-compute[75672]:           <nova:ip type="fixed" address="10.1.1.68" ipVersion="4"/>
Nov 30 12:33:32 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:32 user nova-compute[75672]:         <nova:port uuid="441e94f2-f857-4b09-886a-b958df41483a">
Nov 30 12:33:32 user nova-compute[75672]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 30 12:33:32 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:32 user nova-compute[75672]:         <nova:port uuid="52cf6915-a26b-4126-9f42-6741a35e66c9">
Nov 30 12:33:32 user nova-compute[75672]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 30 12:33:32 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:32 user nova-compute[75672]:       </nova:ports>
Nov 30 12:33:32 user nova-compute[75672]:     </nova:instance>
Nov 30 12:33:32 user nova-compute[75672]:   </metadata>
Nov 30 12:33:32 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:33:32 user nova-compute[75672]:     <system>
Nov 30 12:33:32 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:33:32 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:33:32 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:33:32 user nova-compute[75672]:       <entry name="serial">d8328382-e998-44b8-9c34-a1dbf74746e7</entry>
Nov 30 12:33:32 user nova-compute[75672]:       <entry name="uuid">d8328382-e998-44b8-9c34-a1dbf74746e7</entry>
Nov 30 12:33:32 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:33:32 user nova-compute[75672]:     </system>
Nov 30 12:33:32 user nova-compute[75672]:   </sysinfo>
Nov 30 12:33:32 user nova-compute[75672]:   <os>
Nov 30 12:33:32 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:33:32 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:33:32 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:33:32 user nova-compute[75672]:   </os>
Nov 30 12:33:32 user nova-compute[75672]:   <features>
Nov 30 12:33:32 user nova-compute[75672]:     <acpi/>
Nov 30 12:33:32 user nova-compute[75672]:     <apic/>
Nov 30 12:33:32 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:33:32 user nova-compute[75672]:   </features>
Nov 30 12:33:32 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:33:32 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:33:32 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:33:32 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:33:32 user nova-compute[75672]:   </clock>
Nov 30 12:33:32 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:33:32 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:33:32 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:33:32 user nova-compute[75672]:   </cpu>
Nov 30 12:33:32 user nova-compute[75672]:   <devices>
Nov 30 12:33:32 user nova-compute[75672]:     <disk type="file" device="cdrom">
Nov 30 12:33:32 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 12:33:32 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/d8328382-e998-44b8-9c34-a1dbf74746e7/disk.config"/>
Nov 30 12:33:32 user nova-compute[75672]:       <target dev="hda" bus="ide"/>
Nov 30 12:33:32 user nova-compute[75672]:     </disk>
Nov 30 12:33:32 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:33:32 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:33:32 user nova-compute[75672]:       <source dev="/dev/sdb"/>
Nov 30 12:33:32 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:33:32 user nova-compute[75672]:       <serial>02ff4f1f-381a-463d-ae72-ecf5c174fd71</serial>
Nov 30 12:33:32 user nova-compute[75672]:     </disk>
Nov 30 12:33:32 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:33:32 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:33:32 user nova-compute[75672]:       <source dev="/dev/sdd"/>
Nov 30 12:33:32 user nova-compute[75672]:       <target dev="vdb" bus="virtio"/>
Nov 30 12:33:32 user nova-compute[75672]:       <serial>85a3c4e6-bb1e-4241-9004-509bbd493e5c</serial>
Nov 30 12:33:32 user nova-compute[75672]:     </disk>
Nov 30 12:33:32 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:33:32 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:33:32 user nova-compute[75672]:       <source dev="/dev/sdf"/>
Nov 30 12:33:32 user nova-compute[75672]:       <target dev="vdc" bus="virtio"/>
Nov 30 12:33:32 user nova-compute[75672]:       <serial>417630b1-4b40-4ed4-acef-5309c9f42629</serial>
Nov 30 12:33:32 user nova-compute[75672]:     </disk>
Nov 30 12:33:32 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:32 user nova-compute[75672]:       <mac address="fa:16:3e:09:63:ab"/>
Nov 30 12:33:32 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:32 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:32 user nova-compute[75672]:       <target dev="tap026ddb45-5a"/>
Nov 30 12:33:32 user nova-compute[75672]:     </interface>
Nov 30 12:33:32 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:32 user nova-compute[75672]:       <mac address="fa:16:3e:78:de:b4"/>
Nov 30 12:33:32 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:32 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:32 user nova-compute[75672]:       <target dev="tapf50a4265-e7"/>
Nov 30 12:33:32 user nova-compute[75672]:     </interface>
Nov 30 12:33:32 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:32 user nova-compute[75672]:       <mac address="fa:16:3e:56:be:df"/>
Nov 30 12:33:32 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:32 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:32 user nova-compute[75672]:       <target dev="tapbffe61b1-46"/>
Nov 30 12:33:32 user nova-compute[75672]:     </interface>
Nov 30 12:33:32 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:32 user nova-compute[75672]:       <mac address="fa:16:3e:c0:57:d2"/>
Nov 30 12:33:32 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:32 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:32 user nova-compute[75672]:       <target dev="tap7df92582-df"/>
Nov 30 12:33:32 user nova-compute[75672]:     </interface>
Nov 30 12:33:32 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:32 user nova-compute[75672]:       <mac address="fa:16:3e:6a:c7:b1"/>
Nov 30 12:33:32 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:32 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:32 user nova-compute[75672]:       <target dev="tap2f0976de-f4"/>
Nov 30 12:33:32 user nova-compute[75672]:     </interface>
Nov 30 12:33:32 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:32 user nova-compute[75672]:       <mac address="fa:16:3e:00:9b:13"/>
Nov 30 12:33:32 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:32 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:32 user nova-compute[75672]:       <target dev="tap441e94f2-f8"/>
Nov 30 12:33:32 user nova-compute[75672]:     </interface>
Nov 30 12:33:32 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:32 user nova-compute[75672]:       <mac address="fa:16:3e:1f:66:ac"/>
Nov 30 12:33:32 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:32 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:32 user nova-compute[75672]:       <target dev="tap52cf6915-a2"/>
Nov 30 12:33:32 user nova-compute[75672]:     </interface>
Nov 30 12:33:32 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:33:32 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/d8328382-e998-44b8-9c34-a1dbf74746e7/console.log" append="off"/>
Nov 30 12:33:32 user nova-compute[75672]:     </serial>
Nov 30 12:33:32 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:33:32 user nova-compute[75672]:     <video>
Nov 30 12:33:32 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:32 user nova-compute[75672]:     </video>
Nov 30 12:33:32 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:33:32 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:33:32 user nova-compute[75672]:     </rng>
Nov 30 12:33:32 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:33:32 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:33:32 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:33:32 user nova-compute[75672]:     </memballoon>
Nov 30 12:33:32 user nova-compute[75672]:   </devices>
Nov 30 12:33:32 user nova-compute[75672]: </domain>
Nov 30 12:33:32 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:63:ab,bridge_name='br-int',has_traffic_filtering=True,id=026ddb45-5a8b-4434-906c-7350c6e6f878,network=Network(a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026ddb45-5a') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:63:ab,bridge_name='br-int',has_traffic_filtering=True,id=026ddb45-5a8b-4434-906c-7350c6e6f878,network=Network(a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026ddb45-5a') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45987b6c-7a02-5712-b7e2-6bc51827a86d', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap026ddb45-5a, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap026ddb45-5a, col_values=(('qos', UUID('ca541616-8e6c-451f-bfe9-b4678740bef0')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap026ddb45-5a, col_values=(('external_ids', {'iface-id': '026ddb45-5a8b-4434-906c-7350c6e6f878', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:63:ab', 'vm-uuid': 'd8328382-e998-44b8-9c34-a1dbf74746e7'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf070e1-affd-4463-9919-d1481c87df1d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DVNLUSPq {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: INFO os_vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:63:ab,bridge_name='br-int',has_traffic_filtering=True,id=026ddb45-5a8b-4434-906c-7350c6e6f878,network=Network(a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026ddb45-5a')
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:de:b4,bridge_name='br-int',has_traffic_filtering=True,id=f50a4265-e775-4197-a5ec-5980f4cd0485,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf50a4265-e7') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:de:b4,bridge_name='br-int',has_traffic_filtering=True,id=f50a4265-e775-4197-a5ec-5980f4cd0485,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf50a4265-e7') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DVNLUSPq" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[91df96c1-6636-45fd-be10-8f0e3fc3aa94]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f26b0a49-38ea-548c-af99-2f591657237b', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DVNLUSPq'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf50a4265-e7, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf50a4265-e7, col_values=(('qos', UUID('ddce618e-0eb6-4511-a594-b8d64d1f4655')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf50a4265-e7, col_values=(('external_ids', {'iface-id': 'f50a4265-e775-4197-a5ec-5980f4cd0485', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:de:b4', 'vm-uuid': 'd8328382-e998-44b8-9c34-a1dbf74746e7'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d166de42-a7a7-488d-bfd0-6cbd2040f3ab]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: INFO os_vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:de:b4,bridge_name='br-int',has_traffic_filtering=True,id=f50a4265-e775-4197-a5ec-5980f4cd0485,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf50a4265-e7')
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:be:df,bridge_name='br-int',has_traffic_filtering=True,id=bffe61b1-46cc-476d-b96e-c4cb5b81fb63,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbffe61b1-46') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:be:df,bridge_name='br-int',has_traffic_filtering=True,id=bffe61b1-46cc-476d-b96e-c4cb5b81fb63,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbffe61b1-46') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab24f8b-27cc-4dec-a58e-d983a14d3393]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:33:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:33:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcd36d12-26a9-58d8-baa3-b4da7c0a900f', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbffe61b1-46, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbffe61b1-46, col_values=(('qos', UUID('80b7f8fb-ac7f-4238-b013-2303435e9948')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbffe61b1-46, col_values=(('external_ids', {'iface-id': 'bffe61b1-46cc-476d-b96e-c4cb5b81fb63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:be:df', 'vm-uuid': 'd8328382-e998-44b8-9c34-a1dbf74746e7'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[382d8b38-051a-42c8-a53f-a672a34cb7ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f, portal: 172.16.0.220,3260]
Nov 30 12:33:32 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f, portal: 172.16.0.220,3260] successful.
Nov 30 12:33:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: INFO os_vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:be:df,bridge_name='br-int',has_traffic_filtering=True,id=bffe61b1-46cc-476d-b96e-c4cb5b81fb63,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbffe61b1-46')
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7df92582-df3e-4666-8afc-0fa41fa10d27", "address": "fa:16:3e:c0:57:d2", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df92582-df", "ovs_interfaceid": "7df92582-df3e-4666-8afc-0fa41fa10d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "7df92582-df3e-4666-8afc-0fa41fa10d27", "address": "fa:16:3e:c0:57:d2", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df92582-df", "ovs_interfaceid": "7df92582-df3e-4666-8afc-0fa41fa10d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:57:d2,bridge_name='br-int',has_traffic_filtering=True,id=7df92582-df3e-4666-8afc-0fa41fa10d27,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df92582-df') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:57:d2,bridge_name='br-int',has_traffic_filtering=True,id=7df92582-df3e-4666-8afc-0fa41fa10d27,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df92582-df') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '279a9875-49aa-5bc3-9983-a7de70a052aa', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cace1d4-f7b4-46c7-92cf-890faef1f712]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7df92582-df, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7df92582-df, col_values=(('qos', UUID('ebb1a345-42b7-4e03-bf8f-88d26d382c40')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7df92582-df, col_values=(('external_ids', {'iface-id': '7df92582-df3e-4666-8afc-0fa41fa10d27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:57:d2', 'vm-uuid': 'd8328382-e998-44b8-9c34-a1dbf74746e7'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1fa3c5-c8c2-4f42-84a2-2ea622fb098f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:33:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:33:32 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:33:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb63022-5947-478a-9a6d-f02a741d60a4]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVNLUSPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: INFO os_vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:57:d2,bridge_name='br-int',has_traffic_filtering=True,id=7df92582-df3e-4666-8afc-0fa41fa10d27,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df92582-df')
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "address": "fa:16:3e:6a:c7:b1", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0976de-f4", "ovs_interfaceid": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "address": "fa:16:3e:6a:c7:b1", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0976de-f4", "ovs_interfaceid": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c7:b1,bridge_name='br-int',has_traffic_filtering=True,id=2f0976de-f44c-4de2-9eb1-4a9f98c16672,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0976de-f4') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG os_vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c7:b1,bridge_name='br-int',has_traffic_filtering=True,id=2f0976de-f44c-4de2-9eb1-4a9f98c16672,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0976de-f4') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c76b12ed-9c79-5f46-b77e-0a62358ab8cd', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:32 user nova-compute[75672]: INFO nova.compute.manager [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Rescuing
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquired lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG nova.network.neutron [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f0976de-f4, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f0976de-f4, col_values=(('qos', UUID('643bfd43-ef97-4b48-b9ff-7384f526a07d')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f0976de-f4, col_values=(('external_ids', {'iface-id': '2f0976de-f44c-4de2-9eb1-4a9f98c16672', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:c7:b1', 'vm-uuid': 'd8328382-e998-44b8-9c34-a1dbf74746e7'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: INFO os_vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c7:b1,bridge_name='br-int',has_traffic_filtering=True,id=2f0976de-f44c-4de2-9eb1-4a9f98c16672,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0976de-f4')
Nov 30 12:33:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "441e94f2-f857-4b09-886a-b958df41483a", "address": "fa:16:3e:00:9b:13", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441e94f2-f8", "ovs_interfaceid": "441e94f2-f857-4b09-886a-b958df41483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "441e94f2-f857-4b09-886a-b958df41483a", "address": "fa:16:3e:00:9b:13", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441e94f2-f8", "ovs_interfaceid": "441e94f2-f857-4b09-886a-b958df41483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:9b:13,bridge_name='br-int',has_traffic_filtering=True,id=441e94f2-f857-4b09-886a-b958df41483a,network=Network(816f5a3b-528a-4f69-aa12-624766d6c89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441e94f2-f8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG os_vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9b:13,bridge_name='br-int',has_traffic_filtering=True,id=441e94f2-f857-4b09-886a-b958df41483a,network=Network(816f5a3b-528a-4f69-aa12-624766d6c89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441e94f2-f8') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '341caadd-089e-5a80-b1c8-e7167368f823', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap441e94f2-f8, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap441e94f2-f8, col_values=(('qos', UUID('ecfb09ee-53dc-4504-af96-8f11a0a47f40')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap441e94f2-f8, col_values=(('external_ids', {'iface-id': '441e94f2-f857-4b09-886a-b958df41483a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:9b:13', 'vm-uuid': 'd8328382-e998-44b8-9c34-a1dbf74746e7'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: INFO os_vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9b:13,bridge_name='br-int',has_traffic_filtering=True,id=441e94f2-f857-4b09-886a-b958df41483a,network=Network(816f5a3b-528a-4f69-aa12-624766d6c89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441e94f2-f8')
Nov 30 12:33:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52cf6915-a26b-4126-9f42-6741a35e66c9", "address": "fa:16:3e:1f:66:ac", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52cf6915-a2", "ovs_interfaceid": "52cf6915-a26b-4126-9f42-6741a35e66c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "52cf6915-a26b-4126-9f42-6741a35e66c9", "address": "fa:16:3e:1f:66:ac", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52cf6915-a2", "ovs_interfaceid": "52cf6915-a26b-4126-9f42-6741a35e66c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:66:ac,bridge_name='br-int',has_traffic_filtering=True,id=52cf6915-a26b-4126-9f42-6741a35e66c9,network=Network(816f5a3b-528a-4f69-aa12-624766d6c89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52cf6915-a2') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG os_vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:66:ac,bridge_name='br-int',has_traffic_filtering=True,id=52cf6915-a26b-4126-9f42-6741a35e66c9,network=Network(816f5a3b-528a-4f69-aa12-624766d6c89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52cf6915-a2') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9977f59f-1a00-5f26-a672-b59e835d61c4', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52cf6915-a2, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52cf6915-a2, col_values=(('qos', UUID('558d259b-c089-41fe-8236-022247469a53')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52cf6915-a2, col_values=(('external_ids', {'iface-id': '52cf6915-a26b-4126-9f42-6741a35e66c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:66:ac', 'vm-uuid': 'd8328382-e998-44b8-9c34-a1dbf74746e7'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:33 user nova-compute[75672]: INFO os_vif [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:66:ac,bridge_name='br-int',has_traffic_filtering=True,id=52cf6915-a26b-4126-9f42-6741a35e66c9,network=Network(816f5a3b-528a-4f69-aa12-624766d6c89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52cf6915-a2')
Nov 30 12:33:33 user nova-compute[75672]: DEBUG nova.network.neutron [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Updating instance_info_cache with network_info: [{"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] No BDM found with device name hda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] No VIF found with MAC fa:16:3e:09:63:ab, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] No VIF found with MAC fa:16:3e:6a:c7:b1, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:33:33 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Using config drive
Nov 30 12:33:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Releasing lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.083s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] <== connect_volume: return (3429ms) {'type': 'block', 'scsi_wwn': '23832373233383137', 'path': '/dev/sdg'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832373233383137', 'path': '/dev/sdg'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.manager [req-1afdd407-0ab0-4eb3-94ff-ceac62fe4527 req-b08a7eb6-5344-414b-b7b7-560879cce12e service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received event network-vif-unplugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1afdd407-0ab0-4eb3-94ff-ceac62fe4527 req-b08a7eb6-5344-414b-b7b7-560879cce12e service nova] Acquiring lock "62555959-6271-47e1-920c-b6333de4cca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1afdd407-0ab0-4eb3-94ff-ceac62fe4527 req-b08a7eb6-5344-414b-b7b7-560879cce12e service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1afdd407-0ab0-4eb3-94ff-ceac62fe4527 req-b08a7eb6-5344-414b-b7b7-560879cce12e service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.manager [req-1afdd407-0ab0-4eb3-94ff-ceac62fe4527 req-b08a7eb6-5344-414b-b7b7-560879cce12e service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] No waiting events found dispatching network-vif-unplugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:34 user nova-compute[75672]: WARNING nova.compute.manager [req-1afdd407-0ab0-4eb3-94ff-ceac62fe4527 req-b08a7eb6-5344-414b-b7b7-560879cce12e service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received unexpected event network-vif-unplugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 for instance with vm_state active and task_state rescuing.
Nov 30 12:33:34 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Instance destroyed successfully.
Nov 30 12:33:34 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:33:34 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=6974MB free_disk=25.414894104003906GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:34 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Attempting rescue
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75672) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Instance directory exists: not creating {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Nov 30 12:33:34 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Creating image(s)
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "/opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "/opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "/opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.objects.instance [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'trusted_certs' on Instance uuid 62555959-6271-47e1-920c-b6333de4cca4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2304dd64-2456-475f-bc90-16143352b18a", "address": "fa:16:3e:6c:fe:34", "network": {"id": "82ff3f53-fea3-4dd1-9e10-f56b442ef619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-814518059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2304dd64-24", "ovs_interfaceid": "2304dd64-2456-475f-bc90-16143352b18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "2304dd64-2456-475f-bc90-16143352b18a", "address": "fa:16:3e:6c:fe:34", "network": {"id": "82ff3f53-fea3-4dd1-9e10-f56b442ef619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-814518059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2304dd64-24", "ovs_interfaceid": "2304dd64-2456-475f-bc90-16143352b18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fe:34,bridge_name='br-int',has_traffic_filtering=True,id=2304dd64-2456-475f-bc90-16143352b18a,network=Network(82ff3f53-fea3-4dd1-9e10-f56b442ef619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2304dd64-24') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:e5:61,bridge_name='br-int',has_traffic_filtering=True,id=9f5fce50-73ed-465d-bf21-f3902157d044,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f5fce50-73') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:af:0b,bridge_name='br-int',has_traffic_filtering=True,id=927378ac-2059-4e53-a96b-ab629c814942,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap927378ac-20') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "address": "fa:16:3e:26:f7:c2", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4ff97-44", "ovs_interfaceid": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "address": "fa:16:3e:26:f7:c2", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4ff97-44", "ovs_interfaceid": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:f7:c2,bridge_name='br-int',has_traffic_filtering=True,id=c2a4ff97-44d0-4b5d-971b-c7015d3e54f8,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a4ff97-44') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "address": "fa:16:3e:96:81:8b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195140fe-5a", "ovs_interfaceid": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "address": "fa:16:3e:96:81:8b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195140fe-5a", "ovs_interfaceid": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:81:8b,bridge_name='br-int',has_traffic_filtering=True,id=195140fe-5a34-44cd-a93f-cbcc015f67d0,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195140fe-5a') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9177927-6e30-497f-9080-78798e05686c", "address": "fa:16:3e:a4:a7:f2", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9177927-6e", "ovs_interfaceid": "d9177927-6e30-497f-9080-78798e05686c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "d9177927-6e30-497f-9080-78798e05686c", "address": "fa:16:3e:a4:a7:f2", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9177927-6e", "ovs_interfaceid": "d9177927-6e30-497f-9080-78798e05686c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a7:f2,bridge_name='br-int',has_traffic_filtering=True,id=d9177927-6e30-497f-9080-78798e05686c,network=Network(61781429-98eb-4e65-9a1d-d2f04625dadf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9177927-6e') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:86:05,bridge_name='br-int',has_traffic_filtering=True,id=288fbe5b-c2d5-434b-9ce1-82364edc246f,network=Network(61781429-98eb-4e65-9a1d-d2f04625dadf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288fbe5b-c2') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.objects.instance [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lazy-loading 'pci_devices' on Instance uuid 35ef80cd-d7d8-421b-8296-44b107b1bce4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:33:34 user nova-compute[75672]:   <uuid>35ef80cd-d7d8-421b-8296-44b107b1bce4</uuid>
Nov 30 12:33:34 user nova-compute[75672]:   <name>instance-0000000b</name>
Nov 30 12:33:34 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:33:34 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:33:34 user nova-compute[75672]:   <metadata>
Nov 30 12:33:34 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:33:34 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:33:34 user nova-compute[75672]:       <nova:name>tempest-device-tagging-server-1190961203</nova:name>
Nov 30 12:33:34 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:33:26</nova:creationTime>
Nov 30 12:33:34 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:33:34 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:33:34 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:33:34 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:33:34 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:33:34 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:33:34 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:33:34 user nova-compute[75672]:       <nova:owner>
Nov 30 12:33:34 user nova-compute[75672]:         <nova:user uuid="e7ab9a7339334ee39a17b7911e2ebfde">tempest-TaggedBootDevicesTest_v242-1911046419-project-member</nova:user>
Nov 30 12:33:34 user nova-compute[75672]:         <nova:project uuid="4ec663862ec640dcaba59b031512fe30">tempest-TaggedBootDevicesTest_v242-1911046419</nova:project>
Nov 30 12:33:34 user nova-compute[75672]:       </nova:owner>
Nov 30 12:33:34 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:33:34 user nova-compute[75672]:       <nova:ports>
Nov 30 12:33:34 user nova-compute[75672]:         <nova:port uuid="2304dd64-2456-475f-bc90-16143352b18a">
Nov 30 12:33:34 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 12:33:34 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:34 user nova-compute[75672]:         <nova:port uuid="9f5fce50-73ed-465d-bf21-f3902157d044">
Nov 30 12:33:34 user nova-compute[75672]:           <nova:ip type="fixed" address="10.1.1.115" ipVersion="4"/>
Nov 30 12:33:34 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:34 user nova-compute[75672]:         <nova:port uuid="927378ac-2059-4e53-a96b-ab629c814942">
Nov 30 12:33:34 user nova-compute[75672]:           <nova:ip type="fixed" address="10.1.1.129" ipVersion="4"/>
Nov 30 12:33:34 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:34 user nova-compute[75672]:         <nova:port uuid="c2a4ff97-44d0-4b5d-971b-c7015d3e54f8">
Nov 30 12:33:34 user nova-compute[75672]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Nov 30 12:33:34 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:34 user nova-compute[75672]:         <nova:port uuid="195140fe-5a34-44cd-a93f-cbcc015f67d0">
Nov 30 12:33:34 user nova-compute[75672]:           <nova:ip type="fixed" address="10.1.1.78" ipVersion="4"/>
Nov 30 12:33:34 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:34 user nova-compute[75672]:         <nova:port uuid="d9177927-6e30-497f-9080-78798e05686c">
Nov 30 12:33:34 user nova-compute[75672]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 30 12:33:34 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:34 user nova-compute[75672]:         <nova:port uuid="288fbe5b-c2d5-434b-9ce1-82364edc246f">
Nov 30 12:33:34 user nova-compute[75672]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 30 12:33:34 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:34 user nova-compute[75672]:       </nova:ports>
Nov 30 12:33:34 user nova-compute[75672]:     </nova:instance>
Nov 30 12:33:34 user nova-compute[75672]:   </metadata>
Nov 30 12:33:34 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:33:34 user nova-compute[75672]:     <system>
Nov 30 12:33:34 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:33:34 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:33:34 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:33:34 user nova-compute[75672]:       <entry name="serial">35ef80cd-d7d8-421b-8296-44b107b1bce4</entry>
Nov 30 12:33:34 user nova-compute[75672]:       <entry name="uuid">35ef80cd-d7d8-421b-8296-44b107b1bce4</entry>
Nov 30 12:33:34 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:33:34 user nova-compute[75672]:     </system>
Nov 30 12:33:34 user nova-compute[75672]:   </sysinfo>
Nov 30 12:33:34 user nova-compute[75672]:   <os>
Nov 30 12:33:34 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:33:34 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:33:34 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:33:34 user nova-compute[75672]:   </os>
Nov 30 12:33:34 user nova-compute[75672]:   <features>
Nov 30 12:33:34 user nova-compute[75672]:     <acpi/>
Nov 30 12:33:34 user nova-compute[75672]:     <apic/>
Nov 30 12:33:34 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:33:34 user nova-compute[75672]:   </features>
Nov 30 12:33:34 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:33:34 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:33:34 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:33:34 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:33:34 user nova-compute[75672]:   </clock>
Nov 30 12:33:34 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:33:34 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:33:34 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:33:34 user nova-compute[75672]:   </cpu>
Nov 30 12:33:34 user nova-compute[75672]:   <devices>
Nov 30 12:33:34 user nova-compute[75672]:     <disk type="file" device="cdrom">
Nov 30 12:33:34 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 12:33:34 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/35ef80cd-d7d8-421b-8296-44b107b1bce4/disk.config"/>
Nov 30 12:33:34 user nova-compute[75672]:       <target dev="hda" bus="ide"/>
Nov 30 12:33:34 user nova-compute[75672]:     </disk>
Nov 30 12:33:34 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:33:34 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:33:34 user nova-compute[75672]:       <source dev="/dev/sdc"/>
Nov 30 12:33:34 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:33:34 user nova-compute[75672]:       <serial>49f97df5-26e7-4dc8-a5cc-38c192302b63</serial>
Nov 30 12:33:34 user nova-compute[75672]:     </disk>
Nov 30 12:33:34 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:33:34 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:33:34 user nova-compute[75672]:       <source dev="/dev/sde"/>
Nov 30 12:33:34 user nova-compute[75672]:       <target dev="vdb" bus="virtio"/>
Nov 30 12:33:34 user nova-compute[75672]:       <serial>31189b16-d950-46e3-ab69-6729febf2c1b</serial>
Nov 30 12:33:34 user nova-compute[75672]:     </disk>
Nov 30 12:33:34 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:33:34 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:33:34 user nova-compute[75672]:       <source dev="/dev/sdg"/>
Nov 30 12:33:34 user nova-compute[75672]:       <target dev="vdc" bus="virtio"/>
Nov 30 12:33:34 user nova-compute[75672]:       <serial>00529119-c8a8-4898-ac85-9c3f7e99da7f</serial>
Nov 30 12:33:34 user nova-compute[75672]:     </disk>
Nov 30 12:33:34 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:34 user nova-compute[75672]:       <mac address="fa:16:3e:6c:fe:34"/>
Nov 30 12:33:34 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:34 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:34 user nova-compute[75672]:       <target dev="tap2304dd64-24"/>
Nov 30 12:33:34 user nova-compute[75672]:     </interface>
Nov 30 12:33:34 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:34 user nova-compute[75672]:       <mac address="fa:16:3e:f6:e5:61"/>
Nov 30 12:33:34 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:34 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:34 user nova-compute[75672]:       <target dev="tap9f5fce50-73"/>
Nov 30 12:33:34 user nova-compute[75672]:     </interface>
Nov 30 12:33:34 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:34 user nova-compute[75672]:       <mac address="fa:16:3e:8b:af:0b"/>
Nov 30 12:33:34 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:34 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:34 user nova-compute[75672]:       <target dev="tap927378ac-20"/>
Nov 30 12:33:34 user nova-compute[75672]:     </interface>
Nov 30 12:33:34 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:34 user nova-compute[75672]:       <mac address="fa:16:3e:26:f7:c2"/>
Nov 30 12:33:34 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:34 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:34 user nova-compute[75672]:       <target dev="tapc2a4ff97-44"/>
Nov 30 12:33:34 user nova-compute[75672]:     </interface>
Nov 30 12:33:34 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:34 user nova-compute[75672]:       <mac address="fa:16:3e:96:81:8b"/>
Nov 30 12:33:34 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:34 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:34 user nova-compute[75672]:       <target dev="tap195140fe-5a"/>
Nov 30 12:33:34 user nova-compute[75672]:     </interface>
Nov 30 12:33:34 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:34 user nova-compute[75672]:       <mac address="fa:16:3e:a4:a7:f2"/>
Nov 30 12:33:34 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:34 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:34 user nova-compute[75672]:       <target dev="tapd9177927-6e"/>
Nov 30 12:33:34 user nova-compute[75672]:     </interface>
Nov 30 12:33:34 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:34 user nova-compute[75672]:       <mac address="fa:16:3e:f6:86:05"/>
Nov 30 12:33:34 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:34 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:34 user nova-compute[75672]:       <target dev="tap288fbe5b-c2"/>
Nov 30 12:33:34 user nova-compute[75672]:     </interface>
Nov 30 12:33:34 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:33:34 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/35ef80cd-d7d8-421b-8296-44b107b1bce4/console.log" append="off"/>
Nov 30 12:33:34 user nova-compute[75672]:     </serial>
Nov 30 12:33:34 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:33:34 user nova-compute[75672]:     <video>
Nov 30 12:33:34 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:34 user nova-compute[75672]:     </video>
Nov 30 12:33:34 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:33:34 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:33:34 user nova-compute[75672]:     </rng>
Nov 30 12:33:34 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:33:34 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:33:34 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:33:34 user nova-compute[75672]:     </memballoon>
Nov 30 12:33:34 user nova-compute[75672]:   </devices>
Nov 30 12:33:34 user nova-compute[75672]: </domain>
Nov 30 12:33:34 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2304dd64-2456-475f-bc90-16143352b18a", "address": "fa:16:3e:6c:fe:34", "network": {"id": "82ff3f53-fea3-4dd1-9e10-f56b442ef619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-814518059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2304dd64-24", "ovs_interfaceid": "2304dd64-2456-475f-bc90-16143352b18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "2304dd64-2456-475f-bc90-16143352b18a", "address": "fa:16:3e:6c:fe:34", "network": {"id": "82ff3f53-fea3-4dd1-9e10-f56b442ef619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-814518059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2304dd64-24", "ovs_interfaceid": "2304dd64-2456-475f-bc90-16143352b18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fe:34,bridge_name='br-int',has_traffic_filtering=True,id=2304dd64-2456-475f-bc90-16143352b18a,network=Network(82ff3f53-fea3-4dd1-9e10-f56b442ef619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2304dd64-24') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG os_vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fe:34,bridge_name='br-int',has_traffic_filtering=True,id=2304dd64-2456-475f-bc90-16143352b18a,network=Network(82ff3f53-fea3-4dd1-9e10-f56b442ef619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2304dd64-24') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:33:34 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Creating config drive at /opt/stack/data/nova/instances/d8328382-e998-44b8-9c34-a1dbf74746e7/disk.config
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d8328382-e998-44b8-9c34-a1dbf74746e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_jp53cgj {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93913748-068d-5e6e-9253-1bce41a921f9', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d8328382-e998-44b8-9c34-a1dbf74746e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_jp53cgj" returned: 0 in 0.066s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 1fba8af1-8074-4ce8-be23-912e9850fc41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 85f7c21c-b973-422f-a10c-8fb3635879f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 84f3ca7c-05db-4714-a685-3598bc6134d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 22619e89-6f9e-402b-9a73-2af94c1e59a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance e1542356-c1bb-46db-8570-94958f48ab83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 35ef80cd-d7d8-421b-8296-44b107b1bce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d8328382-e998-44b8-9c34-a1dbf74746e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2304dd64-24, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2304dd64-24, col_values=(('qos', UUID('e29a4377-4879-467a-b9fd-94f7d431a920')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2304dd64-24, col_values=(('external_ids', {'iface-id': '2304dd64-2456-475f-bc90-16143352b18a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:fe:34', 'vm-uuid': '35ef80cd-d7d8-421b-8296-44b107b1bce4'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.235s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue" returned: 0 in 0.048s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.objects.instance [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'migration_context' on Instance uuid 62555959-6271-47e1-920c-b6333de4cca4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.objects.base [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<62555959-6271-47e1-920c-b6333de4cca4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Start _get_guest_xml network_info=[{"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "vif_mac": "fa:16:3e:63:41:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.objects.instance [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'resources' on Instance uuid 62555959-6271-47e1-920c-b6333de4cca4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:34 user nova-compute[75672]: INFO os_vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fe:34,bridge_name='br-int',has_traffic_filtering=True,id=2304dd64-2456-475f-bc90-16143352b18a,network=Network(82ff3f53-fea3-4dd1-9e10-f56b442ef619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2304dd64-24')
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:e5:61,bridge_name='br-int',has_traffic_filtering=True,id=9f5fce50-73ed-465d-bf21-f3902157d044,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f5fce50-73') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG os_vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:e5:61,bridge_name='br-int',has_traffic_filtering=True,id=9f5fce50-73ed-465d-bf21-f3902157d044,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f5fce50-73') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.objects.base [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<62555959-6271-47e1-920c-b6333de4cca4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.objects.instance [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'numa_topology' on Instance uuid 62555959-6271-47e1-920c-b6333de4cca4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '194b3482-046f-5a22-99ef-aa065c58c028', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:34 user nova-compute[75672]: DEBUG nova.objects.base [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<62555959-6271-47e1-920c-b6333de4cca4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:33:35 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:33:35 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.objects.instance [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'vcpu_model' on Instance uuid 62555959-6271-47e1-920c-b6333de4cca4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.objects.base [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<62555959-6271-47e1-920c-b6333de4cca4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-197576731',display_name='tempest-ServerRescueNegativeTestJSON-server-197576731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-197576731',id=2,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:31:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='601d2f3e56844b68b3a0c71f8a7f5454',ramdisk_id='',reservation_id='r-n98vn0nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-928198583',owner_user_name='tempest-ServerRescueNegativeTestJSON-928198583-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:31:59Z,user_data=None,user_id='61c6bf770dfe4eadba28f371b29f1d79',uuid=62555959-6271-47e1-920c-b6333de4cca4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "vif_mac": "fa:16:3e:63:41:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converting VIF {"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "vif_mac": "fa:16:3e:63:41:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:41:41,bridge_name='br-int',has_traffic_filtering=True,id=eb326ae3-464f-42bf-8e4d-ca951d6115a0,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb326ae3-46') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.objects.instance [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'pci_devices' on Instance uuid 62555959-6271-47e1-920c-b6333de4cca4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f5fce50-73, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f5fce50-73, col_values=(('qos', UUID('29cef846-19ec-44fd-86fc-d28ddd0d45d4')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f5fce50-73, col_values=(('external_ids', {'iface-id': '9f5fce50-73ed-465d-bf21-f3902157d044', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:e5:61', 'vm-uuid': '35ef80cd-d7d8-421b-8296-44b107b1bce4'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.objects.base [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<62555959-6271-47e1-920c-b6333de4cca4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:33:35 user nova-compute[75672]:   <uuid>62555959-6271-47e1-920c-b6333de4cca4</uuid>
Nov 30 12:33:35 user nova-compute[75672]:   <name>instance-00000002</name>
Nov 30 12:33:35 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:33:35 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:33:35 user nova-compute[75672]:   <metadata>
Nov 30 12:33:35 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:33:35 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:33:35 user nova-compute[75672]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-197576731</nova:name>
Nov 30 12:33:35 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:33:35</nova:creationTime>
Nov 30 12:33:35 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:33:35 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:33:35 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:33:35 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:33:35 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:33:35 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:33:35 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:33:35 user nova-compute[75672]:       <nova:owner>
Nov 30 12:33:35 user nova-compute[75672]:         <nova:user uuid="61c6bf770dfe4eadba28f371b29f1d79">tempest-ServerRescueNegativeTestJSON-928198583-project-member</nova:user>
Nov 30 12:33:35 user nova-compute[75672]:         <nova:project uuid="601d2f3e56844b68b3a0c71f8a7f5454">tempest-ServerRescueNegativeTestJSON-928198583</nova:project>
Nov 30 12:33:35 user nova-compute[75672]:       </nova:owner>
Nov 30 12:33:35 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:33:35 user nova-compute[75672]:       <nova:ports>
Nov 30 12:33:35 user nova-compute[75672]:         <nova:port uuid="eb326ae3-464f-42bf-8e4d-ca951d6115a0">
Nov 30 12:33:35 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 12:33:35 user nova-compute[75672]:         </nova:port>
Nov 30 12:33:35 user nova-compute[75672]:       </nova:ports>
Nov 30 12:33:35 user nova-compute[75672]:     </nova:instance>
Nov 30 12:33:35 user nova-compute[75672]:   </metadata>
Nov 30 12:33:35 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:33:35 user nova-compute[75672]:     <system>
Nov 30 12:33:35 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:33:35 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:33:35 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:33:35 user nova-compute[75672]:       <entry name="serial">62555959-6271-47e1-920c-b6333de4cca4</entry>
Nov 30 12:33:35 user nova-compute[75672]:       <entry name="uuid">62555959-6271-47e1-920c-b6333de4cca4</entry>
Nov 30 12:33:35 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:33:35 user nova-compute[75672]:     </system>
Nov 30 12:33:35 user nova-compute[75672]:   </sysinfo>
Nov 30 12:33:35 user nova-compute[75672]:   <os>
Nov 30 12:33:35 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:33:35 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:33:35 user nova-compute[75672]:   </os>
Nov 30 12:33:35 user nova-compute[75672]:   <features>
Nov 30 12:33:35 user nova-compute[75672]:     <acpi/>
Nov 30 12:33:35 user nova-compute[75672]:     <apic/>
Nov 30 12:33:35 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:33:35 user nova-compute[75672]:   </features>
Nov 30 12:33:35 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:33:35 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:33:35 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:33:35 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:33:35 user nova-compute[75672]:   </clock>
Nov 30 12:33:35 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:33:35 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:33:35 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:33:35 user nova-compute[75672]:   </cpu>
Nov 30 12:33:35 user nova-compute[75672]:   <devices>
Nov 30 12:33:35 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:33:35 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:33:35 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue"/>
Nov 30 12:33:35 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:33:35 user nova-compute[75672]:     </disk>
Nov 30 12:33:35 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:33:35 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:33:35 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk"/>
Nov 30 12:33:35 user nova-compute[75672]:       <target dev="vdb" bus="virtio"/>
Nov 30 12:33:35 user nova-compute[75672]:     </disk>
Nov 30 12:33:35 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:33:35 user nova-compute[75672]:       <mac address="fa:16:3e:63:41:41"/>
Nov 30 12:33:35 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:35 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:33:35 user nova-compute[75672]:       <target dev="tapeb326ae3-46"/>
Nov 30 12:33:35 user nova-compute[75672]:     </interface>
Nov 30 12:33:35 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:33:35 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/console.log" append="off"/>
Nov 30 12:33:35 user nova-compute[75672]:     </serial>
Nov 30 12:33:35 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:33:35 user nova-compute[75672]:     <video>
Nov 30 12:33:35 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:33:35 user nova-compute[75672]:     </video>
Nov 30 12:33:35 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:33:35 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:33:35 user nova-compute[75672]:     </rng>
Nov 30 12:33:35 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:33:35 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:33:35 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:33:35 user nova-compute[75672]:     </memballoon>
Nov 30 12:33:35 user nova-compute[75672]:   </devices>
Nov 30 12:33:35 user nova-compute[75672]: </domain>
Nov 30 12:33:35 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:35 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Instance destroyed successfully.
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: INFO os_vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:e5:61,bridge_name='br-int',has_traffic_filtering=True,id=9f5fce50-73ed-465d-bf21-f3902157d044,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f5fce50-73')
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:af:0b,bridge_name='br-int',has_traffic_filtering=True,id=927378ac-2059-4e53-a96b-ab629c814942,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap927378ac-20') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG os_vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:af:0b,bridge_name='br-int',has_traffic_filtering=True,id=927378ac-2059-4e53-a96b-ab629c814942,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap927378ac-20') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7187d08d-c699-5b52-bba3-4d58cf30d5c6', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No VIF found with MAC fa:16:3e:63:41:41, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap927378ac-20, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap927378ac-20, col_values=(('qos', UUID('42b5fec8-c3ff-48e6-8c16-3be36adaa170')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap927378ac-20, col_values=(('external_ids', {'iface-id': '927378ac-2059-4e53-a96b-ab629c814942', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:af:0b', 'vm-uuid': '35ef80cd-d7d8-421b-8296-44b107b1bce4'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.095s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:35 user nova-compute[75672]: INFO os_vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:af:0b,bridge_name='br-int',has_traffic_filtering=True,id=927378ac-2059-4e53-a96b-ab629c814942,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap927378ac-20')
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "address": "fa:16:3e:26:f7:c2", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4ff97-44", "ovs_interfaceid": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "address": "fa:16:3e:26:f7:c2", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4ff97-44", "ovs_interfaceid": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:f7:c2,bridge_name='br-int',has_traffic_filtering=True,id=c2a4ff97-44d0-4b5d-971b-c7015d3e54f8,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a4ff97-44') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG os_vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:f7:c2,bridge_name='br-int',has_traffic_filtering=True,id=c2a4ff97-44d0-4b5d-971b-c7015d3e54f8,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a4ff97-44') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b902ba4d-f4be-5078-a309-7d1f61cb2765', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2a4ff97-44, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2a4ff97-44, col_values=(('qos', UUID('cca6d54c-55e7-4ac9-9a4d-4fb620aa9c47')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2a4ff97-44, col_values=(('external_ids', {'iface-id': 'c2a4ff97-44d0-4b5d-971b-c7015d3e54f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:f7:c2', 'vm-uuid': '35ef80cd-d7d8-421b-8296-44b107b1bce4'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: INFO os_vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:f7:c2,bridge_name='br-int',has_traffic_filtering=True,id=c2a4ff97-44d0-4b5d-971b-c7015d3e54f8,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a4ff97-44')
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "address": "fa:16:3e:96:81:8b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195140fe-5a", "ovs_interfaceid": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "address": "fa:16:3e:96:81:8b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195140fe-5a", "ovs_interfaceid": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:81:8b,bridge_name='br-int',has_traffic_filtering=True,id=195140fe-5a34-44cd-a93f-cbcc015f67d0,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195140fe-5a') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG os_vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:81:8b,bridge_name='br-int',has_traffic_filtering=True,id=195140fe-5a34-44cd-a93f-cbcc015f67d0,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195140fe-5a') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f3b70bc-8687-53e8-8076-46b31ba2af53', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-aa6b174d-b3d5-4301-90c4-ebe0fd0181d8 req-ed24142d-5504-4363-93e0-1f9caf51e667 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received event network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-aa6b174d-b3d5-4301-90c4-ebe0fd0181d8 req-ed24142d-5504-4363-93e0-1f9caf51e667 service nova] Acquiring lock "62555959-6271-47e1-920c-b6333de4cca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-aa6b174d-b3d5-4301-90c4-ebe0fd0181d8 req-ed24142d-5504-4363-93e0-1f9caf51e667 service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-aa6b174d-b3d5-4301-90c4-ebe0fd0181d8 req-ed24142d-5504-4363-93e0-1f9caf51e667 service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-aa6b174d-b3d5-4301-90c4-ebe0fd0181d8 req-ed24142d-5504-4363-93e0-1f9caf51e667 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] No waiting events found dispatching network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:36 user nova-compute[75672]: WARNING nova.compute.manager [req-aa6b174d-b3d5-4301-90c4-ebe0fd0181d8 req-ed24142d-5504-4363-93e0-1f9caf51e667 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received unexpected event network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 for instance with vm_state active and task_state rescuing.
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap195140fe-5a, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap195140fe-5a, col_values=(('qos', UUID('7777c995-e7ee-4979-bd24-1fb9690c7d38')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap195140fe-5a, col_values=(('external_ids', {'iface-id': '195140fe-5a34-44cd-a93f-cbcc015f67d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:81:8b', 'vm-uuid': '35ef80cd-d7d8-421b-8296-44b107b1bce4'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: INFO os_vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:81:8b,bridge_name='br-int',has_traffic_filtering=True,id=195140fe-5a34-44cd-a93f-cbcc015f67d0,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195140fe-5a')
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9177927-6e30-497f-9080-78798e05686c", "address": "fa:16:3e:a4:a7:f2", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9177927-6e", "ovs_interfaceid": "d9177927-6e30-497f-9080-78798e05686c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "d9177927-6e30-497f-9080-78798e05686c", "address": "fa:16:3e:a4:a7:f2", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9177927-6e", "ovs_interfaceid": "d9177927-6e30-497f-9080-78798e05686c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a7:f2,bridge_name='br-int',has_traffic_filtering=True,id=d9177927-6e30-497f-9080-78798e05686c,network=Network(61781429-98eb-4e65-9a1d-d2f04625dadf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9177927-6e') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG os_vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a7:f2,bridge_name='br-int',has_traffic_filtering=True,id=d9177927-6e30-497f-9080-78798e05686c,network=Network(61781429-98eb-4e65-9a1d-d2f04625dadf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9177927-6e') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a7881ce-627c-56f5-947b-5c664e7b75d5', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-08a32134-2b79-4a1e-a9e9-89ca3b7430f7 req-956665ea-ab32-4994-bd6a-079588caa7ff service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Received event network-changed-890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-08a32134-2b79-4a1e-a9e9-89ca3b7430f7 req-956665ea-ab32-4994-bd6a-079588caa7ff service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Refreshing instance network info cache due to event network-changed-890df6ae-1036-4cfd-b155-04a5c16f093c. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-08a32134-2b79-4a1e-a9e9-89ca3b7430f7 req-956665ea-ab32-4994-bd6a-079588caa7ff service nova] Acquiring lock "refresh_cache-dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-08a32134-2b79-4a1e-a9e9-89ca3b7430f7 req-956665ea-ab32-4994-bd6a-079588caa7ff service nova] Acquired lock "refresh_cache-dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.network.neutron [req-08a32134-2b79-4a1e-a9e9-89ca3b7430f7 req-956665ea-ab32-4994-bd6a-079588caa7ff service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Refreshing network info cache for port 890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9177927-6e, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9177927-6e, col_values=(('qos', UUID('eabef2ec-3280-46e7-95b4-8b3cfa8e5d9c')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9177927-6e, col_values=(('external_ids', {'iface-id': 'd9177927-6e30-497f-9080-78798e05686c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:a7:f2', 'vm-uuid': '35ef80cd-d7d8-421b-8296-44b107b1bce4'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: INFO os_vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a7:f2,bridge_name='br-int',has_traffic_filtering=True,id=d9177927-6e30-497f-9080-78798e05686c,network=Network(61781429-98eb-4e65-9a1d-d2f04625dadf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9177927-6e')
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:86:05,bridge_name='br-int',has_traffic_filtering=True,id=288fbe5b-c2d5-434b-9ce1-82364edc246f,network=Network(61781429-98eb-4e65-9a1d-d2f04625dadf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288fbe5b-c2') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG os_vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:86:05,bridge_name='br-int',has_traffic_filtering=True,id=288fbe5b-c2d5-434b-9ce1-82364edc246f,network=Network(61781429-98eb-4e65-9a1d-d2f04625dadf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288fbe5b-c2') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '639f7ab4-8720-5c26-a6d4-ff4e13e7bebe', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap288fbe5b-c2, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap288fbe5b-c2, col_values=(('qos', UUID('3d15a436-d29b-4643-b887-2c5a360e8b87')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap288fbe5b-c2, col_values=(('external_ids', {'iface-id': '288fbe5b-c2d5-434b-9ce1-82364edc246f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:86:05', 'vm-uuid': '35ef80cd-d7d8-421b-8296-44b107b1bce4'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.network.neutron [req-08a32134-2b79-4a1e-a9e9-89ca3b7430f7 req-956665ea-ab32-4994-bd6a-079588caa7ff service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Updated VIF entry in instance network info cache for port 890df6ae-1036-4cfd-b155-04a5c16f093c. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.network.neutron [req-08a32134-2b79-4a1e-a9e9-89ca3b7430f7 req-956665ea-ab32-4994-bd6a-079588caa7ff service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Updating instance_info_cache with network_info: [{"id": "890df6ae-1036-4cfd-b155-04a5c16f093c", "address": "fa:16:3e:9e:f7:d3", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890df6ae-10", "ovs_interfaceid": "890df6ae-1036-4cfd-b155-04a5c16f093c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:36 user nova-compute[75672]: INFO os_vif [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:86:05,bridge_name='br-int',has_traffic_filtering=True,id=288fbe5b-c2d5-434b-9ce1-82364edc246f,network=Network(61781429-98eb-4e65-9a1d-d2f04625dadf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288fbe5b-c2')
Nov 30 12:33:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-08a32134-2b79-4a1e-a9e9-89ca3b7430f7 req-956665ea-ab32-4994-bd6a-079588caa7ff service nova] Releasing lock "refresh_cache-dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] No BDM found with device name hda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] No VIF found with MAC fa:16:3e:6c:fe:34, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:33:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] No VIF found with MAC fa:16:3e:96:81:8b, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:33:36 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Using config drive
Nov 30 12:33:37 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Creating config drive at /opt/stack/data/nova/instances/35ef80cd-d7d8-421b-8296-44b107b1bce4/disk.config
Nov 30 12:33:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/35ef80cd-d7d8-421b-8296-44b107b1bce4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp38lhxniy {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/35ef80cd-d7d8-421b-8296-44b107b1bce4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp38lhxniy" returned: 0 in 0.061s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-f7b337dc-b7c8-423d-b6e7-2be5ec5c24a9 req-70e0a55c-e560-4155-8bfa-13dd28a6256a service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f7b337dc-b7c8-423d-b6e7-2be5ec5c24a9 req-70e0a55c-e560-4155-8bfa-13dd28a6256a service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f7b337dc-b7c8-423d-b6e7-2be5ec5c24a9 req-70e0a55c-e560-4155-8bfa-13dd28a6256a service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f7b337dc-b7c8-423d-b6e7-2be5ec5c24a9 req-70e0a55c-e560-4155-8bfa-13dd28a6256a service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-f7b337dc-b7c8-423d-b6e7-2be5ec5c24a9 req-70e0a55c-e560-4155-8bfa-13dd28a6256a service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:38 user nova-compute[75672]: WARNING nova.compute.manager [req-f7b337dc-b7c8-423d-b6e7-2be5ec5c24a9 req-70e0a55c-e560-4155-8bfa-13dd28a6256a service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-026ddb45-5a8b-4434-906c-7350c6e6f878 for instance with vm_state building and task_state spawning.
Nov 30 12:33:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-4db460ed-b476-4770-9df5-920f33fe1230 req-f8dd928e-9f14-435f-9d61-98594cab8f81 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-changed-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-4db460ed-b476-4770-9df5-920f33fe1230 req-f8dd928e-9f14-435f-9d61-98594cab8f81 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Refreshing instance network info cache due to event network-changed-5bfc6970-5d97-4f13-8603-d508342c282a. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4db460ed-b476-4770-9df5-920f33fe1230 req-f8dd928e-9f14-435f-9d61-98594cab8f81 service nova] Acquiring lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4db460ed-b476-4770-9df5-920f33fe1230 req-f8dd928e-9f14-435f-9d61-98594cab8f81 service nova] Acquired lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG nova.network.neutron [req-4db460ed-b476-4770-9df5-920f33fe1230 req-f8dd928e-9f14-435f-9d61-98594cab8f81 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Refreshing network info cache for port 5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG nova.network.neutron [req-4db460ed-b476-4770-9df5-920f33fe1230 req-f8dd928e-9f14-435f-9d61-98594cab8f81 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Updated VIF entry in instance network info cache for port 5bfc6970-5d97-4f13-8603-d508342c282a. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG nova.network.neutron [req-4db460ed-b476-4770-9df5-920f33fe1230 req-f8dd928e-9f14-435f-9d61-98594cab8f81 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Updating instance_info_cache with network_info: [{"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4db460ed-b476-4770-9df5-920f33fe1230 req-f8dd928e-9f14-435f-9d61-98594cab8f81 service nova] Releasing lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG nova.objects.instance [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'flavor' on Instance uuid dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.144s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:39 user nova-compute[75672]: INFO nova.compute.manager [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Attaching volume 8c415004-90c8-4076-9f15-6a67a3a262b0 to /dev/vdb
Nov 30 12:33:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG os_brick.utils [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0926c80f-3485-4b16-8e23-d8b457c45a7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7248f6a7-c893-4ba5-bf9a-81c5a9fef4d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f83d6b-22a9-4170-8fe6-b6278f504243]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89879e8-5756-4a03-882f-8f7d16c80afb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:39 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:33:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a998b2a0-087a-44cf-b392-19bcdaf4db2a]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG os_brick.utils [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Updating existing volume attachment record: aed85808-9615-45b5-b849-076b60bc6d48 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:33:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:40 user nova-compute[75672]: WARNING nova.compute.manager [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-026ddb45-5a8b-4434-906c-7350c6e6f878 for instance with vm_state building and task_state spawning.
Nov 30 12:33:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received event network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] Acquiring lock "62555959-6271-47e1-920c-b6333de4cca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] No waiting events found dispatching network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:40 user nova-compute[75672]: WARNING nova.compute.manager [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received unexpected event network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 for instance with vm_state active and task_state rescuing.
Nov 30 12:33:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received event network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] Acquiring lock "62555959-6271-47e1-920c-b6333de4cca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] No waiting events found dispatching network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:40 user nova-compute[75672]: WARNING nova.compute.manager [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received unexpected event network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 for instance with vm_state active and task_state rescuing.
Nov 30 12:33:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-bffe61b1-46cc-476d-b96e-c4cb5b81fb63 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-bffe61b1-46cc-476d-b96e-c4cb5b81fb63 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:40 user nova-compute[75672]: WARNING nova.compute.manager [req-608eefae-ea71-40a2-9542-90e2fe723549 req-d2467455-50f8-4a3d-8767-581cebc15af6 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-bffe61b1-46cc-476d-b96e-c4cb5b81fb63 for instance with vm_state building and task_state spawning.
Nov 30 12:33:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-57695c59-15bd-4407-8bba-8e635583e5b6 req-c13a4388-9e1a-49de-b66f-61549906294a service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-f50a4265-e775-4197-a5ec-5980f4cd0485 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-57695c59-15bd-4407-8bba-8e635583e5b6 req-c13a4388-9e1a-49de-b66f-61549906294a service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-57695c59-15bd-4407-8bba-8e635583e5b6 req-c13a4388-9e1a-49de-b66f-61549906294a service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-57695c59-15bd-4407-8bba-8e635583e5b6 req-c13a4388-9e1a-49de-b66f-61549906294a service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-57695c59-15bd-4407-8bba-8e635583e5b6 req-c13a4388-9e1a-49de-b66f-61549906294a service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-f50a4265-e775-4197-a5ec-5980f4cd0485 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:40 user nova-compute[75672]: WARNING nova.compute.manager [req-57695c59-15bd-4407-8bba-8e635583e5b6 req-c13a4388-9e1a-49de-b66f-61549906294a service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-f50a4265-e775-4197-a5ec-5980f4cd0485 for instance with vm_state building and task_state spawning.
Nov 30 12:33:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-57695c59-15bd-4407-8bba-8e635583e5b6 req-c13a4388-9e1a-49de-b66f-61549906294a service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-f50a4265-e775-4197-a5ec-5980f4cd0485 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-57695c59-15bd-4407-8bba-8e635583e5b6 req-c13a4388-9e1a-49de-b66f-61549906294a service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-57695c59-15bd-4407-8bba-8e635583e5b6 req-c13a4388-9e1a-49de-b66f-61549906294a service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-57695c59-15bd-4407-8bba-8e635583e5b6 req-c13a4388-9e1a-49de-b66f-61549906294a service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-57695c59-15bd-4407-8bba-8e635583e5b6 req-c13a4388-9e1a-49de-b66f-61549906294a service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-f50a4265-e775-4197-a5ec-5980f4cd0485 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:40 user nova-compute[75672]: WARNING nova.compute.manager [req-57695c59-15bd-4407-8bba-8e635583e5b6 req-c13a4388-9e1a-49de-b66f-61549906294a service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-f50a4265-e775-4197-a5ec-5980f4cd0485 for instance with vm_state building and task_state spawning.
Nov 30 12:33:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:41 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'flavor' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.264s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-bffe61b1-46cc-476d-b96e-c4cb5b81fb63 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-bffe61b1-46cc-476d-b96e-c4cb5b81fb63 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:42 user nova-compute[75672]: WARNING nova.compute.manager [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-bffe61b1-46cc-476d-b96e-c4cb5b81fb63 for instance with vm_state building and task_state spawning.
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-2f0976de-f44c-4de2-9eb1-4a9f98c16672 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-2f0976de-f44c-4de2-9eb1-4a9f98c16672 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:42 user nova-compute[75672]: WARNING nova.compute.manager [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-2f0976de-f44c-4de2-9eb1-4a9f98c16672 for instance with vm_state building and task_state spawning.
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-2f0976de-f44c-4de2-9eb1-4a9f98c16672 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-2f0976de-f44c-4de2-9eb1-4a9f98c16672 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:42 user nova-compute[75672]: WARNING nova.compute.manager [req-a784cbbe-453f-4e46-951b-d93b8052ebce req-1df6b39c-8495-4754-b7d1-dc35d78dee68 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-2f0976de-f44c-4de2-9eb1-4a9f98c16672 for instance with vm_state building and task_state spawning.
Nov 30 12:33:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:42 user nova-compute[75672]: INFO nova.compute.manager [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Attaching volume c6f5b089-e352-4270-b369-e79ce8349e93 to /dev/vdb
Nov 30 12:33:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG os_brick.utils [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccde5ae-6f33-44ad-b287-ce59e85ef104]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-7df92582-df3e-4666-8afc-0fa41fa10d27 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-7df92582-df3e-4666-8afc-0fa41fa10d27 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:42 user nova-compute[75672]: WARNING nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-7df92582-df3e-4666-8afc-0fa41fa10d27 for instance with vm_state building and task_state spawning.
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-7df92582-df3e-4666-8afc-0fa41fa10d27 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-7df92582-df3e-4666-8afc-0fa41fa10d27 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:42 user nova-compute[75672]: WARNING nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-7df92582-df3e-4666-8afc-0fa41fa10d27 for instance with vm_state building and task_state spawning.
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:42 user nova-compute[75672]: WARNING nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-2304dd64-2456-475f-bc90-16143352b18a for instance with vm_state building and task_state spawning.
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:42 user nova-compute[75672]: WARNING nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-2304dd64-2456-475f-bc90-16143352b18a for instance with vm_state building and task_state spawning.
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-9f5fce50-73ed-465d-bf21-f3902157d044 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-9f5fce50-73ed-465d-bf21-f3902157d044 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:42 user nova-compute[75672]: WARNING nova.compute.manager [req-d8162f31-f23b-453b-918b-60bae6e88332 req-f95cb1c1-a997-4a8d-8642-feff953eb896 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-9f5fce50-73ed-465d-bf21-f3902157d044 for instance with vm_state building and task_state spawning.
Nov 30 12:33:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfa970b-21ed-4ba8-b9de-9134c2d8aa1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[43928739-a722-4f14-ada0-e651b96711a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1143f7c-8ce2-4228-897b-b48ccd96b1bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:42 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06613f8-a2bb-4b6d-94a8-51c62bcdc4b6]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG os_brick.utils [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Updating existing volume attachment record: 99f69182-b3b3-4539-a061-fecd49842cac {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-5a64c8f6-39f2-4408-bced-1ab6ea5274a9 req-f96a41cf-63cd-40b7-bc4e-4f136b8952e8 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-441e94f2-f857-4b09-886a-b958df41483a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5a64c8f6-39f2-4408-bced-1ab6ea5274a9 req-f96a41cf-63cd-40b7-bc4e-4f136b8952e8 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5a64c8f6-39f2-4408-bced-1ab6ea5274a9 req-f96a41cf-63cd-40b7-bc4e-4f136b8952e8 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5a64c8f6-39f2-4408-bced-1ab6ea5274a9 req-f96a41cf-63cd-40b7-bc4e-4f136b8952e8 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-5a64c8f6-39f2-4408-bced-1ab6ea5274a9 req-f96a41cf-63cd-40b7-bc4e-4f136b8952e8 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-441e94f2-f857-4b09-886a-b958df41483a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:42 user nova-compute[75672]: WARNING nova.compute.manager [req-5a64c8f6-39f2-4408-bced-1ab6ea5274a9 req-f96a41cf-63cd-40b7-bc4e-4f136b8952e8 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-441e94f2-f857-4b09-886a-b958df41483a for instance with vm_state building and task_state spawning.
Nov 30 12:33:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [None req-23522dc9-a0b0-47db-ad23-9e4067436a35 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-9d97b829-10b9-4a2d-8937-a4214ca6d232 req-fc3016d1-160e-44b6-871d-c40c35de3e31 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9d97b829-10b9-4a2d-8937-a4214ca6d232 req-fc3016d1-160e-44b6-871d-c40c35de3e31 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9d97b829-10b9-4a2d-8937-a4214ca6d232 req-fc3016d1-160e-44b6-871d-c40c35de3e31 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9d97b829-10b9-4a2d-8937-a4214ca6d232 req-fc3016d1-160e-44b6-871d-c40c35de3e31 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-9d97b829-10b9-4a2d-8937-a4214ca6d232 req-fc3016d1-160e-44b6-871d-c40c35de3e31 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:44 user nova-compute[75672]: WARNING nova.compute.manager [req-9d97b829-10b9-4a2d-8937-a4214ca6d232 req-fc3016d1-160e-44b6-871d-c40c35de3e31 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 for instance with vm_state building and task_state spawning.
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-9d97b829-10b9-4a2d-8937-a4214ca6d232 req-fc3016d1-160e-44b6-871d-c40c35de3e31 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9d97b829-10b9-4a2d-8937-a4214ca6d232 req-fc3016d1-160e-44b6-871d-c40c35de3e31 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9d97b829-10b9-4a2d-8937-a4214ca6d232 req-fc3016d1-160e-44b6-871d-c40c35de3e31 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9d97b829-10b9-4a2d-8937-a4214ca6d232 req-fc3016d1-160e-44b6-871d-c40c35de3e31 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-9d97b829-10b9-4a2d-8937-a4214ca6d232 req-fc3016d1-160e-44b6-871d-c40c35de3e31 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:44 user nova-compute[75672]: WARNING nova.compute.manager [req-9d97b829-10b9-4a2d-8937-a4214ca6d232 req-fc3016d1-160e-44b6-871d-c40c35de3e31 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 for instance with vm_state building and task_state spawning.
Nov 30 12:33:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-9f5fce50-73ed-465d-bf21-f3902157d044 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-9f5fce50-73ed-465d-bf21-f3902157d044 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:44 user nova-compute[75672]: WARNING nova.compute.manager [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-9f5fce50-73ed-465d-bf21-f3902157d044 for instance with vm_state building and task_state spawning.
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-927378ac-2059-4e53-a96b-ab629c814942 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-927378ac-2059-4e53-a96b-ab629c814942 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:44 user nova-compute[75672]: WARNING nova.compute.manager [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-927378ac-2059-4e53-a96b-ab629c814942 for instance with vm_state building and task_state spawning.
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-927378ac-2059-4e53-a96b-ab629c814942 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-927378ac-2059-4e53-a96b-ab629c814942 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:44 user nova-compute[75672]: WARNING nova.compute.manager [req-ba35c2fc-035d-4ede-a4de-5a13e2bc1116 req-0d99b7d6-5c0c-4a58-bb86-c8bd7c027f2d service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-927378ac-2059-4e53-a96b-ab629c814942 for instance with vm_state building and task_state spawning.
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-16316ce3-c083-47c4-984b-d7bc2a9bb70e req-c2b2998e-70e0-4f10-bf14-15d231f78c32 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-441e94f2-f857-4b09-886a-b958df41483a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-16316ce3-c083-47c4-984b-d7bc2a9bb70e req-c2b2998e-70e0-4f10-bf14-15d231f78c32 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-16316ce3-c083-47c4-984b-d7bc2a9bb70e req-c2b2998e-70e0-4f10-bf14-15d231f78c32 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-16316ce3-c083-47c4-984b-d7bc2a9bb70e req-c2b2998e-70e0-4f10-bf14-15d231f78c32 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-16316ce3-c083-47c4-984b-d7bc2a9bb70e req-c2b2998e-70e0-4f10-bf14-15d231f78c32 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-441e94f2-f857-4b09-886a-b958df41483a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:44 user nova-compute[75672]: WARNING nova.compute.manager [req-16316ce3-c083-47c4-984b-d7bc2a9bb70e req-c2b2998e-70e0-4f10-bf14-15d231f78c32 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-441e94f2-f857-4b09-886a-b958df41483a for instance with vm_state building and task_state spawning.
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-16316ce3-c083-47c4-984b-d7bc2a9bb70e req-c2b2998e-70e0-4f10-bf14-15d231f78c32 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-52cf6915-a26b-4126-9f42-6741a35e66c9 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-16316ce3-c083-47c4-984b-d7bc2a9bb70e req-c2b2998e-70e0-4f10-bf14-15d231f78c32 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-16316ce3-c083-47c4-984b-d7bc2a9bb70e req-c2b2998e-70e0-4f10-bf14-15d231f78c32 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-16316ce3-c083-47c4-984b-d7bc2a9bb70e req-c2b2998e-70e0-4f10-bf14-15d231f78c32 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-16316ce3-c083-47c4-984b-d7bc2a9bb70e req-c2b2998e-70e0-4f10-bf14-15d231f78c32 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-52cf6915-a26b-4126-9f42-6741a35e66c9 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:44 user nova-compute[75672]: WARNING nova.compute.manager [req-16316ce3-c083-47c4-984b-d7bc2a9bb70e req-c2b2998e-70e0-4f10-bf14-15d231f78c32 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-52cf6915-a26b-4126-9f42-6741a35e66c9 for instance with vm_state building and task_state spawning.
Nov 30 12:33:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-d9177927-6e30-497f-9080-78798e05686c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-d9177927-6e30-497f-9080-78798e05686c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:46 user nova-compute[75672]: WARNING nova.compute.manager [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-d9177927-6e30-497f-9080-78798e05686c for instance with vm_state building and task_state spawning.
Nov 30 12:33:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Received event network-changed-7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Refreshing instance network info cache due to event network-changed-7513ca6e-ee52-47e2-a2cb-428f6013ca40. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Acquiring lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Acquired lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG nova.network.neutron [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Refreshing network info cache for port 7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-52cf6915-a26b-4126-9f42-6741a35e66c9 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-52cf6915-a26b-4126-9f42-6741a35e66c9 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:46 user nova-compute[75672]: WARNING nova.compute.manager [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-52cf6915-a26b-4126-9f42-6741a35e66c9 for instance with vm_state building and task_state spawning.
Nov 30 12:33:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-195140fe-5a34-44cd-a93f-cbcc015f67d0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-195140fe-5a34-44cd-a93f-cbcc015f67d0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:46 user nova-compute[75672]: WARNING nova.compute.manager [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-195140fe-5a34-44cd-a93f-cbcc015f67d0 for instance with vm_state building and task_state spawning.
Nov 30 12:33:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-195140fe-5a34-44cd-a93f-cbcc015f67d0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-195140fe-5a34-44cd-a93f-cbcc015f67d0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:46 user nova-compute[75672]: WARNING nova.compute.manager [req-7ef00d85-8ccd-4d57-a1a9-28b783236323 req-bfcb73f9-2925-4ff4-b8f9-9f1255599042 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-195140fe-5a34-44cd-a93f-cbcc015f67d0 for instance with vm_state building and task_state spawning.
Nov 30 12:33:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:33:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:33:47 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Instance spawned successfully.
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:33:47 user nova-compute[75672]: INFO nova.compute.manager [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Took 21.49 seconds to spawn the instance on the hypervisor.
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:33:47 user nova-compute[75672]: INFO nova.compute.manager [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Took 52.16 seconds to build instance.
Nov 30 12:33:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2b26c12a-ad64-440d-8193-c5c23c0e2610 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.258s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.network.neutron [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updated VIF entry in instance network info cache for port 7513ca6e-ee52-47e2-a2cb-428f6013ca40. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.network.neutron [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updating instance_info_cache with network_info: [{"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Releasing lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-d9177927-6e30-497f-9080-78798e05686c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-d9177927-6e30-497f-9080-78798e05686c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:47 user nova-compute[75672]: WARNING nova.compute.manager [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-d9177927-6e30-497f-9080-78798e05686c for instance with vm_state building and task_state spawning.
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-288fbe5b-c2d5-434b-9ce1-82364edc246f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-288fbe5b-c2d5-434b-9ce1-82364edc246f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:47 user nova-compute[75672]: WARNING nova.compute.manager [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-288fbe5b-c2d5-434b-9ce1-82364edc246f for instance with vm_state building and task_state spawning.
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-288fbe5b-c2d5-434b-9ce1-82364edc246f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-288fbe5b-c2d5-434b-9ce1-82364edc246f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:33:47 user nova-compute[75672]: WARNING nova.compute.manager [req-754e62ee-32f1-4abc-9d1b-dd3a118ec86b req-c256bf8a-99ce-434a-8e61-fe58de077782 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-288fbe5b-c2d5-434b-9ce1-82364edc246f for instance with vm_state building and task_state spawning.
Nov 30 12:33:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:33:47 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Instance spawned successfully.
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:48 user nova-compute[75672]: INFO nova.compute.manager [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Took 21.44 seconds to spawn the instance on the hypervisor.
Nov 30 12:33:48 user nova-compute[75672]: DEBUG nova.compute.manager [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:33:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:48 user nova-compute[75672]: INFO nova.compute.manager [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Took 54.20 seconds to build instance.
Nov 30 12:33:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7a37912b-fd7c-4198-a32c-cb377a47ed08 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 54.308s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUfZhIDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:53 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.015s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:53 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:53 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[743fab0b-9d5a-402c-b6c3-c0cf2218bba3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:33:53 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf9443b-b7bf-4e18-a263-dddb5859f1d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0] added
Nov 30 12:33:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81849a6-dfbb-424d-8010-0c257e4e9279]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd9ff6d-2698-4390-a3ac-bd4dd441c43a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YUfZhIDH {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YUfZhIDH" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d4a9e1-5caf-48f4-bbee-cd2b809762de]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YUfZhIDH'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fabf558-69c3-4b6c-8999-b3f0ab3f626f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7deda93-32a7-4cae-95f8-45c9ef13af2f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:33:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:33:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7a6a4e-57d6-49de-a302-d89bac5072d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0, portal: 172.16.0.220,3260]
Nov 30 12:33:53 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0, portal: 172.16.0.220,3260] successful.
Nov 30 12:33:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[babc995e-8547-4775-b1cd-dcee6fa8ad5c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8f8557-c713-4086-9024-42773f5ffe95]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:33:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:33:53 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:33:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5332b969-9ef3-4a65-8aae-40d690ed0407]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:33:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUfZhIDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:33:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23531663531316532', 'path': '/dev/sdh'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531663531316532', 'path': '/dev/sdh'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:33:54 user nova-compute[75672]: DEBUG nova.objects.instance [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'flavor' on Instance uuid dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:33:54 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:33:54 user nova-compute[75672]:   <source dev="/dev/sdh"/>
Nov 30 12:33:54 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:33:54 user nova-compute[75672]:   <serial>8c415004-90c8-4076-9f15-6a67a3a262b0</serial>
Nov 30 12:33:54 user nova-compute[75672]: </disk>
Nov 30 12:33:54 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:33:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-b9404458-350f-49fc-82d3-cb77c368aa6f req-1629336f-bb12-413b-871f-2d9ce955c15e service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Received event network-changed-f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-b9404458-350f-49fc-82d3-cb77c368aa6f req-1629336f-bb12-413b-871f-2d9ce955c15e service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Refreshing instance network info cache due to event network-changed-f63d8e51-e821-4448-8d86-ca8c90e5b382. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b9404458-350f-49fc-82d3-cb77c368aa6f req-1629336f-bb12-413b-871f-2d9ce955c15e service nova] Acquiring lock "refresh_cache-85f7c21c-b973-422f-a10c-8fb3635879f4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b9404458-350f-49fc-82d3-cb77c368aa6f req-1629336f-bb12-413b-871f-2d9ce955c15e service nova] Acquired lock "refresh_cache-85f7c21c-b973-422f-a10c-8fb3635879f4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:54 user nova-compute[75672]: DEBUG nova.network.neutron [req-b9404458-350f-49fc-82d3-cb77c368aa6f req-1629336f-bb12-413b-871f-2d9ce955c15e service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Refreshing network info cache for port f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:33:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:33:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No VIF found with MAC fa:16:3e:9e:f7:d3, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:33:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-82457862-cfa2-44da-9502-84be19abb663 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.126s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:55 user nova-compute[75672]: DEBUG nova.network.neutron [req-b9404458-350f-49fc-82d3-cb77c368aa6f req-1629336f-bb12-413b-871f-2d9ce955c15e service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Updated VIF entry in instance network info cache for port f63d8e51-e821-4448-8d86-ca8c90e5b382. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:33:55 user nova-compute[75672]: DEBUG nova.network.neutron [req-b9404458-350f-49fc-82d3-cb77c368aa6f req-1629336f-bb12-413b-871f-2d9ce955c15e service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Updating instance_info_cache with network_info: [{"id": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "address": "fa:16:3e:30:a9:02", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63d8e51-e8", "ovs_interfaceid": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b9404458-350f-49fc-82d3-cb77c368aa6f req-1629336f-bb12-413b-871f-2d9ce955c15e service nova] Releasing lock "refresh_cache-85f7c21c-b973-422f-a10c-8fb3635879f4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-d33e76cd-b9e7-4143-bf64-f1d593ee740e req-ec61f3df-26f7-4e29-9746-6ed08c7813c2 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received event network-changed-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:33:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-d33e76cd-b9e7-4143-bf64-f1d593ee740e req-ec61f3df-26f7-4e29-9746-6ed08c7813c2 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Refreshing instance network info cache due to event network-changed-19ffba33-190e-4fe0-bb72-53d8e79bbbd0. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:33:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d33e76cd-b9e7-4143-bf64-f1d593ee740e req-ec61f3df-26f7-4e29-9746-6ed08c7813c2 service nova] Acquiring lock "refresh_cache-84f3ca7c-05db-4714-a685-3598bc6134d3" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:33:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d33e76cd-b9e7-4143-bf64-f1d593ee740e req-ec61f3df-26f7-4e29-9746-6ed08c7813c2 service nova] Acquired lock "refresh_cache-84f3ca7c-05db-4714-a685-3598bc6134d3" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:33:55 user nova-compute[75672]: DEBUG nova.network.neutron [req-d33e76cd-b9e7-4143-bf64-f1d593ee740e req-ec61f3df-26f7-4e29-9746-6ed08c7813c2 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Refreshing network info cache for port 19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG nova.objects.instance [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lazy-loading 'flavor' on Instance uuid 84f3ca7c-05db-4714-a685-3598bc6134d3 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKkbRgPw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:56 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:56 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:33:56 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7c501e-0dab-410b-a916-66365aec0e80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:33:56 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.118s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[52457190-13a6-4c8d-838b-933b9f1c0b41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93] added
Nov 30 12:33:56 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e8b217-55f0-433f-98a5-0a813562c7a4]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82abd3b-7455-430b-a822-6c90329f7c1d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKkbRgPw {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKkbRgPw" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c435c4f1-ab92-4bbf-b918-a8f9fb1bce7d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iKkbRgPw'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.046s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac51cce7-bbea-421d-addb-8ccf5f1bb11a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[99059788-822e-44ed-a063-e94a1b46ec08]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:56 user nova-compute[75672]: INFO nova.compute.manager [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Attaching volume 2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 to /dev/vdb
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG nova.network.neutron [req-d33e76cd-b9e7-4143-bf64-f1d593ee740e req-ec61f3df-26f7-4e29-9746-6ed08c7813c2 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Updated VIF entry in instance network info cache for port 19ffba33-190e-4fe0-bb72-53d8e79bbbd0. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG nova.network.neutron [req-d33e76cd-b9e7-4143-bf64-f1d593ee740e req-ec61f3df-26f7-4e29-9746-6ed08c7813c2 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Updating instance_info_cache with network_info: [{"id": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "address": "fa:16:3e:36:eb:96", "network": {"id": "c905cd92-2463-450c-9c3e-6fef670e27e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1410834846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39eae439dda0405e84c7e37b768e28a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ffba33-19", "ovs_interfaceid": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --login" returned: 0 in 0.136s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0066cd7f-ea21-4e0a-b375-d7f721605da1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260]
Nov 30 12:33:56 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260] successful.
Nov 30 12:33:56 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d33e76cd-b9e7-4143-bf64-f1d593ee740e req-ec61f3df-26f7-4e29-9746-6ed08c7813c2 service nova] Releasing lock "refresh_cache-84f3ca7c-05db-4714-a685-3598bc6134d3" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f53893-9a4d-4190-944b-a02486147131]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d398a48-7ca4-4417-a3e4-a66e2346ba57]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:33:56 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.564s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.utils [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.045s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e3c6d3-3500-4ae5-a989-6f0a4b094f3c]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKkbRgPw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e2d50f-b339-479c-8b94-8d81d997fdb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dee71bf-6d66-4bf5-88ff-ce629aac3388]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fee03f-a14d-41e9-8936-ed0553d19996]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6398f0d8-e64b-4dc2-b3d1-743e164bb2dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:57 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:33:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:57 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:33:57 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f979124d-26af-4dc4-b4ed-88d2f3c41f24]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:57 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:33:57 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:33:57 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:33:57 user nova-compute[75672]: DEBUG os_brick.utils [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:57 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Updating existing volume attachment record: cbc8e3b6-4be7-490d-bff8-e82f488be583 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:33:57 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.630s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:33:57 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] <== connect_volume: return (1632ms) {'type': 'block', 'scsi_wwn': '26132383232323864', 'path': '/dev/sdi'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:57 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132383232323864', 'path': '/dev/sdi'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:33:57 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'flavor' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:57 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:33:57 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:33:57 user nova-compute[75672]:   <source dev="/dev/sdi"/>
Nov 30 12:33:57 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:33:57 user nova-compute[75672]:   <serial>c6f5b089-e352-4270-b369-e79ce8349e93</serial>
Nov 30 12:33:57 user nova-compute[75672]: </disk>
Nov 30 12:33:57 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:33:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:33:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:33:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] No VIF found with MAC fa:16:3e:99:e9:ab, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:33:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e280f928-23a2-462e-8aeb-27e69277b261 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.371s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-43c56f7f-c1f2-42da-ac08-e0e7d45646cf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-43c56f7f-c1f2-42da-ac08-e0e7d45646cf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-43c56f7f-c1f2-42da-ac08-e0e7d45646cf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:33:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-43c56f7f-c1f2-42da-ac08-e0e7d45646cf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75672) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 30 12:33:58 user nova-compute[75672]: DEBUG nova.objects.instance [None req-43c56f7f-c1f2-42da-ac08-e0e7d45646cf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'flavor' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "85f7c21c-b973-422f-a10c-8fb3635879f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:58 user nova-compute[75672]: DEBUG nova.objects.instance [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lazy-loading 'flavor' on Instance uuid 85f7c21c-b973-422f-a10c-8fb3635879f4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "85f7c21c-b973-422f-a10c-8fb3635879f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:59 user nova-compute[75672]: INFO nova.compute.manager [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Attaching volume db1ae54f-0797-4105-8fd4-425852e86c94 to /dev/vdb
Nov 30 12:33:59 user nova-compute[75672]: DEBUG os_brick.utils [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cf3889-af30-41f5-9ac6-9262f9874b22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[facb6703-3061-464b-8c9e-0b9f04506069]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5eac68-fd9f-402c-9346-10de050d8f33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd47c16-d0a0-40ac-993c-b8586dba8d48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:33:59 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[881cb68b-b8b6-4e5d-b991-58dceed25dfb]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG os_brick.utils [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Updating existing volume attachment record: 75e51c51-7776-497e-9b05-03b8fac055d9 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "c8333c65-42ab-4de2-abc4-6cc672746b2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "c8333c65-42ab-4de2-abc4-6cc672746b2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:33:59 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:33:59 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Instance destroyed successfully.
Nov 30 12:33:59 user nova-compute[75672]: DEBUG nova.compute.manager [None req-43c56f7f-c1f2-42da-ac08-e0e7d45646cf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-43c56f7f-c1f2-42da-ac08-e0e7d45646cf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.091s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:34:00 user nova-compute[75672]: INFO nova.compute.claims [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Claim successful on node user
Nov 30 12:34:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.662s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:34:00 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:34:00 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG nova.policy [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3166f2b3dee4aa4aa738f1f15ca7d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f07019e3584771af197e865b6877cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:34:00 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Creating image(s)
Nov 30 12:34:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "/opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "/opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.217s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.188s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk 1073741824" returned: 0 in 0.058s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.207s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Successfully created port: fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Cannot resize image /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Ensure instance console log exists: /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Successfully updated port: fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "refresh_cache-c8333c65-42ab-4de2-abc4-6cc672746b2b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquired lock "refresh_cache-c8333c65-42ab-4de2-abc4-6cc672746b2b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-ecdb5c78-3062-4551-95dc-7f9d3c631321 req-555097d1-c649-49ba-a2cc-445305e7a80b service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Received event network-changed-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-ecdb5c78-3062-4551-95dc-7f9d3c631321 req-555097d1-c649-49ba-a2cc-445305e7a80b service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Refreshing instance network info cache due to event network-changed-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ecdb5c78-3062-4551-95dc-7f9d3c631321 req-555097d1-c649-49ba-a2cc-445305e7a80b service nova] Acquiring lock "refresh_cache-c8333c65-42ab-4de2-abc4-6cc672746b2b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Updating instance_info_cache with network_info: [{"id": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "address": "fa:16:3e:57:e4:6e", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa8f95ae-9b", "ovs_interfaceid": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Releasing lock "refresh_cache-c8333c65-42ab-4de2-abc4-6cc672746b2b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Instance network_info: |[{"id": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "address": "fa:16:3e:57:e4:6e", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa8f95ae-9b", "ovs_interfaceid": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ecdb5c78-3062-4551-95dc-7f9d3c631321 req-555097d1-c649-49ba-a2cc-445305e7a80b service nova] Acquired lock "refresh_cache-c8333c65-42ab-4de2-abc4-6cc672746b2b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.network.neutron [req-ecdb5c78-3062-4551-95dc-7f9d3c631321 req-555097d1-c649-49ba-a2cc-445305e7a80b service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Refreshing network info cache for port fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Start _get_guest_xml network_info=[{"id": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "address": "fa:16:3e:57:e4:6e", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa8f95ae-9b", "ovs_interfaceid": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:34:02 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:34:02 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:33:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-569767320',display_name='tempest-AttachVolumeNegativeTest-server-569767320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-569767320',id=13,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsAqUbkJX6+z0xMgs6Va9GYr95uHTgVijYiZLM8xjokvkeiqtWvKfDBxKWp11n47bP+vBioA23/H+uIyQtVqQTcSLrYSui1Wz0UKZA+Ug6hNeb62Sz7JgDloiN2WBbsuQ==',key_name='tempest-keypair-1376892281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f07019e3584771af197e865b6877cc',ramdisk_id='',reservation_id='r-jg1khlv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1224349538',owner_user_name='tempest-AttachVolumeNegativeTest-1224349538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3166f2b3dee4aa4aa738f1f15ca7d19',uuid=c8333c65-42ab-4de2-abc4-6cc672746b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "address": "fa:16:3e:57:e4:6e", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa8f95ae-9b", "ovs_interfaceid": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converting VIF {"id": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "address": "fa:16:3e:57:e4:6e", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa8f95ae-9b", "ovs_interfaceid": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e4:6e,bridge_name='br-int',has_traffic_filtering=True,id=fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa8f95ae-9b') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.objects.instance [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'pci_devices' on Instance uuid c8333c65-42ab-4de2-abc4-6cc672746b2b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:34:02 user nova-compute[75672]:   <uuid>c8333c65-42ab-4de2-abc4-6cc672746b2b</uuid>
Nov 30 12:34:02 user nova-compute[75672]:   <name>instance-0000000d</name>
Nov 30 12:34:02 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:34:02 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:34:02 user nova-compute[75672]:   <metadata>
Nov 30 12:34:02 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:34:02 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:34:02 user nova-compute[75672]:       <nova:name>tempest-AttachVolumeNegativeTest-server-569767320</nova:name>
Nov 30 12:34:02 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:34:02</nova:creationTime>
Nov 30 12:34:02 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:34:02 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:34:02 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:34:02 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:34:02 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:34:02 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:34:02 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:34:02 user nova-compute[75672]:       <nova:owner>
Nov 30 12:34:02 user nova-compute[75672]:         <nova:user uuid="e3166f2b3dee4aa4aa738f1f15ca7d19">tempest-AttachVolumeNegativeTest-1224349538-project-member</nova:user>
Nov 30 12:34:02 user nova-compute[75672]:         <nova:project uuid="04f07019e3584771af197e865b6877cc">tempest-AttachVolumeNegativeTest-1224349538</nova:project>
Nov 30 12:34:02 user nova-compute[75672]:       </nova:owner>
Nov 30 12:34:02 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:34:02 user nova-compute[75672]:       <nova:ports>
Nov 30 12:34:02 user nova-compute[75672]:         <nova:port uuid="fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c">
Nov 30 12:34:02 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 12:34:02 user nova-compute[75672]:         </nova:port>
Nov 30 12:34:02 user nova-compute[75672]:       </nova:ports>
Nov 30 12:34:02 user nova-compute[75672]:     </nova:instance>
Nov 30 12:34:02 user nova-compute[75672]:   </metadata>
Nov 30 12:34:02 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:34:02 user nova-compute[75672]:     <system>
Nov 30 12:34:02 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:34:02 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:34:02 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:34:02 user nova-compute[75672]:       <entry name="serial">c8333c65-42ab-4de2-abc4-6cc672746b2b</entry>
Nov 30 12:34:02 user nova-compute[75672]:       <entry name="uuid">c8333c65-42ab-4de2-abc4-6cc672746b2b</entry>
Nov 30 12:34:02 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:34:02 user nova-compute[75672]:     </system>
Nov 30 12:34:02 user nova-compute[75672]:   </sysinfo>
Nov 30 12:34:02 user nova-compute[75672]:   <os>
Nov 30 12:34:02 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:34:02 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:34:02 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:34:02 user nova-compute[75672]:   </os>
Nov 30 12:34:02 user nova-compute[75672]:   <features>
Nov 30 12:34:02 user nova-compute[75672]:     <acpi/>
Nov 30 12:34:02 user nova-compute[75672]:     <apic/>
Nov 30 12:34:02 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:34:02 user nova-compute[75672]:   </features>
Nov 30 12:34:02 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:34:02 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:34:02 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:34:02 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:34:02 user nova-compute[75672]:   </clock>
Nov 30 12:34:02 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:34:02 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:34:02 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:34:02 user nova-compute[75672]:   </cpu>
Nov 30 12:34:02 user nova-compute[75672]:   <devices>
Nov 30 12:34:02 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:34:02 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:34:02 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk"/>
Nov 30 12:34:02 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:34:02 user nova-compute[75672]:     </disk>
Nov 30 12:34:02 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:34:02 user nova-compute[75672]:       <mac address="fa:16:3e:57:e4:6e"/>
Nov 30 12:34:02 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:34:02 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:34:02 user nova-compute[75672]:       <target dev="tapfa8f95ae-9b"/>
Nov 30 12:34:02 user nova-compute[75672]:     </interface>
Nov 30 12:34:02 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:34:02 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/console.log" append="off"/>
Nov 30 12:34:02 user nova-compute[75672]:     </serial>
Nov 30 12:34:02 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:34:02 user nova-compute[75672]:     <video>
Nov 30 12:34:02 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:34:02 user nova-compute[75672]:     </video>
Nov 30 12:34:02 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:34:02 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:34:02 user nova-compute[75672]:     </rng>
Nov 30 12:34:02 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:34:02 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:34:02 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:34:02 user nova-compute[75672]:     </memballoon>
Nov 30 12:34:02 user nova-compute[75672]:   </devices>
Nov 30 12:34:02 user nova-compute[75672]: </domain>
Nov 30 12:34:02 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:33:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-569767320',display_name='tempest-AttachVolumeNegativeTest-server-569767320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-569767320',id=13,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsAqUbkJX6+z0xMgs6Va9GYr95uHTgVijYiZLM8xjokvkeiqtWvKfDBxKWp11n47bP+vBioA23/H+uIyQtVqQTcSLrYSui1Wz0UKZA+Ug6hNeb62Sz7JgDloiN2WBbsuQ==',key_name='tempest-keypair-1376892281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f07019e3584771af197e865b6877cc',ramdisk_id='',reservation_id='r-jg1khlv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1224349538',owner_user_name='tempest-AttachVolumeNegativeTest-1224349538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3166f2b3dee4aa4aa738f1f15ca7d19',uuid=c8333c65-42ab-4de2-abc4-6cc672746b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "address": "fa:16:3e:57:e4:6e", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa8f95ae-9b", "ovs_interfaceid": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converting VIF {"id": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "address": "fa:16:3e:57:e4:6e", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa8f95ae-9b", "ovs_interfaceid": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e4:6e,bridge_name='br-int',has_traffic_filtering=True,id=fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa8f95ae-9b') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG os_vif [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e4:6e,bridge_name='br-int',has_traffic_filtering=True,id=fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa8f95ae-9b') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a6100dd-9a59-5d3a-ab57-17004fa9c870', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa8f95ae-9b, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa8f95ae-9b, col_values=(('qos', UUID('c203708c-acae-4ea0-8cab-d184e932d4fd')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa8f95ae-9b, col_values=(('external_ids', {'iface-id': 'fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:e4:6e', 'vm-uuid': 'c8333c65-42ab-4de2-abc4-6cc672746b2b'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:34:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:02 user nova-compute[75672]: INFO os_vif [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e4:6e,bridge_name='br-int',has_traffic_filtering=True,id=fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa8f95ae-9b')
Nov 30 12:34:03 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:34:03 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No VIF found with MAC fa:16:3e:57:e4:6e, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:34:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:03 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:34:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-ecdb5c78-3062-4551-95dc-7f9d3c631321 req-555097d1-c649-49ba-a2cc-445305e7a80b service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Updated VIF entry in instance network info cache for port fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:34:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-ecdb5c78-3062-4551-95dc-7f9d3c631321 req-555097d1-c649-49ba-a2cc-445305e7a80b service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Updating instance_info_cache with network_info: [{"id": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "address": "fa:16:3e:57:e4:6e", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa8f95ae-9b", "ovs_interfaceid": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:34:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ecdb5c78-3062-4551-95dc-7f9d3c631321 req-555097d1-c649-49ba-a2cc-445305e7a80b service nova] Releasing lock "refresh_cache-c8333c65-42ab-4de2-abc4-6cc672746b2b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:34:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:03 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:34:03 user nova-compute[75672]: INFO nova.compute.claims [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Claim successful on node user
Nov 30 12:34:03 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:34:03 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:34:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:03 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:34:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:34:04 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:34:04 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:34:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:34:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:34:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:34:04 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Creating image(s)
Nov 30 12:34:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "/opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "/opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "/opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "4f113774bb562d3fbf93daae1a1ed2e0d05d96e2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4f113774bb562d3fbf93daae1a1ed2e0d05d96e2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:04 user nova-compute[75672]: DEBUG nova.policy [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c663fb001aa64ec6a8e5861449ec2bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc2e7dfcbff457c9e394b1e5d0d23e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:34:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2.part --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-d9e79a32-6aa5-41e4-88ce-bc6887de17b4 req-b99dfec1-81a5-4ada-b3c6-677ae0fce6bd service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-unplugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d9e79a32-6aa5-41e4-88ce-bc6887de17b4 req-b99dfec1-81a5-4ada-b3c6-677ae0fce6bd service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d9e79a32-6aa5-41e4-88ce-bc6887de17b4 req-b99dfec1-81a5-4ada-b3c6-677ae0fce6bd service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d9e79a32-6aa5-41e4-88ce-bc6887de17b4 req-b99dfec1-81a5-4ada-b3c6-677ae0fce6bd service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-d9e79a32-6aa5-41e4-88ce-bc6887de17b4 req-b99dfec1-81a5-4ada-b3c6-677ae0fce6bd service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-unplugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:34:05 user nova-compute[75672]: WARNING nova.compute.manager [req-d9e79a32-6aa5-41e4-88ce-bc6887de17b4 req-b99dfec1-81a5-4ada-b3c6-677ae0fce6bd service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-unplugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state stopped and task_state None.
Nov 30 12:34:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2.part --force-share --output=json" returned: 0 in 0.210s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG nova.virt.images [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] c866fbbf-29c3-4e1b-8464-0648755b20e3 was qcow2, converting to raw {{(pid=75672) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2.part /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2.converted {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2.part /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2.converted" returned: 0 in 0.205s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2.converted --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4f113774bb562d3fbf93daae1a1ed2e0d05d96e2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.342s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-558ffe89-b812-4073-87d4-ce133f76378c req-61c950a6-bbdc-4c56-a2ac-62c47d65a401 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Received event network-changed-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-558ffe89-b812-4073-87d4-ce133f76378c req-61c950a6-bbdc-4c56-a2ac-62c47d65a401 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Refreshing instance network info cache due to event network-changed-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-558ffe89-b812-4073-87d4-ce133f76378c req-61c950a6-bbdc-4c56-a2ac-62c47d65a401 service nova] Acquiring lock "refresh_cache-6b34c9c2-18ab-45a5-ad54-24b830c27ac6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-558ffe89-b812-4073-87d4-ce133f76378c req-61c950a6-bbdc-4c56-a2ac-62c47d65a401 service nova] Acquired lock "refresh_cache-6b34c9c2-18ab-45a5-ad54-24b830c27ac6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG nova.network.neutron [req-558ffe89-b812-4073-87d4-ce133f76378c req-61c950a6-bbdc-4c56-a2ac-62c47d65a401 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Refreshing network info cache for port 2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2 --force-share --output=json" returned: 0 in 0.189s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "4f113774bb562d3fbf93daae1a1ed2e0d05d96e2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4f113774bb562d3fbf93daae1a1ed2e0d05d96e2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2 --force-share --output=json" returned: 0 in 0.209s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2,backing_fmt=raw /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2,backing_fmt=raw /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk 1073741824" returned: 0 in 0.051s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4f113774bb562d3fbf93daae1a1ed2e0d05d96e2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2 --force-share --output=json" returned: 0 in 0.200s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Successfully created port: d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Cannot resize image /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Ensure instance console log exists: /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:34:06 user nova-compute[75672]: WARNING nova.compute.manager [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state stopped and task_state None.
Nov 30 12:34:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Received event network-vif-plugged-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] Acquiring lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] Lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] Lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] No waiting events found dispatching network-vif-plugged-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:34:06 user nova-compute[75672]: WARNING nova.compute.manager [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Received unexpected event network-vif-plugged-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c for instance with vm_state building and task_state spawning.
Nov 30 12:34:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Received event network-vif-plugged-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] Acquiring lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] Lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] Lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] No waiting events found dispatching network-vif-plugged-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:34:06 user nova-compute[75672]: WARNING nova.compute.manager [req-5f972d37-3fc0-4892-8a79-24db3880b71b req-994ee4f7-db3c-404f-abd4-51f409f4af82 service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Received unexpected event network-vif-plugged-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c for instance with vm_state building and task_state spawning.
Nov 30 12:34:06 user nova-compute[75672]: DEBUG nova.network.neutron [req-558ffe89-b812-4073-87d4-ce133f76378c req-61c950a6-bbdc-4c56-a2ac-62c47d65a401 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Updated VIF entry in instance network info cache for port 2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG nova.network.neutron [req-558ffe89-b812-4073-87d4-ce133f76378c req-61c950a6-bbdc-4c56-a2ac-62c47d65a401 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Updating instance_info_cache with network_info: [{"id": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "address": "fa:16:3e:40:c9:b1", "network": {"id": "cff34241-9fea-4ea4-870c-f313e592180f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1419258086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e970f80ebac4746b62535ef0a437c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abd93a7-c3", "ovs_interfaceid": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:34:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-558ffe89-b812-4073-87d4-ce133f76378c req-61c950a6-bbdc-4c56-a2ac-62c47d65a401 service nova] Releasing lock "refresh_cache-6b34c9c2-18ab-45a5-ad54-24b830c27ac6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Successfully updated port: d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquired lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:34:07 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Instance spawned successfully.
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:34:07 user nova-compute[75672]: INFO nova.compute.manager [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Took 6.62 seconds to spawn the instance on the hypervisor.
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:34:07 user nova-compute[75672]: INFO nova.compute.manager [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Took 7.73 seconds to build instance.
Nov 30 12:34:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b27e6b62-2c25-4c41-894a-bff41751c0a7 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "c8333c65-42ab-4de2-abc4-6cc672746b2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.964s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updating instance_info_cache with network_info: [{"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Releasing lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Instance network_info: |[{"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Start _get_guest_xml network_info=[{"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:34:00Z,direct_url=<?>,disk_format='qcow2',id=c866fbbf-29c3-4e1b-8464-0648755b20e3,min_disk=0,min_ram=0,name='tempest-scenario-img--270146346',owner='ebc2e7dfcbff457c9e394b1e5d0d23e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:34:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'c866fbbf-29c3-4e1b-8464-0648755b20e3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:34:07 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:34:07 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:34:00Z,direct_url=<?>,disk_format='qcow2',id=c866fbbf-29c3-4e1b-8464-0648755b20e3,min_disk=0,min_ram=0,name='tempest-scenario-img--270146346',owner='ebc2e7dfcbff457c9e394b1e5d0d23e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:34:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-711672773',display_name='tempest-TestMinimumBasicScenario-server-711672773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-711672773',id=14,image_ref='c866fbbf-29c3-4e1b-8464-0648755b20e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOniC84tdYnYlJswjjRC4kKmNmB0tBzcdJaPVjXX2wcc4T+DibHFv1jYbqqzIDwZXYmRjVVueGyQD3b6liZnaDVWOLMtKxt+1Icj/6dsoFWFdwDT8Mgl2jBx4KBOz3cFsQ==',key_name='tempest-TestMinimumBasicScenario-2113508187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc2e7dfcbff457c9e394b1e5d0d23e6',ramdisk_id='',reservation_id='r-ekl1jzdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c866fbbf-29c3-4e1b-8464-0648755b20e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-950497565',owner_user_name='tempest-TestMinimumBasicScenario-950497565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:34:04Z,user_data=None,user_id='c663fb001aa64ec6a8e5861449ec2bbb',uuid=4382544b-6fb7-4164-9b6b-302a6e24bc52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converting VIF {"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:7d:cb,bridge_name='br-int',has_traffic_filtering=True,id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd229eaa1-29') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.objects.instance [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'pci_devices' on Instance uuid 4382544b-6fb7-4164-9b6b-302a6e24bc52 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:34:07 user nova-compute[75672]:   <uuid>4382544b-6fb7-4164-9b6b-302a6e24bc52</uuid>
Nov 30 12:34:07 user nova-compute[75672]:   <name>instance-0000000e</name>
Nov 30 12:34:07 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:34:07 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:34:07 user nova-compute[75672]:   <metadata>
Nov 30 12:34:07 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:34:07 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:34:07 user nova-compute[75672]:       <nova:name>tempest-TestMinimumBasicScenario-server-711672773</nova:name>
Nov 30 12:34:07 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:34:07</nova:creationTime>
Nov 30 12:34:07 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:34:07 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:34:07 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:34:07 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:34:07 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:34:07 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:34:07 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:34:07 user nova-compute[75672]:       <nova:owner>
Nov 30 12:34:07 user nova-compute[75672]:         <nova:user uuid="c663fb001aa64ec6a8e5861449ec2bbb">tempest-TestMinimumBasicScenario-950497565-project-member</nova:user>
Nov 30 12:34:07 user nova-compute[75672]:         <nova:project uuid="ebc2e7dfcbff457c9e394b1e5d0d23e6">tempest-TestMinimumBasicScenario-950497565</nova:project>
Nov 30 12:34:07 user nova-compute[75672]:       </nova:owner>
Nov 30 12:34:07 user nova-compute[75672]:       <nova:root type="image" uuid="c866fbbf-29c3-4e1b-8464-0648755b20e3"/>
Nov 30 12:34:07 user nova-compute[75672]:       <nova:ports>
Nov 30 12:34:07 user nova-compute[75672]:         <nova:port uuid="d229eaa1-29dc-4b3f-b468-d5a8f24d7514">
Nov 30 12:34:07 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 12:34:07 user nova-compute[75672]:         </nova:port>
Nov 30 12:34:07 user nova-compute[75672]:       </nova:ports>
Nov 30 12:34:07 user nova-compute[75672]:     </nova:instance>
Nov 30 12:34:07 user nova-compute[75672]:   </metadata>
Nov 30 12:34:07 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:34:07 user nova-compute[75672]:     <system>
Nov 30 12:34:07 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:34:07 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:34:07 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:34:07 user nova-compute[75672]:       <entry name="serial">4382544b-6fb7-4164-9b6b-302a6e24bc52</entry>
Nov 30 12:34:07 user nova-compute[75672]:       <entry name="uuid">4382544b-6fb7-4164-9b6b-302a6e24bc52</entry>
Nov 30 12:34:07 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:34:07 user nova-compute[75672]:     </system>
Nov 30 12:34:07 user nova-compute[75672]:   </sysinfo>
Nov 30 12:34:07 user nova-compute[75672]:   <os>
Nov 30 12:34:07 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:34:07 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:34:07 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:34:07 user nova-compute[75672]:   </os>
Nov 30 12:34:07 user nova-compute[75672]:   <features>
Nov 30 12:34:07 user nova-compute[75672]:     <acpi/>
Nov 30 12:34:07 user nova-compute[75672]:     <apic/>
Nov 30 12:34:07 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:34:07 user nova-compute[75672]:   </features>
Nov 30 12:34:07 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:34:07 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:34:07 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:34:07 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:34:07 user nova-compute[75672]:   </clock>
Nov 30 12:34:07 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:34:07 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:34:07 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:34:07 user nova-compute[75672]:   </cpu>
Nov 30 12:34:07 user nova-compute[75672]:   <devices>
Nov 30 12:34:07 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:34:07 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:34:07 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk"/>
Nov 30 12:34:07 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:34:07 user nova-compute[75672]:     </disk>
Nov 30 12:34:07 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:34:07 user nova-compute[75672]:       <mac address="fa:16:3e:5b:7d:cb"/>
Nov 30 12:34:07 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:34:07 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:34:07 user nova-compute[75672]:       <target dev="tapd229eaa1-29"/>
Nov 30 12:34:07 user nova-compute[75672]:     </interface>
Nov 30 12:34:07 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:34:07 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/console.log" append="off"/>
Nov 30 12:34:07 user nova-compute[75672]:     </serial>
Nov 30 12:34:07 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:34:07 user nova-compute[75672]:     <video>
Nov 30 12:34:07 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:34:07 user nova-compute[75672]:     </video>
Nov 30 12:34:07 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:34:07 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:34:07 user nova-compute[75672]:     </rng>
Nov 30 12:34:07 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:34:07 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:34:07 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:34:07 user nova-compute[75672]:     </memballoon>
Nov 30 12:34:07 user nova-compute[75672]:   </devices>
Nov 30 12:34:07 user nova-compute[75672]: </domain>
Nov 30 12:34:07 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-711672773',display_name='tempest-TestMinimumBasicScenario-server-711672773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-711672773',id=14,image_ref='c866fbbf-29c3-4e1b-8464-0648755b20e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOniC84tdYnYlJswjjRC4kKmNmB0tBzcdJaPVjXX2wcc4T+DibHFv1jYbqqzIDwZXYmRjVVueGyQD3b6liZnaDVWOLMtKxt+1Icj/6dsoFWFdwDT8Mgl2jBx4KBOz3cFsQ==',key_name='tempest-TestMinimumBasicScenario-2113508187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc2e7dfcbff457c9e394b1e5d0d23e6',ramdisk_id='',reservation_id='r-ekl1jzdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c866fbbf-29c3-4e1b-8464-0648755b20e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-950497565',owner_user_name='tempest-TestMinimumBasicScenario-950497565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:34:04Z,user_data=None,user_id='c663fb001aa64ec6a8e5861449ec2bbb',uuid=4382544b-6fb7-4164-9b6b-302a6e24bc52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converting VIF {"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:7d:cb,bridge_name='br-int',has_traffic_filtering=True,id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd229eaa1-29') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG os_vif [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:7d:cb,bridge_name='br-int',has_traffic_filtering=True,id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd229eaa1-29') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffd5efad-3897-5686-b169-b8dc69c4c3c4', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd229eaa1-29, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd229eaa1-29, col_values=(('qos', UUID('e2aeeaac-a86b-4be2-88f1-dca244fae061')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd229eaa1-29, col_values=(('external_ids', {'iface-id': 'd229eaa1-29dc-4b3f-b468-d5a8f24d7514', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:7d:cb', 'vm-uuid': '4382544b-6fb7-4164-9b6b-302a6e24bc52'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:34:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:08 user nova-compute[75672]: INFO os_vif [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:7d:cb,bridge_name='br-int',has_traffic_filtering=True,id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd229eaa1-29')
Nov 30 12:34:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:34:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] No VIF found with MAC fa:16:3e:5b:7d:cb, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:34:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-13355bf1-2bec-4c02-be7c-d418defd306c req-140701da-ebc7-40fb-90cc-4cf0d327c53d service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received event network-changed-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:34:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-13355bf1-2bec-4c02-be7c-d418defd306c req-140701da-ebc7-40fb-90cc-4cf0d327c53d service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Refreshing instance network info cache due to event network-changed-d229eaa1-29dc-4b3f-b468-d5a8f24d7514. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:34:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-13355bf1-2bec-4c02-be7c-d418defd306c req-140701da-ebc7-40fb-90cc-4cf0d327c53d service nova] Acquiring lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:34:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-13355bf1-2bec-4c02-be7c-d418defd306c req-140701da-ebc7-40fb-90cc-4cf0d327c53d service nova] Acquired lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:34:08 user nova-compute[75672]: DEBUG nova.network.neutron [req-13355bf1-2bec-4c02-be7c-d418defd306c req-140701da-ebc7-40fb-90cc-4cf0d327c53d service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Refreshing network info cache for port d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:34:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-13355bf1-2bec-4c02-be7c-d418defd306c req-140701da-ebc7-40fb-90cc-4cf0d327c53d service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updated VIF entry in instance network info cache for port d229eaa1-29dc-4b3f-b468-d5a8f24d7514. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:34:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-13355bf1-2bec-4c02-be7c-d418defd306c req-140701da-ebc7-40fb-90cc-4cf0d327c53d service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updating instance_info_cache with network_info: [{"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:34:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-13355bf1-2bec-4c02-be7c-d418defd306c req-140701da-ebc7-40fb-90cc-4cf0d327c53d service nova] Releasing lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:34:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:10 user nova-compute[75672]: DEBUG nova.compute.manager [req-33943c8c-72e9-438f-b1de-8626f625ef70 req-c2df917a-2391-4b5f-b483-6949a99ba22e service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received event network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:34:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-33943c8c-72e9-438f-b1de-8626f625ef70 req-c2df917a-2391-4b5f-b483-6949a99ba22e service nova] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-33943c8c-72e9-438f-b1de-8626f625ef70 req-c2df917a-2391-4b5f-b483-6949a99ba22e service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-33943c8c-72e9-438f-b1de-8626f625ef70 req-c2df917a-2391-4b5f-b483-6949a99ba22e service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:10 user nova-compute[75672]: DEBUG nova.compute.manager [req-33943c8c-72e9-438f-b1de-8626f625ef70 req-c2df917a-2391-4b5f-b483-6949a99ba22e service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] No waiting events found dispatching network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:34:10 user nova-compute[75672]: WARNING nova.compute.manager [req-33943c8c-72e9-438f-b1de-8626f625ef70 req-c2df917a-2391-4b5f-b483-6949a99ba22e service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received unexpected event network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 for instance with vm_state building and task_state spawning.
Nov 30 12:34:10 user nova-compute[75672]: DEBUG nova.compute.manager [req-33943c8c-72e9-438f-b1de-8626f625ef70 req-c2df917a-2391-4b5f-b483-6949a99ba22e service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received event network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:34:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-33943c8c-72e9-438f-b1de-8626f625ef70 req-c2df917a-2391-4b5f-b483-6949a99ba22e service nova] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-33943c8c-72e9-438f-b1de-8626f625ef70 req-c2df917a-2391-4b5f-b483-6949a99ba22e service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-33943c8c-72e9-438f-b1de-8626f625ef70 req-c2df917a-2391-4b5f-b483-6949a99ba22e service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:10 user nova-compute[75672]: DEBUG nova.compute.manager [req-33943c8c-72e9-438f-b1de-8626f625ef70 req-c2df917a-2391-4b5f-b483-6949a99ba22e service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] No waiting events found dispatching network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:34:10 user nova-compute[75672]: WARNING nova.compute.manager [req-33943c8c-72e9-438f-b1de-8626f625ef70 req-c2df917a-2391-4b5f-b483-6949a99ba22e service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received unexpected event network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 for instance with vm_state building and task_state spawning.
Nov 30 12:34:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUelhcGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:34:12 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:12 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:12 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af1bf92-ec88-4569-b209-8e7de6f25860]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:34:12 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eddbf4f-1194-46ca-9015-1e9acc80d64b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94] added
Nov 30 12:34:12 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[474e3077-7f1a-4f8c-9023-9c90c64a0298]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1895836a-42fe-4781-845f-35e8d7edae4b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CUelhcGD {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:34:12 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Instance spawned successfully.
Nov 30 12:34:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CUelhcGD" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c1a99b-aa63-41b4-8cde-bfce2cb93423]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CUelhcGD'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec74ebba-09ab-4f7d-bf2f-5bfdd53f1527]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[169f4c97-aadd-4fb2-be64-17383d83ae63]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:12 user nova-compute[75672]: INFO nova.compute.manager [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Took 8.15 seconds to spawn the instance on the hypervisor.
Nov 30 12:34:12 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:34:12 user nova-compute[75672]: INFO nova.compute.manager [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Took 9.23 seconds to build instance.
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bce8c7-4b93-4bcc-82aa-2c966462b680]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94, portal: 172.16.0.220,3260]
Nov 30 12:34:12 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94, portal: 172.16.0.220,3260] successful.
Nov 30 12:34:12 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1346c39e-5135-4e80-b59c-e59695774d1d tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.357s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d42ffbf-d9e8-451d-9446-8e2b50d56c55]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce5781d-30cb-475c-9000-77215cc5017d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:12 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f5e71c-6883-47fa-9289-fb25f6e1fbba]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUelhcGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG nova.objects.instance [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lazy-loading 'flavor' on Instance uuid 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITrOCmRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:34:12 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:13 user nova-compute[75672]: INFO nova.compute.manager [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Attaching volume 37f813a8-e552-47ec-8fc3-7d5b25fd1e1d to /dev/sdc
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.utils [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9004ba0-9c3c-4a25-a2fd-51189a65df58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94b3b60-a152-41e7-ae1b-dfb3dec2a7cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f8d6c3-6268-435e-b004-13542a23a757]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6779cad-ef4a-41ab-bbf3-e9df274e80ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:34:13 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc6fe25-2711-4c41-a91a-80e37bfe032e]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.utils [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Updating existing volume attachment record: 42227fb2-d596-4a8b-a73f-f4838a49b110 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '23631633436333963', 'path': '/dev/sdj'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631633436333963', 'path': '/dev/sdj'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.772s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:13 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:13 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG nova.objects.instance [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lazy-loading 'flavor' on Instance uuid 85f7c21c-b973-422f-a10c-8fb3635879f4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0a1e75-f6f3-451d-8939-f88d6c5c072f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:34:13 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4647dc-886f-432e-9354-ed4a988cc922]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1] added
Nov 30 12:34:13 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:34:13 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:34:13 user nova-compute[75672]:   <source dev="/dev/sdj"/>
Nov 30 12:34:13 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:34:13 user nova-compute[75672]:   <serial>db1ae54f-0797-4105-8fd4-425852e86c94</serial>
Nov 30 12:34:13 user nova-compute[75672]: </disk>
Nov 30 12:34:13 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc42e034-b2f4-4f58-9ccc-ff4e327a2c61]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2eba190-d674-4143-b5d7-e797db28e634]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITrOCmRv {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITrOCmRv" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce52cd94-60f8-4d58-b5d3-d39e3d8fdf5e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ITrOCmRv'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[519df46e-4681-43ff-b251-c0b7a100c0cd]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fb75c8-0dbd-4015-9f56-b2381a069e46]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:13 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:13 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:13 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3423f71-b6f1-446e-97a6-599e14bd0d44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260]
Nov 30 12:34:13 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260] successful.
Nov 30 12:34:13 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[31da74bf-728f-419e-9d11-36030377ba89]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9bbb0c-ec5f-4c06-ad59-69ca4e41040b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:14 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:14 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:14 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e493d80-7d35-40fa-a17f-29032c43a0dc]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITrOCmRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] No VIF found with MAC fa:16:3e:30:a9:02, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-208a2167-f0f8-473c-8a89-331d5991308c tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.091s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-e1b9a83e-85a2-4a2a-9dcd-e780387061e0 req-3066c275-ac13-4633-90c6-baa552039d15 service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received event network-changed-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-e1b9a83e-85a2-4a2a-9dcd-e780387061e0 req-3066c275-ac13-4633-90c6-baa552039d15 service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Refreshing instance network info cache due to event network-changed-32c6ac7e-d869-4c4a-8d1a-3419048d9a00. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e1b9a83e-85a2-4a2a-9dcd-e780387061e0 req-3066c275-ac13-4633-90c6-baa552039d15 service nova] Acquiring lock "refresh_cache-22619e89-6f9e-402b-9a73-2af94c1e59a5" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e1b9a83e-85a2-4a2a-9dcd-e780387061e0 req-3066c275-ac13-4633-90c6-baa552039d15 service nova] Acquired lock "refresh_cache-22619e89-6f9e-402b-9a73-2af94c1e59a5" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:34:14 user nova-compute[75672]: DEBUG nova.network.neutron [req-e1b9a83e-85a2-4a2a-9dcd-e780387061e0 req-3066c275-ac13-4633-90c6-baa552039d15 service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Refreshing network info cache for port 32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] <== connect_volume: return (2233ms) {'type': 'block', 'scsi_wwn': '23465343936646264', 'path': '/dev/sdk'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465343936646264', 'path': '/dev/sdk'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG nova.objects.instance [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lazy-loading 'flavor' on Instance uuid 84f3ca7c-05db-4714-a685-3598bc6134d3 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:34:15 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:34:15 user nova-compute[75672]:   <source dev="/dev/sdk"/>
Nov 30 12:34:15 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:34:15 user nova-compute[75672]:   <serial>2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1</serial>
Nov 30 12:34:15 user nova-compute[75672]: </disk>
Nov 30 12:34:15 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Acquiring lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG nova.objects.instance [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lazy-loading 'flavor' on Instance uuid 22619e89-6f9e-402b-9a73-2af94c1e59a5 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG nova.network.neutron [req-e1b9a83e-85a2-4a2a-9dcd-e780387061e0 req-3066c275-ac13-4633-90c6-baa552039d15 service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Updated VIF entry in instance network info cache for port 32c6ac7e-d869-4c4a-8d1a-3419048d9a00. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG nova.network.neutron [req-e1b9a83e-85a2-4a2a-9dcd-e780387061e0 req-3066c275-ac13-4633-90c6-baa552039d15 service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Updating instance_info_cache with network_info: [{"id": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "address": "fa:16:3e:47:90:40", "network": {"id": "4eae53c3-fc97-4624-ac91-68d53774ad23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1034722699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb448f77dbf143d59589139add90ff93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c6ac7e-d8", "ovs_interfaceid": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.435s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e1b9a83e-85a2-4a2a-9dcd-e780387061e0 req-3066c275-ac13-4633-90c6-baa552039d15 service nova] Releasing lock "refresh_cache-22619e89-6f9e-402b-9a73-2af94c1e59a5" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] No VIF found with MAC fa:16:3e:36:eb:96, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "85f7c21c-b973-422f-a10c-8fb3635879f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Acquiring lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:15 user nova-compute[75672]: INFO nova.compute.manager [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Attaching volume 9dc045c5-352c-42c8-9ca1-b4617b007ccb to /dev/vdb
Nov 30 12:34:15 user nova-compute[75672]: INFO nova.compute.manager [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Detaching volume db1ae54f-0797-4105-8fd4-425852e86c94
Nov 30 12:34:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-07456308-0be6-4149-8d8d-903e0f34e335 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.351s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG os_brick.utils [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7d3006-6ecc-461e-bbb3-00ec12109ae1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:16 user nova-compute[75672]: INFO nova.virt.block_device [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Attempting to driver detach volume db1ae54f-0797-4105-8fd4-425852e86c94 from mountpoint /dev/vdb
Nov 30 12:34:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Attempting to detach device vdb from instance 85f7c21c-b973-422f-a10c-8fb3635879f4 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:34:16 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:34:16 user nova-compute[75672]:   <source dev="/dev/sdj"/>
Nov 30 12:34:16 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:34:16 user nova-compute[75672]:   <serial>db1ae54f-0797-4105-8fd4-425852e86c94</serial>
Nov 30 12:34:16 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:34:16 user nova-compute[75672]: </disk>
Nov 30 12:34:16 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4f685f-31c1-45b0-80d1-63b46fb4ed2a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Successfully detached device vdb from instance 85f7c21c-b973-422f-a10c-8fb3635879f4 from the persistent domain config.
Nov 30 12:34:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85f7c21c-b973-422f-a10c-8fb3635879f4 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:34:16 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:34:16 user nova-compute[75672]:   <source dev="/dev/sdj"/>
Nov 30 12:34:16 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:34:16 user nova-compute[75672]:   <serial>db1ae54f-0797-4105-8fd4-425852e86c94</serial>
Nov 30 12:34:16 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:34:16 user nova-compute[75672]: </disk>
Nov 30 12:34:16 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d2c4e6-1179-42d2-85b7-1c6a6888889f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee7cf6e-2e9e-4f1f-b249-bf2003a507cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:34:16 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:34:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[246bcf5f-3486-4061-90e0-df78c8148822]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG os_brick.utils [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Updating existing volume attachment record: 900293ed-091a-46f3-8a3b-3f6989ac4e19 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:34:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85f7c21c-b973-422f-a10c-8fb3635879f4 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG os_brick.utils [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fdca00-ae5d-4344-9818-b0567eb620d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[74471fc3-3f0c-492a-bf53-884024d706e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bce39ef-f3aa-404f-8c1f-564d7c6cd8a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07afbc4-64db-4a2c-a0bc-eab153771b08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:34:17 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:34:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19405d0-e094-48bf-8c5b-d25c35d44fa9]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:34:17 user nova-compute[75672]: DEBUG os_brick.utils [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:34:17 user nova-compute[75672]: INFO nova.compute.manager [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Swapping volume 2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 for 0e688476-b04e-44a5-9fab-48541ef39528
Nov 30 12:34:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hugRevXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84f3ca7c-05db-4714-a685-3598bc6134d3', 'attached_at': '', 'detached_at': '', 'volume_id': '0e688476-b04e-44a5-9fab-48541ef39528', 'serial': '0e688476-b04e-44a5-9fab-48541ef39528'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITrOCmRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '84f3ca7c-05db-4714-a685-3598bc6134d3', 'attached_at': '', 'detached_at': '', 'volume_id': '2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 'serial'} {{(pid=75672) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hugRevXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:34:27 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:27 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:27 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82bc20d-d3f1-4acf-aa4e-629088589b0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:34:27 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b3228e-8be2-430e-a47c-d9f378958284]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528] added
Nov 30 12:34:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.064s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5c6ae6-0051-4edd-a23d-63188d6d80f8]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e48b94c-ff79-4b80-8c45-6e7108122e6b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hugRevXO {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hugRevXO" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e986fd-2c3e-498d-b2bd-7707e4ea4d1c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hugRevXO'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.213s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6822159-32ae-453d-8d60-1891f569b965]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[07febddc-b42e-4e3c-a063-d50a7e30ded5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5bd2ca-fd04-462e-8a4b-c8e587914edb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528, portal: 172.16.0.220,3260]
Nov 30 12:34:28 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528, portal: 172.16.0.220,3260] successful.
Nov 30 12:34:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.147s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a867e8-629d-4245-971f-a3dae68b9a04]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd04550e-6ec6-495d-976f-a86c1af2d8af]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.763s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] HCTL ('43', '-', '-', 0) found on session 12 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7984a3-9030-4870-a027-dcabf9908883]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Searching for a device in session 12 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hugRevXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:34:28 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:34:29 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Updating instance_info_cache with network_info: [{"id": "890df6ae-1036-4cfd-b155-04a5c16f093c", "address": "fa:16:3e:9e:f7:d3", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890df6ae-10", "ovs_interfaceid": "890df6ae-1036-4cfd-b155-04a5c16f093c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:34:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:34:29 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:34:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.806s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] <== connect_volume: return (1808ms) {'type': 'block', 'scsi_wwn': '26134336230633033', 'path': '/dev/sdl'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:34:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134336230633033', 'path': '/dev/sdl'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:34:29 user nova-compute[75672]: DEBUG nova.objects.instance [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lazy-loading 'flavor' on Instance uuid 84f3ca7c-05db-4714-a685-3598bc6134d3 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:34:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Checking UEFI support for host arch (x86_64) {{(pid=75672) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 30 12:34:29 user nova-compute[75672]: INFO nova.virt.libvirt.host [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] UEFI support detected
Nov 30 12:34:29 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:34:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 101711872 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:30 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:34:30 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:34:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 266338304 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 402653184 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:31 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:34:31 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:34:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:31 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:34:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 500170752 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:34:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 675282944 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 873463808 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 1042284544 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.250s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITrOCmRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:34:34 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[86212caf-133d-4372-85d3-ca714927f030]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:34:34 user nova-compute[75672]: No targets found.
Nov 30 12:34:34 user nova-compute[75672]: iSNS:
Nov 30 12:34:34 user nova-compute[75672]: No targets found.
Nov 30 12:34:34 user nova-compute[75672]: STATIC:
Nov 30 12:34:34 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:34:34 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:34 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:34 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528
Nov 30 12:34:34 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:34 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:34 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63
Nov 30 12:34:34 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:34 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:34 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f
Nov 30 12:34:34 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:34 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:34 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1
Nov 30 12:34:34 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:34 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:34 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b
Nov 30 12:34:34 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:34 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:34 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629
Nov 30 12:34:34 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:34 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:34 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:34:34 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:34 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:34 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71
Nov 30 12:34:34 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:34 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:34 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c
Nov 30 12:34:34 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:34 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:34 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94
Nov 30 12:34:34 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:34 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:34 user nova-compute[75672]: FIRMWARE:
Nov 30 12:34:34 user nova-compute[75672]: No targets found.
Nov 30 12:34:34 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:34:34 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:34:34 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cb494b-a085-4078-a09e-3dfe1d51d4f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0590f47-6f30-48bf-974f-ff2c011bffb6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:34 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd475ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1'): ({'sdk'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Removing single pathed devices sdk {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95875c0-e7cb-425b-82d7-f92854b3ed61]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae8772e-e6b8-4bb5-b2d5-2fae81c09da5]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Flushing IO for device /dev/sdk {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9355c74c-e218-4bb2-9a92-d4551788f23b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.039s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c49dbee-ce83-49b6-a674-d7c76313d16d]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] SCSI volumes sdk have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9d23a2-49fe-49b6-84ca-cd510be13dae]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ae358a-b09f-4f1d-aa78-f4ced8337c5b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260]
Nov 30 12:34:34 user nova-compute[75672]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260] successful.
Nov 30 12:34:34 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8ee23f-2ef5-4ce4-b6f7-23eb66f005df]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] <== disconnect_volume: return (410ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hugRevXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': '84f3ca7c-05db-4714-a685-3598bc6134d3', 'attached_at': '', 'detached_at': '', 'volume_id': '0e688476-b04e-44a5-9fab-48541ef39528', 'serial'} {{(pid=75672) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] swap_volume: removing Cinder connection for volume 2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 {{(pid=75672) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG nova.compute.manager [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] swap_volume: Updating volume 2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "hugRevXO", "auth_password": "Sc7C4lxzObW1HV", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdl", "volume_id": "0e688476-b04e-44a5-9fab-48541ef39528"}, "status": "reserved", "instance": "84f3ca7c-05db-4714-a685-3598bc6134d3", "attached_at": "", "detached_at": "", "volume_id": "0e688476-b04e-44a5-9fab-48541ef39528", "serial": "0e688476-b04e-44a5-9fab-48541ef39528"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0e688476-b04e-44a5-9fab-48541ef39528', 'no_device': None, 'attachment_id': 'cea80f30-1d45-4f08-8095-c6561ef1131b'} {{(pid=75672) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-271bc6c7-72c4-4b1c-9d4b-8601e57bb2c1 tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.684s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Acquiring lock "e1542356-c1bb-46db-8570-94958f48ab83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "e1542356-c1bb-46db-8570-94958f48ab83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Acquiring lock "e1542356-c1bb-46db-8570-94958f48ab83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "e1542356-c1bb-46db-8570-94958f48ab83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "e1542356-c1bb-46db-8570-94958f48ab83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:35 user nova-compute[75672]: INFO nova.compute.manager [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Terminating instance
Nov 30 12:34:35 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmDMXsqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:34:36 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:36 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:36 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTCnaAdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:34:36 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e8f109-2c07-4d25-a79d-d972125f9d54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:34:36 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[795be92c-c0f0-4e63-a977-c20ef9d1eca1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d] added
Nov 30 12:34:36 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa91ae66-9274-439f-9df2-cd91e6015dbe]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02e77d8-55d3-4b59-ba55-7ca1d2478b4e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmDMXsqo {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmDMXsqo" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b063f5-5dc5-4344-b8e1-3a394fff988c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SmDMXsqo'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30031b8-3c22-49f1-a4f5-b5074c6709a3]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[56019973-13e9-4b07-857d-3b4da9d94b4c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-792f66c8-afc3-469c-bc72-6b3e3b3e2f4f req-5937083c-74af-4609-bbc6-477e32847764 service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Received event network-vif-unplugged-c7416931-8e4f-4050-8639-9afe7daa7e2e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-792f66c8-afc3-469c-bc72-6b3e3b3e2f4f req-5937083c-74af-4609-bbc6-477e32847764 service nova] Acquiring lock "e1542356-c1bb-46db-8570-94958f48ab83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-792f66c8-afc3-469c-bc72-6b3e3b3e2f4f req-5937083c-74af-4609-bbc6-477e32847764 service nova] Lock "e1542356-c1bb-46db-8570-94958f48ab83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-792f66c8-afc3-469c-bc72-6b3e3b3e2f4f req-5937083c-74af-4609-bbc6-477e32847764 service nova] Lock "e1542356-c1bb-46db-8570-94958f48ab83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-792f66c8-afc3-469c-bc72-6b3e3b3e2f4f req-5937083c-74af-4609-bbc6-477e32847764 service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] No waiting events found dispatching network-vif-unplugged-c7416931-8e4f-4050-8639-9afe7daa7e2e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-792f66c8-afc3-469c-bc72-6b3e3b3e2f4f req-5937083c-74af-4609-bbc6-477e32847764 service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Received event network-vif-unplugged-c7416931-8e4f-4050-8639-9afe7daa7e2e for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ffa7be-a87a-432f-aa26-66fa14f58746]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d, portal: 172.16.0.220,3260]
Nov 30 12:34:36 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d, portal: 172.16.0.220,3260] successful.
Nov 30 12:34:36 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80d1829-b9d3-4997-9b03-ffa17bb96af6]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6ebc25-6671-4570-8cf2-72eea62f70cc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 85f7c21c-b973-422f-a10c-8fb3635879f4 is timed out.
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.utils [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:36 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.518s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Successfully detached device vdb from instance 85f7c21c-b973-422f-a10c-8fb3635879f4 from the live domain config.
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6731a44-8cfe-4273-9e4c-9d7c2e260aef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUelhcGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:34:36 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf07a75-8b27-4a17-8685-29f6a1c1d607]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmDMXsqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a51a6de-b772-4c81-a8a1-35ad0a74461a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d82e24d-96f3-4e15-b846-fe9043610640]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[438f6dd0-222c-489e-ac17-873c3f620901]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:34:36 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[31900b40-86b2-4a13-bee4-016ec596c952]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_brick.utils [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:34:36 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Instance destroyed successfully.
Nov 30 12:34:36 user nova-compute[75672]: DEBUG nova.objects.instance [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lazy-loading 'resources' on Instance uuid e1542356-c1bb-46db-8570-94958f48ab83 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-371365079',display_name='tempest-VolumesActionsTest-instance-371365079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-371365079',id=10,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:32:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fce81245b66a491e9e2d180432fe23f6',ramdisk_id='',reservation_id='r-c86aqvym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-79059644',owner_user_name='tempest-VolumesActionsTest-79059644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:32:35Z,user_data=None,user_id='4d8657c2797c425a8d77f9843eec9928',uuid=e1542356-c1bb-46db-8570-94958f48ab83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "address": "fa:16:3e:41:4d:11", "network": {"id": "31fd3573-37a5-4451-b7d2-1a713d5c0c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-900830365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce81245b66a491e9e2d180432fe23f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7416931-8e", "ovs_interfaceid": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Converting VIF {"id": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "address": "fa:16:3e:41:4d:11", "network": {"id": "31fd3573-37a5-4451-b7d2-1a713d5c0c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-900830365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce81245b66a491e9e2d180432fe23f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7416931-8e", "ovs_interfaceid": "c7416931-8e4f-4050-8639-9afe7daa7e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:4d:11,bridge_name='br-int',has_traffic_filtering=True,id=c7416931-8e4f-4050-8639-9afe7daa7e2e,network=Network(31fd3573-37a5-4451-b7d2-1a713d5c0c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7416931-8e') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG os_vif [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4d:11,bridge_name='br-int',has_traffic_filtering=True,id=c7416931-8e4f-4050-8639-9afe7daa7e2e,network=Network(31fd3573-37a5-4451-b7d2-1a713d5c0c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7416931-8e') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7416931-8e, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b54828d2-a288-4fd3-b573-482f0395768e) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:36 user nova-compute[75672]: INFO os_vif [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4d:11,bridge_name='br-int',has_traffic_filtering=True,id=c7416931-8e4f-4050-8639-9afe7daa7e2e,network=Network(31fd3573-37a5-4451-b7d2-1a713d5c0c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7416931-8e')
Nov 30 12:34:36 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Deleting instance files /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83_del
Nov 30 12:34:36 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Deletion of /opt/stack/data/nova/instances/e1542356-c1bb-46db-8570-94958f48ab83_del complete
Nov 30 12:34:36 user nova-compute[75672]: INFO nova.compute.manager [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Swapping volume 0e688476-b04e-44a5-9fab-48541ef39528 for 2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:36 user nova-compute[75672]: INFO nova.compute.manager [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 30 12:34:36 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:34:36 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: e1542356-c1bb-46db-8570-94958f48ab83] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:34:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:34:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:34:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:34:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.997s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] <== connect_volume: return (2001ms) {'type': 'block', 'scsi_wwn': '26435653664323664', 'path': '/dev/sdk'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435653664323664', 'path': '/dev/sdk'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-18a0be20-5c15-4ec0-a041-393f5588e082 req-53c3be1c-d157-4150-b0a0-3940bb59287e service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Received event network-vif-deleted-c7416931-8e4f-4050-8639-9afe7daa7e2e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:34:38 user nova-compute[75672]: INFO nova.compute.manager [req-18a0be20-5c15-4ec0-a041-393f5588e082 req-53c3be1c-d157-4150-b0a0-3940bb59287e service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Neutron deleted interface c7416931-8e4f-4050-8639-9afe7daa7e2e; detaching it from the instance and deleting it from the info cache
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.network.neutron [req-18a0be20-5c15-4ec0-a041-393f5588e082 req-53c3be1c-d157-4150-b0a0-3940bb59287e service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.983s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:38 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:38 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:38 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Took 1.08 seconds to deallocate network for instance.
Nov 30 12:34:38 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:34:38 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=6469MB free_disk=25.274513244628906GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2157a659-1be7-46c8-a487-507b36fa4367]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:34:38 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-18a0be20-5c15-4ec0-a041-393f5588e082 req-53c3be1c-d157-4150-b0a0-3940bb59287e service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Detach interface failed, port_id=c7416931-8e4f-4050-8639-9afe7daa7e2e, reason: Instance e1542356-c1bb-46db-8570-94958f48ab83 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.objects.instance [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lazy-loading 'flavor' on Instance uuid 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9127f0-5d7d-48b2-843f-c783eadd68aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb] added
Nov 30 12:34:38 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:34:38 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:34:38 user nova-compute[75672]:   <source dev="/dev/sdk"/>
Nov 30 12:34:38 user nova-compute[75672]:   <target dev="sdc" bus="scsi"/>
Nov 30 12:34:38 user nova-compute[75672]:   <serial>37f813a8-e552-47ec-8fc3-7d5b25fd1e1d</serial>
Nov 30 12:34:38 user nova-compute[75672]:   <address type="drive" controller="0" unit="2"/>
Nov 30 12:34:38 user nova-compute[75672]: </disk>
Nov 30 12:34:38 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0432f32e-b887-4db2-bf83-667dc1bd3b55]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2994563c-3f87-4fee-be44-c092f22d7a83]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTCnaAdr {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTCnaAdr" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[967a1108-96ed-4721-a3c1-57a46dcec81e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UTCnaAdr'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8566a95-117f-4851-a242-bf35a8843bfa]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 1fba8af1-8074-4ce8-be23-912e9850fc41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 85f7c21c-b973-422f-a10c-8fb3635879f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 84f3ca7c-05db-4714-a685-3598bc6134d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 22619e89-6f9e-402b-9a73-2af94c1e59a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance e1542356-c1bb-46db-8570-94958f48ab83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 35ef80cd-d7d8-421b-8296-44b107b1bce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d8328382-e998-44b8-9c34-a1dbf74746e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance c8333c65-42ab-4de2-abc4-6cc672746b2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 4382544b-6fb7-4164-9b6b-302a6e24bc52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[177ce520-24cf-42c0-b63b-8f59b0303cf5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7baca0-e80d-4cce-8298-1edae6736005]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb, portal: 172.16.0.220,3260]
Nov 30 12:34:38 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb, portal: 172.16.0.220,3260] successful.
Nov 30 12:34:38 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[730e553a-f6a8-4b0e-9117-68f7e47aeb6b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3790be4-b072-41e4-940c-8f00e2063f8b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:38 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] HCTL ('44', '-', '-', 0) found on session 14 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1269d627-62ad-46d4-aeec-89c23a39a941]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Searching for a device in session 14 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTCnaAdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-ffadd708-4967-46f9-8db2-bd61f428b5cb req-8c29baa6-4339-4f35-8fb8-9dbc8af7c981 service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Received event network-vif-plugged-c7416931-8e4f-4050-8639-9afe7daa7e2e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ffadd708-4967-46f9-8db2-bd61f428b5cb req-8c29baa6-4339-4f35-8fb8-9dbc8af7c981 service nova] Acquiring lock "e1542356-c1bb-46db-8570-94958f48ab83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ffadd708-4967-46f9-8db2-bd61f428b5cb req-8c29baa6-4339-4f35-8fb8-9dbc8af7c981 service nova] Lock "e1542356-c1bb-46db-8570-94958f48ab83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ffadd708-4967-46f9-8db2-bd61f428b5cb req-8c29baa6-4339-4f35-8fb8-9dbc8af7c981 service nova] Lock "e1542356-c1bb-46db-8570-94958f48ab83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-ffadd708-4967-46f9-8db2-bd61f428b5cb req-8c29baa6-4339-4f35-8fb8-9dbc8af7c981 service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] No waiting events found dispatching network-vif-plugged-c7416931-8e4f-4050-8639-9afe7daa7e2e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:34:38 user nova-compute[75672]: WARNING nova.compute.manager [req-ffadd708-4967-46f9-8db2-bd61f428b5cb req-8c29baa6-4339-4f35-8fb8-9dbc8af7c981 service nova] [instance: e1542356-c1bb-46db-8570-94958f48ab83] Received unexpected event network-vif-plugged-c7416931-8e4f-4050-8639-9afe7daa7e2e for instance with vm_state deleted and task_state None.
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] No BDM found with device name sda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] No VIF found with MAC fa:16:3e:40:c9:b1, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9470fe9c-e26f-43ac-b5f1-833b5b4263d1 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.720s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.692s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.613s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:39 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Deleted allocations for instance e1542356-c1bb-46db-8570-94958f48ab83
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:39 user nova-compute[75672]: INFO nova.compute.manager [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Detaching volume 37f813a8-e552-47ec-8fc3-7d5b25fd1e1d
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f1e5664d-682d-4896-93f5-ff2d3e53435f tempest-VolumesActionsTest-79059644 tempest-VolumesActionsTest-79059644-project-member] Lock "e1542356-c1bb-46db-8570-94958f48ab83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.527s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:39 user nova-compute[75672]: INFO nova.virt.block_device [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Attempting to driver detach volume 37f813a8-e552-47ec-8fc3-7d5b25fd1e1d from mountpoint /dev/sdc
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] <== connect_volume: return (3414ms) {'type': 'block', 'scsi_wwn': '23132383031343539', 'path': '/dev/sdm'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132383031343539', 'path': '/dev/sdm'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.898s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Attempting to detach device sdc from instance 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:34:39 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:34:39 user nova-compute[75672]:   <source dev="/dev/sdk"/>
Nov 30 12:34:39 user nova-compute[75672]:   <target dev="sdc" bus="scsi"/>
Nov 30 12:34:39 user nova-compute[75672]:   <serial>37f813a8-e552-47ec-8fc3-7d5b25fd1e1d</serial>
Nov 30 12:34:39 user nova-compute[75672]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 30 12:34:39 user nova-compute[75672]: </disk>
Nov 30 12:34:39 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG nova.objects.instance [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lazy-loading 'flavor' on Instance uuid 22619e89-6f9e-402b-9a73-2af94c1e59a5 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:34:39 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Successfully detached device sdc from instance 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 from the persistent domain config.
Nov 30 12:34:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:34:39 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:34:39 user nova-compute[75672]:   <source dev="/dev/sdk"/>
Nov 30 12:34:39 user nova-compute[75672]:   <target dev="sdc" bus="scsi"/>
Nov 30 12:34:39 user nova-compute[75672]:   <serial>37f813a8-e552-47ec-8fc3-7d5b25fd1e1d</serial>
Nov 30 12:34:39 user nova-compute[75672]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 30 12:34:39 user nova-compute[75672]: </disk>
Nov 30 12:34:39 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad18142a-18cc-479a-882c-df3aa395b386]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:34:39 user nova-compute[75672]: No targets found.
Nov 30 12:34:39 user nova-compute[75672]: iSNS:
Nov 30 12:34:39 user nova-compute[75672]: No targets found.
Nov 30 12:34:39 user nova-compute[75672]: STATIC:
Nov 30 12:34:39 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:34:39 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:39 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:39 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d
Nov 30 12:34:39 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:39 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:39 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528
Nov 30 12:34:39 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:39 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:39 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63
Nov 30 12:34:39 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:39 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:39 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f
Nov 30 12:34:39 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:39 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:39 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b
Nov 30 12:34:39 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:39 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:39 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629
Nov 30 12:34:39 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:39 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:39 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb
Nov 30 12:34:39 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:39 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:39 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:34:39 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:39 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:39 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71
Nov 30 12:34:39 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:39 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:39 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c
Nov 30 12:34:39 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:39 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:39 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94
Nov 30 12:34:39 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:39 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:39 user nova-compute[75672]: FIRMWARE:
Nov 30 12:34:39 user nova-compute[75672]: No targets found.
Nov 30 12:34:39 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:34:39 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:34:39 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] attach device xml: <disk type="block" device="disk">
Nov 30 12:34:39 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:34:39 user nova-compute[75672]:   <source dev="/dev/sdm"/>
Nov 30 12:34:39 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:34:39 user nova-compute[75672]:   <serial>9dc045c5-352c-42c8-9ca1-b4617b007ccb</serial>
Nov 30 12:34:39 user nova-compute[75672]: </disk>
Nov 30 12:34:39 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[75573792-71f0-45e8-9265-9491c8cd7f53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd15ded8-6f9a-4ed9-96ad-bcffa04849b3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:39 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:39 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:39 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd450fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94'): ({'sdj'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Removing single pathed devices sdj {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b82eab-8e73-49be-8e95-6e409b564345]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c06b60b-463e-4aab-885d-dd0623fb02d2]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Flushing IO for device /dev/sdj {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd85759-124b-4d36-a26f-e4ef8deff333]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.042s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cfb08b-f28a-4bab-92b8-3412f3a3ee45]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] SCSI volumes sdj have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c544ed-d271-435a-80b7-7c0c9187653c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8950bef1-a961-4d54-814f-d69c5b2b1507]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94, portal: 172.16.0.220,3260]
Nov 30 12:34:39 user nova-compute[75672]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94, portal: 172.16.0.220,3260] successful.
Nov 30 12:34:39 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1ae54f-0797-4105-8fd4-425852e86c94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.058s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ca8486-fac4-4bfd-b8b6-6013c00584ee]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.479s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] <== disconnect_volume: return (3378ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:34:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:34:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:34:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:34:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] No VIF found with MAC fa:16:3e:47:90:40, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:34:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cd681394-3425-4b7f-b67d-25bb7ba2148d tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.400s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:34:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c2106f5b-3191-416a-ad98-65110662e62c tempest-VolumesAssistedSnapshotsTest-1910015951 tempest-VolumesAssistedSnapshotsTest-1910015951-project] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] volume_snapshot_create: create_info: {'snapshot_id': '8823025a-5cfc-4c2b-83dc-d3e2225604b7', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75672) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3572}}
Nov 30 12:34:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c2106f5b-3191-416a-ad98-65110662e62c tempest-VolumesAssistedSnapshotsTest-1910015951 tempest-VolumesAssistedSnapshotsTest-1910015951-project] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] snap xml: <domainsnapshot>
Nov 30 12:34:41 user nova-compute[75672]:   <disks>
Nov 30 12:34:41 user nova-compute[75672]:     <disk name="/dev/sdm" snapshot="external" type="file">
Nov 30 12:34:41 user nova-compute[75672]:       <source file="/dev/new_file"/>
Nov 30 12:34:41 user nova-compute[75672]:     </disk>
Nov 30 12:34:41 user nova-compute[75672]:     <disk name="vda" snapshot="no"/>
Nov 30 12:34:41 user nova-compute[75672]:   </disks>
Nov 30 12:34:41 user nova-compute[75672]: </domainsnapshot>
Nov 30 12:34:41 user nova-compute[75672]:  {{(pid=75672) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3513}}
Nov 30 12:34:41 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c2106f5b-3191-416a-ad98-65110662e62c tempest-VolumesAssistedSnapshotsTest-1910015951 tempest-VolumesAssistedSnapshotsTest-1910015951-project] Lazy-loading 'system_metadata' on Instance uuid 22619e89-6f9e-402b-9a73-2af94c1e59a5 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:34:41 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c2106f5b-3191-416a-ad98-65110662e62c tempest-VolumesAssistedSnapshotsTest-1910015951 tempest-VolumesAssistedSnapshotsTest-1910015951-project] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [None req-c2106f5b-3191-416a-ad98-65110662e62c tempest-VolumesAssistedSnapshotsTest-1910015951 tempest-VolumesAssistedSnapshotsTest-1910015951-project] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Traceback (most recent call last):
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     rv = execute(f, *args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     six.reraise(c, e, tb)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     raise value
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     rv = meth(*args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] 
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [None req-c2106f5b-3191-416a-ad98-65110662e62c tempest-VolumesAssistedSnapshotsTest-1910015951 tempest-VolumesAssistedSnapshotsTest-1910015951-project] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Traceback (most recent call last):
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     self._volume_snapshot_create(context, instance, guest,
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     rv = execute(f, *args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     six.reraise(c, e, tb)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     raise value
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     rv = meth(*args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] 
Nov 30 12:34:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b300838b-ea62-408f-9ffd-fea90e89ff44 tempest-VolumesAssistedSnapshotsTest-1910015951 tempest-VolumesAssistedSnapshotsTest-1910015951-project] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] volume_snapshot_delete: delete_info: {'volume_id': '9dc045c5-352c-42c8-9ca1-b4617b007ccb'} {{(pid=75672) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3673}}
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [None req-b300838b-ea62-408f-9ffd-fea90e89ff44 tempest-VolumesAssistedSnapshotsTest-1910015951 tempest-VolumesAssistedSnapshotsTest-1910015951-project] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Traceback (most recent call last):
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5]     if delete_info['type'] != 'qcow2':
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] KeyError: 'type'
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] 
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [None req-c2106f5b-3191-416a-ad98-65110662e62c tempest-VolumesAssistedSnapshotsTest-1910015951 tempest-VolumesAssistedSnapshotsTest-1910015951-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 8823025a-5cfc-4c2b-83dc-d3e2225604b7 could not be found.
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     raise value
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver 
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver 
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 8823025a-5cfc-4c2b-83dc-d3e2225604b7 could not be found. (HTTP 404) (Request-ID: req-9c74033b-1d20-43b1-a7a9-fc97391313cc)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver 
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver 
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 8823025a-5cfc-4c2b-83dc-d3e2225604b7 could not be found.
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver 
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server [None req-c2106f5b-3191-416a-ad98-65110662e62c tempest-VolumesAssistedSnapshotsTest-1910015951 tempest-VolumesAssistedSnapshotsTest-1910015951-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3593, in volume_snapshot_create
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise value
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server 
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver [None req-b300838b-ea62-408f-9ffd-fea90e89ff44 tempest-VolumesAssistedSnapshotsTest-1910015951 tempest-VolumesAssistedSnapshotsTest-1910015951-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver 
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver 
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-3e229547-64a8-451a-abb5-f94f4cdbbb15)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver 
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver 
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 30 12:34:41 user nova-compute[75672]: ERROR nova.virt.libvirt.driver 
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server [None req-b300838b-ea62-408f-9ffd-fea90e89ff44 tempest-VolumesAssistedSnapshotsTest-1910015951 tempest-VolumesAssistedSnapshotsTest-1910015951-project] Exception during message handling: KeyError: 'type'
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3849, in volume_snapshot_delete
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 30 12:34:41 user nova-compute[75672]: ERROR oslo_messaging.rpc.server 
Nov 30 12:34:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Acquiring lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:42 user nova-compute[75672]: INFO nova.compute.manager [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Detaching volume 9dc045c5-352c-42c8-9ca1-b4617b007ccb
Nov 30 12:34:42 user nova-compute[75672]: INFO nova.virt.block_device [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Attempting to driver detach volume 9dc045c5-352c-42c8-9ca1-b4617b007ccb from mountpoint /dev/vdb
Nov 30 12:34:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Attempting to detach device vdb from instance 22619e89-6f9e-402b-9a73-2af94c1e59a5 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:34:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] detach device xml: <disk type="block" device="disk">
Nov 30 12:34:42 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:34:42 user nova-compute[75672]:   <source dev="/dev/sdm"/>
Nov 30 12:34:42 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:34:42 user nova-compute[75672]:   <serial>9dc045c5-352c-42c8-9ca1-b4617b007ccb</serial>
Nov 30 12:34:42 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:34:42 user nova-compute[75672]: </disk>
Nov 30 12:34:42 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:34:42 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Successfully detached device vdb from instance 22619e89-6f9e-402b-9a73-2af94c1e59a5 from the persistent domain config.
Nov 30 12:34:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22619e89-6f9e-402b-9a73-2af94c1e59a5 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:34:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] detach device xml: <disk type="block" device="disk">
Nov 30 12:34:42 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:34:42 user nova-compute[75672]:   <source dev="/dev/sdm"/>
Nov 30 12:34:42 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:34:42 user nova-compute[75672]:   <serial>9dc045c5-352c-42c8-9ca1-b4617b007ccb</serial>
Nov 30 12:34:42 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:34:42 user nova-compute[75672]: </disk>
Nov 30 12:34:42 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:34:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22619e89-6f9e-402b-9a73-2af94c1e59a5 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:34:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG nova.objects.instance [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lazy-loading 'flavor' on Instance uuid 85f7c21c-b973-422f-a10c-8fb3635879f4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f9d6a5b1-b586-4e97-be3e-739949c87741 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.453s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG nova.compute.manager [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITrOCmRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84f3ca7c-05db-4714-a685-3598bc6134d3', 'attached_at': '', 'detached_at': '', 'volume_id': '2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 'serial': '2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hugRevXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '0e688476-b04e-44a5-9fab-48541ef39528'}, 'status': 'reserved', 'instance': '84f3ca7c-05db-4714-a685-3598bc6134d3', 'attached_at': '', 'detached_at': '', 'volume_id': '0e688476-b04e-44a5-9fab-48541ef39528', 'serial'} {{(pid=75672) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITrOCmRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:34:48 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:48 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:48 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad03122e-e1b3-47d7-b832-8887a18e4c82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:34:48 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d38495-d792-4056-9e63-daeda04d145b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1] added
Nov 30 12:34:48 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42778bc-6aaa-4b4a-b07e-a6a375078527]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[570280eb-9156-42e7-8245-d6da2da4e28d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITrOCmRv {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITrOCmRv" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[712fbb3e-2652-4534-ba3b-09e621aa2537]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ITrOCmRv'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a12370-cc3c-41f6-ada2-8b609af3c2a1]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[17687b57-aed3-49d3-a7e1-9dfeb36219ec]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d86cdc-b729-4f1a-a971-b57c884c91f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260]
Nov 30 12:34:48 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260] successful.
Nov 30 12:34:48 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[113a2bc8-9035-40a5-922f-7f0fec0c2742]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4614e0-25cf-4e9b-aa21-baaf567a1b9c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:48 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] HCTL ('41', '-', '-', 0) found on session 15 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:34:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:49 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5df8e1f-30cf-4506-a87c-112958f10e4a]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:49 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Searching for a device in session 15 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:34:49 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITrOCmRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:34:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23465343936646264', 'path': '/dev/sdj'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:34:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465343936646264', 'path': '/dev/sdj'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:34:50 user nova-compute[75672]: DEBUG nova.objects.instance [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lazy-loading 'flavor' on Instance uuid 84f3ca7c-05db-4714-a685-3598bc6134d3 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:34:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 90177536 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 270532608 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:34:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 465567744 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 597688320 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 736100352 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 919601152 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hugRevXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '0e688476-b04e-44a5-9fab-48541ef39528'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:34:54 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c53163-3ab9-489b-af9b-9faf6cc56dfd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:34:54 user nova-compute[75672]: No targets found.
Nov 30 12:34:54 user nova-compute[75672]: iSNS:
Nov 30 12:34:54 user nova-compute[75672]: No targets found.
Nov 30 12:34:54 user nova-compute[75672]: STATIC:
Nov 30 12:34:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:34:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d
Nov 30 12:34:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528
Nov 30 12:34:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63
Nov 30 12:34:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f
Nov 30 12:34:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1
Nov 30 12:34:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b
Nov 30 12:34:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629
Nov 30 12:34:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb
Nov 30 12:34:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:34:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71
Nov 30 12:34:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c
Nov 30 12:34:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:34:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:34:54 user nova-compute[75672]: FIRMWARE:
Nov 30 12:34:54 user nova-compute[75672]: No targets found.
Nov 30 12:34:54 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:34:54 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:34:54 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7314d18-ce77-4ae0-a03f-e2252187dbbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0967cb5-ab2b-4fc1-8769-8699b73dcff1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:54 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:34:54 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:34:54 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcf4262d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528'): ({'sdl'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Removing single pathed devices sdl {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28ad922-ddb7-48d2-90d1-51064bddd470]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c3cd18-6b3c-40bc-aef4-f2f31ffccf77]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Flushing IO for device /dev/sdl {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b67f04-4291-4518-b87b-84155a10e509]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.039s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d5606d-f205-47ba-9580-1fc3d4225f46]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] SCSI volumes sdl have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc5c73b-950e-4814-b0be-7cfa0cd920ec]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f975790-4a17-401c-b184-83cde89b5b0a]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528, portal: 172.16.0.220,3260]
Nov 30 12:34:54 user nova-compute[75672]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528, portal: 172.16.0.220,3260] successful.
Nov 30 12:34:54 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e688476-b04e-44a5-9fab-48541ef39528 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a9c4a7-060d-4a98-8626-52dbc0452fcb]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] <== disconnect_volume: return (359ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG nova.compute.manager [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITrOCmRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '84f3ca7c-05db-4714-a685-3598bc6134d3', 'attached_at': '', 'detached_at': '', 'volume_id': '2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 'serial'} {{(pid=75672) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 30 12:34:54 user nova-compute[75672]: DEBUG nova.compute.manager [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] swap_volume: removing Cinder connection for volume 0e688476-b04e-44a5-9fab-48541ef39528 {{(pid=75672) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 30 12:34:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] swap_volume: Updating volume 0e688476-b04e-44a5-9fab-48541ef39528 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ITrOCmRv", "auth_password": "L70xIkRvPWw1mB", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1"}, "status": "reserved", "instance": "84f3ca7c-05db-4714-a685-3598bc6134d3", "attached_at": "", "detached_at": "", "volume_id": "2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1", "serial": "2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 'no_device': None, 'attachment_id': '6fc84cf2-4993-4e7b-8c9a-4be86c7badc5'} {{(pid=75672) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 30 12:34:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-31b04ae1-d6ef-485a-a535-230534cd6c7c tempest-TestVolumeSwap-247950043 tempest-TestVolumeSwap-247950043-project-admin] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.864s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:34:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:34:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:34:56 user nova-compute[75672]: INFO nova.compute.manager [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Detaching volume 2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1
Nov 30 12:34:56 user nova-compute[75672]: INFO nova.virt.block_device [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Attempting to driver detach volume 2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 from mountpoint /dev/vdb
Nov 30 12:34:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Attempting to detach device vdb from instance 84f3ca7c-05db-4714-a685-3598bc6134d3 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:34:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:34:56 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:34:56 user nova-compute[75672]:   <source dev="/dev/sdj"/>
Nov 30 12:34:56 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:34:56 user nova-compute[75672]:   <serial>2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1</serial>
Nov 30 12:34:56 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:34:56 user nova-compute[75672]: </disk>
Nov 30 12:34:56 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:34:56 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Successfully detached device vdb from instance 84f3ca7c-05db-4714-a685-3598bc6134d3 from the persistent domain config.
Nov 30 12:34:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84f3ca7c-05db-4714-a685-3598bc6134d3 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:34:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:34:56 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:34:56 user nova-compute[75672]:   <source dev="/dev/sdj"/>
Nov 30 12:34:56 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:34:56 user nova-compute[75672]:   <serial>2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1</serial>
Nov 30 12:34:56 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:34:56 user nova-compute[75672]: </disk>
Nov 30 12:34:56 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:34:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84f3ca7c-05db-4714-a685-3598bc6134d3 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:34:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:00 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 is timed out.
Nov 30 12:35:00 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Successfully detached device sdc from instance 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 from the live domain config.
Nov 30 12:35:00 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmDMXsqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:35:00 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a34876b-614e-4dbc-890a-5de9c3c7b319]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:35:00 user nova-compute[75672]: No targets found.
Nov 30 12:35:00 user nova-compute[75672]: iSNS:
Nov 30 12:35:00 user nova-compute[75672]: No targets found.
Nov 30 12:35:00 user nova-compute[75672]: STATIC:
Nov 30 12:35:00 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:35:00 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:00 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:00 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d
Nov 30 12:35:00 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:00 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:00 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63
Nov 30 12:35:00 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:00 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:00 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f
Nov 30 12:35:00 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:00 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:00 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1
Nov 30 12:35:00 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:00 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:00 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b
Nov 30 12:35:00 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:00 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:00 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629
Nov 30 12:35:00 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:00 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:00 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb
Nov 30 12:35:00 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:00 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:00 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:35:00 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:00 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:00 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71
Nov 30 12:35:00 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:00 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:00 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c
Nov 30 12:35:00 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:00 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:00 user nova-compute[75672]: FIRMWARE:
Nov 30 12:35:00 user nova-compute[75672]: No targets found.
Nov 30 12:35:00 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:35:00 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:35:00 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e34287-3ef2-4187-9c30-62905e606a9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f65c417-2b2c-4c9d-a973-61b437e5c585]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:00 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:00 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:00 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd4297f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d'): ({'sdk'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Removing single pathed devices sdk {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87df00c-89a2-48cc-9176-d8a619250fd7]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b11ab0-0383-4c5a-8451-f19e6764e925]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Flushing IO for device /dev/sdk {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc342621-17cc-4da0-8bf6-cb17fdde1c3c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.056s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb2d652-820d-448f-bebc-e589e73ed6c2]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] SCSI volumes sdk have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ad0a0a-b249-4bbc-9566-930c0f41319a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bfe28f-0c5c-40c7-a51a-14b3c695a68d]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d, portal: 172.16.0.220,3260]
Nov 30 12:35:00 user nova-compute[75672]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d, portal: 172.16.0.220,3260] successful.
Nov 30 12:35:00 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f813a8-e552-47ec-8fc3-7d5b25fd1e1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[959c82d1-424a-4d8f-a254-adf4858a75b8]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] <== disconnect_volume: return (383ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:35:00 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:35:01 user nova-compute[75672]: DEBUG nova.objects.instance [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lazy-loading 'flavor' on Instance uuid 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4e8ab129-b915-4fd5-9284-506d42655c1c tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.340s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:02 user nova-compute[75672]: INFO nova.compute.manager [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Terminating instance
Nov 30 12:35:02 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-8a857612-03c4-4711-ba01-69edebbaa79f req-589d9e5b-e333-4af8-a60b-ae9044d84add service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Received event network-vif-unplugged-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8a857612-03c4-4711-ba01-69edebbaa79f req-589d9e5b-e333-4af8-a60b-ae9044d84add service nova] Acquiring lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8a857612-03c4-4711-ba01-69edebbaa79f req-589d9e5b-e333-4af8-a60b-ae9044d84add service nova] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8a857612-03c4-4711-ba01-69edebbaa79f req-589d9e5b-e333-4af8-a60b-ae9044d84add service nova] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-8a857612-03c4-4711-ba01-69edebbaa79f req-589d9e5b-e333-4af8-a60b-ae9044d84add service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] No waiting events found dispatching network-vif-unplugged-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-8a857612-03c4-4711-ba01-69edebbaa79f req-589d9e5b-e333-4af8-a60b-ae9044d84add service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Received event network-vif-unplugged-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:02 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 22619e89-6f9e-402b-9a73-2af94c1e59a5 is timed out.
Nov 30 12:35:02 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Successfully detached device vdb from instance 22619e89-6f9e-402b-9a73-2af94c1e59a5 from the live domain config.
Nov 30 12:35:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTCnaAdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:35:02 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4396a0-e153-46d7-80c6-f8bbaa5fc5b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:35:02 user nova-compute[75672]: No targets found.
Nov 30 12:35:02 user nova-compute[75672]: iSNS:
Nov 30 12:35:02 user nova-compute[75672]: No targets found.
Nov 30 12:35:02 user nova-compute[75672]: STATIC:
Nov 30 12:35:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:35:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63
Nov 30 12:35:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f
Nov 30 12:35:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1
Nov 30 12:35:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b
Nov 30 12:35:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629
Nov 30 12:35:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb
Nov 30 12:35:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:35:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71
Nov 30 12:35:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c
Nov 30 12:35:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:02 user nova-compute[75672]: FIRMWARE:
Nov 30 12:35:02 user nova-compute[75672]: No targets found.
Nov 30 12:35:02 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:35:02 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:35:02 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[01de9e6c-8c14-4de1-99ab-f881c7fbf94f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[62445728-9cea-40da-8e1e-d572de86e705]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:02 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:02 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:02 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd4327640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb'): ({'sdm'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Removing single pathed devices sdm {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a276c5d1-018a-433c-924a-a163f3151363]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1032f8-6613-4d4e-8cc9-81c422aea058]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Flushing IO for device /dev/sdm {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.012s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4121b7-5b51-47dc-9ffb-0e0590b8a48f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.039s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[822be305-9ace-4ba6-9bea-9a18bcd5e44c]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Checking to see if SCSI volumes sdm have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] SCSI volumes sdm have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8919c14b-4c27-442a-85ec-d235c5800957]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b898ac-3e0f-4ed8-a511-77aba601f4df]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb, portal: 172.16.0.220,3260]
Nov 30 12:35:02 user nova-compute[75672]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb, portal: 172.16.0.220,3260] successful.
Nov 30 12:35:02 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc045c5-352c-42c8-9ca1-b4617b007ccb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e524599-3567-4b61-ae98-f110ee7d72dd]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] <== disconnect_volume: return (348ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:35:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:35:03 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Instance destroyed successfully.
Nov 30 12:35:03 user nova-compute[75672]: DEBUG nova.objects.instance [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lazy-loading 'resources' on Instance uuid 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1299844378',display_name='tempest-AttachSCSIVolumeTestJSON-server-1299844378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1299844378',id=8,image_ref='e62e39d9-cb91-46bc-9b6f-35627ad05b66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJM6zVjNA9WW1jsBNy9qDTawnAil6tcQCtrI2YbcdgAyrc3ptWNrLYd3MEqf9rWpHhU7fQViu+mUIQ+KuPbS1u6o4JwT6fDgT7dmUdpnnPQs01JilQwB34fAQWsOe8/ZCQ==',key_name='tempest-keypair-2083250103',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:32:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e970f80ebac4746b62535ef0a437c90',ramdisk_id='',reservation_id='r-m4kr0d8l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e62e39d9-cb91-46bc-9b6f-35627ad05b66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1256034176',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1256034176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99c1de98c55f42d8833817b159df5cb2',uuid=6b34c9c2-18ab-45a5-ad54-24b830c27ac6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "address": "fa:16:3e:40:c9:b1", "network": {"id": "cff34241-9fea-4ea4-870c-f313e592180f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1419258086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e970f80ebac4746b62535ef0a437c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abd93a7-c3", "ovs_interfaceid": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Converting VIF {"id": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "address": "fa:16:3e:40:c9:b1", "network": {"id": "cff34241-9fea-4ea4-870c-f313e592180f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1419258086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e970f80ebac4746b62535ef0a437c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abd93a7-c3", "ovs_interfaceid": "2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:c9:b1,bridge_name='br-int',has_traffic_filtering=True,id=2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f,network=Network(cff34241-9fea-4ea4-870c-f313e592180f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abd93a7-c3') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG os_vif [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:c9:b1,bridge_name='br-int',has_traffic_filtering=True,id=2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f,network=Network(cff34241-9fea-4ea4-870c-f313e592180f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abd93a7-c3') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2abd93a7-c3, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=018a0cb4-80ac-4222-8aaf-c6ecd673d10a) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:03 user nova-compute[75672]: INFO os_vif [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:c9:b1,bridge_name='br-int',has_traffic_filtering=True,id=2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f,network=Network(cff34241-9fea-4ea4-870c-f313e592180f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abd93a7-c3')
Nov 30 12:35:03 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Deleting instance files /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6_del
Nov 30 12:35:03 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Deletion of /opt/stack/data/nova/instances/6b34c9c2-18ab-45a5-ad54-24b830c27ac6_del complete
Nov 30 12:35:03 user nova-compute[75672]: INFO nova.compute.manager [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 30 12:35:03 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG nova.objects.instance [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lazy-loading 'flavor' on Instance uuid 22619e89-6f9e-402b-9a73-2af94c1e59a5 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-34a63556-0da6-4512-b549-ad8be7915137 tempest-VolumesAssistedSnapshotsTest-431121678 tempest-VolumesAssistedSnapshotsTest-431121678-project-admin] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.904s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:04 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-b8e45296-7c97-4a73-85cd-db0d47117110 req-57ab37aa-bcc0-4f91-8b62-409eae3b4831 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Received event network-vif-deleted-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:04 user nova-compute[75672]: INFO nova.compute.manager [req-b8e45296-7c97-4a73-85cd-db0d47117110 req-57ab37aa-bcc0-4f91-8b62-409eae3b4831 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Neutron deleted interface 2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f; detaching it from the instance and deleting it from the info cache
Nov 30 12:35:04 user nova-compute[75672]: DEBUG nova.network.neutron [req-b8e45296-7c97-4a73-85cd-db0d47117110 req-57ab37aa-bcc0-4f91-8b62-409eae3b4831 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:04 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Took 0.76 seconds to deallocate network for instance.
Nov 30 12:35:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-b8e45296-7c97-4a73-85cd-db0d47117110 req-57ab37aa-bcc0-4f91-8b62-409eae3b4831 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Detach interface failed, port_id=2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f, reason: Instance 6b34c9c2-18ab-45a5-ad54-24b830c27ac6 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:35:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:04 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:35:04 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:35:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-44a07dae-82fe-4a7c-9974-6bbbc9a93eaf req-d49f5754-9c68-41e3-bc58-6da0b182ad93 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Received event network-vif-plugged-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-44a07dae-82fe-4a7c-9974-6bbbc9a93eaf req-d49f5754-9c68-41e3-bc58-6da0b182ad93 service nova] Acquiring lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-44a07dae-82fe-4a7c-9974-6bbbc9a93eaf req-d49f5754-9c68-41e3-bc58-6da0b182ad93 service nova] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-44a07dae-82fe-4a7c-9974-6bbbc9a93eaf req-d49f5754-9c68-41e3-bc58-6da0b182ad93 service nova] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-44a07dae-82fe-4a7c-9974-6bbbc9a93eaf req-d49f5754-9c68-41e3-bc58-6da0b182ad93 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] No waiting events found dispatching network-vif-plugged-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:04 user nova-compute[75672]: WARNING nova.compute.manager [req-44a07dae-82fe-4a7c-9974-6bbbc9a93eaf req-d49f5754-9c68-41e3-bc58-6da0b182ad93 service nova] [instance: 6b34c9c2-18ab-45a5-ad54-24b830c27ac6] Received unexpected event network-vif-plugged-2abd93a7-c30a-4dc3-9fe2-3d76ad4c271f for instance with vm_state deleted and task_state None.
Nov 30 12:35:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.566s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:04 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Deleted allocations for instance 6b34c9c2-18ab-45a5-ad54-24b830c27ac6
Nov 30 12:35:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ed175a96-f2af-43a9-b649-af60774589d3 tempest-AttachSCSIVolumeTestJSON-1256034176 tempest-AttachSCSIVolumeTestJSON-1256034176-project-member] Lock "6b34c9c2-18ab-45a5-ad54-24b830c27ac6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.640s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "444b860d-f24e-4d21-8390-be86076bc3d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "444b860d-f24e-4d21-8390-be86076bc3d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:35:07 user nova-compute[75672]: INFO nova.compute.claims [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Claim successful on node user
Nov 30 12:35:07 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:35:07 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:35:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG nova.policy [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fe27c1bb48c454082be1109311db96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a602a0e3614e5bafc9d70e26368f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:35:07 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Creating image(s)
Nov 30 12:35:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "/opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "/opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "/opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk 1073741824" returned: 0 in 0.044s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Successfully created port: 9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.169s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Cannot resize image /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Ensure instance console log exists: /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Successfully updated port: 9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "refresh_cache-444b860d-f24e-4d21-8390-be86076bc3d6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquired lock "refresh_cache-444b860d-f24e-4d21-8390-be86076bc3d6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-9d01e416-c7a7-47d8-a02c-ac1ec35b1cc7 req-918de1d8-2c05-444f-9d7a-d3a5175ffad6 service nova] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Received event network-changed-9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-9d01e416-c7a7-47d8-a02c-ac1ec35b1cc7 req-918de1d8-2c05-444f-9d7a-d3a5175ffad6 service nova] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Refreshing instance network info cache due to event network-changed-9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:35:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9d01e416-c7a7-47d8-a02c-ac1ec35b1cc7 req-918de1d8-2c05-444f-9d7a-d3a5175ffad6 service nova] Acquiring lock "refresh_cache-444b860d-f24e-4d21-8390-be86076bc3d6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.network.neutron [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.network.neutron [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Updating instance_info_cache with network_info: [{"id": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "address": "fa:16:3e:01:da:56", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2b6458-36", "ovs_interfaceid": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Releasing lock "refresh_cache-444b860d-f24e-4d21-8390-be86076bc3d6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Instance network_info: |[{"id": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "address": "fa:16:3e:01:da:56", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2b6458-36", "ovs_interfaceid": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9d01e416-c7a7-47d8-a02c-ac1ec35b1cc7 req-918de1d8-2c05-444f-9d7a-d3a5175ffad6 service nova] Acquired lock "refresh_cache-444b860d-f24e-4d21-8390-be86076bc3d6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-9d01e416-c7a7-47d8-a02c-ac1ec35b1cc7 req-918de1d8-2c05-444f-9d7a-d3a5175ffad6 service nova] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Refreshing network info cache for port 9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Start _get_guest_xml network_info=[{"id": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "address": "fa:16:3e:01:da:56", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2b6458-36", "ovs_interfaceid": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:35:09 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:35:09 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-956677902',display_name='tempest-VolumesAdminNegativeTest-server-956677902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-956677902',id=15,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36a602a0e3614e5bafc9d70e26368f66',ramdisk_id='',reservation_id='r-820q02vb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1737879306',owner_user_name='tempest-VolumesAdminNegativeTest-1737879306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:35:08Z,user_data=None,user_id='1fe27c1bb48c454082be1109311db96f',uuid=444b860d-f24e-4d21-8390-be86076bc3d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "address": "fa:16:3e:01:da:56", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2b6458-36", "ovs_interfaceid": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Converting VIF {"id": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "address": "fa:16:3e:01:da:56", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2b6458-36", "ovs_interfaceid": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:56,bridge_name='br-int',has_traffic_filtering=True,id=9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb,network=Network(6c45d0f0-6bba-476f-8c7b-83f86f13ff55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2b6458-36') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.objects.instance [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lazy-loading 'pci_devices' on Instance uuid 444b860d-f24e-4d21-8390-be86076bc3d6 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:35:09 user nova-compute[75672]:   <uuid>444b860d-f24e-4d21-8390-be86076bc3d6</uuid>
Nov 30 12:35:09 user nova-compute[75672]:   <name>instance-0000000f</name>
Nov 30 12:35:09 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:35:09 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:35:09 user nova-compute[75672]:   <metadata>
Nov 30 12:35:09 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:35:09 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:35:09 user nova-compute[75672]:       <nova:name>tempest-VolumesAdminNegativeTest-server-956677902</nova:name>
Nov 30 12:35:09 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:35:09</nova:creationTime>
Nov 30 12:35:09 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:35:09 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:35:09 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:35:09 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:35:09 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:35:09 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:35:09 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:35:09 user nova-compute[75672]:       <nova:owner>
Nov 30 12:35:09 user nova-compute[75672]:         <nova:user uuid="1fe27c1bb48c454082be1109311db96f">tempest-VolumesAdminNegativeTest-1737879306-project-member</nova:user>
Nov 30 12:35:09 user nova-compute[75672]:         <nova:project uuid="36a602a0e3614e5bafc9d70e26368f66">tempest-VolumesAdminNegativeTest-1737879306</nova:project>
Nov 30 12:35:09 user nova-compute[75672]:       </nova:owner>
Nov 30 12:35:09 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:35:09 user nova-compute[75672]:       <nova:ports>
Nov 30 12:35:09 user nova-compute[75672]:         <nova:port uuid="9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb">
Nov 30 12:35:09 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 12:35:09 user nova-compute[75672]:         </nova:port>
Nov 30 12:35:09 user nova-compute[75672]:       </nova:ports>
Nov 30 12:35:09 user nova-compute[75672]:     </nova:instance>
Nov 30 12:35:09 user nova-compute[75672]:   </metadata>
Nov 30 12:35:09 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:35:09 user nova-compute[75672]:     <system>
Nov 30 12:35:09 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:35:09 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:35:09 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:35:09 user nova-compute[75672]:       <entry name="serial">444b860d-f24e-4d21-8390-be86076bc3d6</entry>
Nov 30 12:35:09 user nova-compute[75672]:       <entry name="uuid">444b860d-f24e-4d21-8390-be86076bc3d6</entry>
Nov 30 12:35:09 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:35:09 user nova-compute[75672]:     </system>
Nov 30 12:35:09 user nova-compute[75672]:   </sysinfo>
Nov 30 12:35:09 user nova-compute[75672]:   <os>
Nov 30 12:35:09 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:35:09 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:35:09 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:35:09 user nova-compute[75672]:   </os>
Nov 30 12:35:09 user nova-compute[75672]:   <features>
Nov 30 12:35:09 user nova-compute[75672]:     <acpi/>
Nov 30 12:35:09 user nova-compute[75672]:     <apic/>
Nov 30 12:35:09 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:35:09 user nova-compute[75672]:   </features>
Nov 30 12:35:09 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:35:09 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:35:09 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:35:09 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:35:09 user nova-compute[75672]:   </clock>
Nov 30 12:35:09 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:35:09 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:35:09 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:35:09 user nova-compute[75672]:   </cpu>
Nov 30 12:35:09 user nova-compute[75672]:   <devices>
Nov 30 12:35:09 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:35:09 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:35:09 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk"/>
Nov 30 12:35:09 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:35:09 user nova-compute[75672]:     </disk>
Nov 30 12:35:09 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:35:09 user nova-compute[75672]:       <mac address="fa:16:3e:01:da:56"/>
Nov 30 12:35:09 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:35:09 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:35:09 user nova-compute[75672]:       <target dev="tap9b2b6458-36"/>
Nov 30 12:35:09 user nova-compute[75672]:     </interface>
Nov 30 12:35:09 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:35:09 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/console.log" append="off"/>
Nov 30 12:35:09 user nova-compute[75672]:     </serial>
Nov 30 12:35:09 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:35:09 user nova-compute[75672]:     <video>
Nov 30 12:35:09 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:35:09 user nova-compute[75672]:     </video>
Nov 30 12:35:09 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:35:09 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:35:09 user nova-compute[75672]:     </rng>
Nov 30 12:35:09 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:35:09 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:35:09 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:35:09 user nova-compute[75672]:     </memballoon>
Nov 30 12:35:09 user nova-compute[75672]:   </devices>
Nov 30 12:35:09 user nova-compute[75672]: </domain>
Nov 30 12:35:09 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-956677902',display_name='tempest-VolumesAdminNegativeTest-server-956677902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-956677902',id=15,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36a602a0e3614e5bafc9d70e26368f66',ramdisk_id='',reservation_id='r-820q02vb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1737879306',owner_user_name='tempest-VolumesAdminNegativeTest-1737879306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:35:08Z,user_data=None,user_id='1fe27c1bb48c454082be1109311db96f',uuid=444b860d-f24e-4d21-8390-be86076bc3d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "address": "fa:16:3e:01:da:56", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2b6458-36", "ovs_interfaceid": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Converting VIF {"id": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "address": "fa:16:3e:01:da:56", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2b6458-36", "ovs_interfaceid": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:56,bridge_name='br-int',has_traffic_filtering=True,id=9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb,network=Network(6c45d0f0-6bba-476f-8c7b-83f86f13ff55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2b6458-36') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG os_vif [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:56,bridge_name='br-int',has_traffic_filtering=True,id=9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb,network=Network(6c45d0f0-6bba-476f-8c7b-83f86f13ff55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2b6458-36') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4708fe53-f131-549b-acde-e426a8e32583', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b2b6458-36, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b2b6458-36, col_values=(('qos', UUID('313465d7-5c4b-4b53-9950-35097b545193')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b2b6458-36, col_values=(('external_ids', {'iface-id': '9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:da:56', 'vm-uuid': '444b860d-f24e-4d21-8390-be86076bc3d6'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:09 user nova-compute[75672]: INFO os_vif [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:56,bridge_name='br-int',has_traffic_filtering=True,id=9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb,network=Network(6c45d0f0-6bba-476f-8c7b-83f86f13ff55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2b6458-36')
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] No VIF found with MAC fa:16:3e:01:da:56, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-9d01e416-c7a7-47d8-a02c-ac1ec35b1cc7 req-918de1d8-2c05-444f-9d7a-d3a5175ffad6 service nova] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Updated VIF entry in instance network info cache for port 9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-9d01e416-c7a7-47d8-a02c-ac1ec35b1cc7 req-918de1d8-2c05-444f-9d7a-d3a5175ffad6 service nova] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Updating instance_info_cache with network_info: [{"id": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "address": "fa:16:3e:01:da:56", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2b6458-36", "ovs_interfaceid": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9d01e416-c7a7-47d8-a02c-ac1ec35b1cc7 req-918de1d8-2c05-444f-9d7a-d3a5175ffad6 service nova] Releasing lock "refresh_cache-444b860d-f24e-4d21-8390-be86076bc3d6" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:35:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd34a0c6-fc07-402a-af3c-f6d98a0f3574 req-3146da39-0895-49fa-a866-0478bae69cd5 service nova] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Received event network-vif-plugged-9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd34a0c6-fc07-402a-af3c-f6d98a0f3574 req-3146da39-0895-49fa-a866-0478bae69cd5 service nova] Acquiring lock "444b860d-f24e-4d21-8390-be86076bc3d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd34a0c6-fc07-402a-af3c-f6d98a0f3574 req-3146da39-0895-49fa-a866-0478bae69cd5 service nova] Lock "444b860d-f24e-4d21-8390-be86076bc3d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd34a0c6-fc07-402a-af3c-f6d98a0f3574 req-3146da39-0895-49fa-a866-0478bae69cd5 service nova] Lock "444b860d-f24e-4d21-8390-be86076bc3d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd34a0c6-fc07-402a-af3c-f6d98a0f3574 req-3146da39-0895-49fa-a866-0478bae69cd5 service nova] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] No waiting events found dispatching network-vif-plugged-9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:11 user nova-compute[75672]: WARNING nova.compute.manager [req-bd34a0c6-fc07-402a-af3c-f6d98a0f3574 req-3146da39-0895-49fa-a866-0478bae69cd5 service nova] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Received unexpected event network-vif-plugged-9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb for instance with vm_state building and task_state spawning.
Nov 30 12:35:12 user nova-compute[75672]: DEBUG nova.compute.manager [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:35:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:35:12 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Instance spawned successfully.
Nov 30 12:35:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:35:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:35:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:35:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:35:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:35:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:35:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:35:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-171b560a-bac8-4cc6-9534-9e1eda1f4d6d req-7b6d836a-d723-4368-bc9c-4f04f28f8fc9 service nova] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Received event network-vif-plugged-9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-171b560a-bac8-4cc6-9534-9e1eda1f4d6d req-7b6d836a-d723-4368-bc9c-4f04f28f8fc9 service nova] Acquiring lock "444b860d-f24e-4d21-8390-be86076bc3d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-171b560a-bac8-4cc6-9534-9e1eda1f4d6d req-7b6d836a-d723-4368-bc9c-4f04f28f8fc9 service nova] Lock "444b860d-f24e-4d21-8390-be86076bc3d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-171b560a-bac8-4cc6-9534-9e1eda1f4d6d req-7b6d836a-d723-4368-bc9c-4f04f28f8fc9 service nova] Lock "444b860d-f24e-4d21-8390-be86076bc3d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-171b560a-bac8-4cc6-9534-9e1eda1f4d6d req-7b6d836a-d723-4368-bc9c-4f04f28f8fc9 service nova] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] No waiting events found dispatching network-vif-plugged-9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:13 user nova-compute[75672]: WARNING nova.compute.manager [req-171b560a-bac8-4cc6-9534-9e1eda1f4d6d req-7b6d836a-d723-4368-bc9c-4f04f28f8fc9 service nova] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Received unexpected event network-vif-plugged-9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb for instance with vm_state building and task_state spawning.
Nov 30 12:35:13 user nova-compute[75672]: INFO nova.compute.manager [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 30 12:35:13 user nova-compute[75672]: DEBUG nova.compute.manager [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:35:13 user nova-compute[75672]: INFO nova.compute.manager [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Took 6.01 seconds to build instance.
Nov 30 12:35:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-11f81d40-07b0-408b-a65b-e96b892cdcbd tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "444b860d-f24e-4d21-8390-be86076bc3d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.101s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:16 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 84f3ca7c-05db-4714-a685-3598bc6134d3 is timed out.
Nov 30 12:35:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Successfully detached device vdb from instance 84f3ca7c-05db-4714-a685-3598bc6134d3 from the live domain config.
Nov 30 12:35:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITrOCmRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:35:16 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c853c4c2-dedc-46d1-95b7-697d36a01323]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:35:16 user nova-compute[75672]: No targets found.
Nov 30 12:35:16 user nova-compute[75672]: iSNS:
Nov 30 12:35:16 user nova-compute[75672]: No targets found.
Nov 30 12:35:16 user nova-compute[75672]: STATIC:
Nov 30 12:35:16 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:35:16 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:16 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:16 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63
Nov 30 12:35:16 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:16 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:16 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f
Nov 30 12:35:16 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:16 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:16 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1
Nov 30 12:35:16 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:16 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:16 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b
Nov 30 12:35:16 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:16 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:16 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629
Nov 30 12:35:16 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:16 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:16 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:35:16 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:16 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:16 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71
Nov 30 12:35:16 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:16 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:16 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c
Nov 30 12:35:16 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:16 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:16 user nova-compute[75672]: FIRMWARE:
Nov 30 12:35:16 user nova-compute[75672]: No targets found.
Nov 30 12:35:16 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:35:16 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:35:16 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9465e8-76f5-4aa1-9047-a0e1274d6259]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c043e5-4808-4855-8881-e1f70bdd9699]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:16 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:16 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:16 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd4326680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1'): ({'sdj'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Removing single pathed devices sdj {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac2bbf2-baed-4a87-8818-672b538b2feb]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d599ae45-a0ba-43d3-88a4-ece18695b50b]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Flushing IO for device /dev/sdj {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9900807d-8f2f-482b-8e94-a99ce6fc1e0a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bd1ed5-35bb-4635-aa38-e46a79cefa6c]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] SCSI volumes sdj have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f490e35f-f5ad-4d88-9265-ea1d9358e402]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d774ea6-36fa-4b57-a40c-4477896d2568]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260]
Nov 30 12:35:17 user nova-compute[75672]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1, portal: 172.16.0.220,3260] successful.
Nov 30 12:35:17 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ea5bbc1-6d1a-4cbe-855e-6266e667d0a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0488df-8d00-4be1-a13c-436a92f1aa9a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:35:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] <== disconnect_volume: return (355ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:35:17 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:35:17 user nova-compute[75672]: DEBUG nova.objects.instance [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lazy-loading 'flavor' on Instance uuid 84f3ca7c-05db-4714-a685-3598bc6134d3 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-61b3c36c-2d0e-483e-90ee-180a0db3f5b9 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.725s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:28 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:35:28 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:35:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:35:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:35:28 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:35:29 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Updating instance_info_cache with network_info: [{"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:35:29 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:35:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:35:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:35:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:35:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:30 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:35:30 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:35:31 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:35:32 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:35:32 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:35:32 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:35:33 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:35:33 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:35:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:33 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:35:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:35:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-3a606ceb-c02c-4491-8e92-6355f737abe6 req-81b042dd-ed8e-497e-b4f1-de192f8ccbe2 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-changed-2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-3a606ceb-c02c-4491-8e92-6355f737abe6 req-81b042dd-ed8e-497e-b4f1-de192f8ccbe2 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing instance network info cache due to event network-changed-2304dd64-2456-475f-bc90-16143352b18a. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3a606ceb-c02c-4491-8e92-6355f737abe6 req-81b042dd-ed8e-497e-b4f1-de192f8ccbe2 service nova] Acquiring lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3a606ceb-c02c-4491-8e92-6355f737abe6 req-81b042dd-ed8e-497e-b4f1-de192f8ccbe2 service nova] Acquired lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG nova.network.neutron [req-3a606ceb-c02c-4491-8e92-6355f737abe6 req-81b042dd-ed8e-497e-b4f1-de192f8ccbe2 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Refreshing network info cache for port 2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Acquiring lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Acquiring lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:36 user nova-compute[75672]: INFO nova.compute.manager [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Terminating instance
Nov 30 12:35:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG nova.network.neutron [req-3a606ceb-c02c-4491-8e92-6355f737abe6 req-81b042dd-ed8e-497e-b4f1-de192f8ccbe2 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updated VIF entry in instance network info cache for port 2304dd64-2456-475f-bc90-16143352b18a. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG nova.network.neutron [req-3a606ceb-c02c-4491-8e92-6355f737abe6 req-81b042dd-ed8e-497e-b4f1-de192f8ccbe2 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating instance_info_cache with network_info: [{"id": "2304dd64-2456-475f-bc90-16143352b18a", "address": "fa:16:3e:6c:fe:34", "network": {"id": "82ff3f53-fea3-4dd1-9e10-f56b442ef619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-814518059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2304dd64-24", "ovs_interfaceid": "2304dd64-2456-475f-bc90-16143352b18a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "address": "fa:16:3e:26:f7:c2", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4ff97-44", "ovs_interfaceid": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "address": "fa:16:3e:96:81:8b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195140fe-5a", "ovs_interfaceid": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9177927-6e30-497f-9080-78798e05686c", "address": "fa:16:3e:a4:a7:f2", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9177927-6e", "ovs_interfaceid": "d9177927-6e30-497f-9080-78798e05686c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3a606ceb-c02c-4491-8e92-6355f737abe6 req-81b042dd-ed8e-497e-b4f1-de192f8ccbe2 service nova] Releasing lock "refresh_cache-35ef80cd-d7d8-421b-8296-44b107b1bce4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:37 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Instance destroyed successfully.
Nov 30 12:35:37 user nova-compute[75672]: DEBUG nova.objects.instance [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lazy-loading 'resources' on Instance uuid 22619e89-6f9e-402b-9a73-2af94c1e59a5 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:32:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1707145720',display_name='tempest-VolumesAssistedSnapshotsTest-server-1707145720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1707145720',id=9,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVaiWCW4hM4tcgYvVgf8ZayAaXqzyBdl/mUiEGOIVmNzijIpAGF+6vt+HKkFlEA5+Aonj3OwEEim0zPWRWEUM5kJyW19GURD3Ka55yMl9nWTmi3BbSvHHC4EJpjG120Og==',key_name='tempest-keypair-1737760818',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:32:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb448f77dbf143d59589139add90ff93',ramdisk_id='',reservation_id='r-q2m3q64b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-313696671',owner_user_name='tempest-VolumesAssistedSnapshotsTest-313696671-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:32:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5deab7a4199e420490ea7c5300d4bd55',uuid=22619e89-6f9e-402b-9a73-2af94c1e59a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "address": "fa:16:3e:47:90:40", "network": {"id": "4eae53c3-fc97-4624-ac91-68d53774ad23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1034722699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb448f77dbf143d59589139add90ff93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c6ac7e-d8", "ovs_interfaceid": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Converting VIF {"id": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "address": "fa:16:3e:47:90:40", "network": {"id": "4eae53c3-fc97-4624-ac91-68d53774ad23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1034722699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb448f77dbf143d59589139add90ff93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c6ac7e-d8", "ovs_interfaceid": "32c6ac7e-d869-4c4a-8d1a-3419048d9a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:90:40,bridge_name='br-int',has_traffic_filtering=True,id=32c6ac7e-d869-4c4a-8d1a-3419048d9a00,network=Network(4eae53c3-fc97-4624-ac91-68d53774ad23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c6ac7e-d8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG os_vif [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:90:40,bridge_name='br-int',has_traffic_filtering=True,id=32c6ac7e-d869-4c4a-8d1a-3419048d9a00,network=Network(4eae53c3-fc97-4624-ac91-68d53774ad23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c6ac7e-d8') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32c6ac7e-d8, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6837795-a503-4739-a8e5-d95acf9becfd) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:37 user nova-compute[75672]: INFO os_vif [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:90:40,bridge_name='br-int',has_traffic_filtering=True,id=32c6ac7e-d869-4c4a-8d1a-3419048d9a00,network=Network(4eae53c3-fc97-4624-ac91-68d53774ad23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c6ac7e-d8')
Nov 30 12:35:37 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Deleting instance files /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5_del
Nov 30 12:35:37 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Deletion of /opt/stack/data/nova/instances/22619e89-6f9e-402b-9a73-2af94c1e59a5_del complete
Nov 30 12:35:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:37 user nova-compute[75672]: INFO nova.compute.manager [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 30 12:35:37 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:35:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-7c2a595f-b7c5-4313-8929-f295782ad147 req-da7c76dd-937d-4d9d-9b82-e66183b4d4a7 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-changed-026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-7c2a595f-b7c5-4313-8929-f295782ad147 req-da7c76dd-937d-4d9d-9b82-e66183b4d4a7 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing instance network info cache due to event network-changed-026ddb45-5a8b-4434-906c-7350c6e6f878. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7c2a595f-b7c5-4313-8929-f295782ad147 req-da7c76dd-937d-4d9d-9b82-e66183b4d4a7 service nova] Acquiring lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7c2a595f-b7c5-4313-8929-f295782ad147 req-da7c76dd-937d-4d9d-9b82-e66183b4d4a7 service nova] Acquired lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG nova.network.neutron [req-7c2a595f-b7c5-4313-8929-f295782ad147 req-da7c76dd-937d-4d9d-9b82-e66183b4d4a7 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Refreshing network info cache for port 026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received event network-vif-unplugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] Acquiring lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] No waiting events found dispatching network-vif-unplugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received event network-vif-unplugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received event network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] Acquiring lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] No waiting events found dispatching network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:38 user nova-compute[75672]: WARNING nova.compute.manager [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received unexpected event network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 for instance with vm_state active and task_state deleting.
Nov 30 12:35:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received event network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] Acquiring lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] No waiting events found dispatching network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:38 user nova-compute[75672]: WARNING nova.compute.manager [req-d0a2ed00-d5fe-4feb-9188-acaf75f3f93e req-ba62ee41-5d12-4f90-8945-54cb966a770e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received unexpected event network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 for instance with vm_state active and task_state deleting.
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:39 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:35:39 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7021MB free_disk=25.289344787597656GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 1fba8af1-8074-4ce8-be23-912e9850fc41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 85f7c21c-b973-422f-a10c-8fb3635879f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 84f3ca7c-05db-4714-a685-3598bc6134d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 22619e89-6f9e-402b-9a73-2af94c1e59a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 35ef80cd-d7d8-421b-8296-44b107b1bce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d8328382-e998-44b8-9c34-a1dbf74746e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance c8333c65-42ab-4de2-abc4-6cc672746b2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 4382544b-6fb7-4164-9b6b-302a6e24bc52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 444b860d-f24e-4d21-8390-be86076bc3d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:39 user nova-compute[75672]: INFO nova.compute.manager [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Terminating instance
Nov 30 12:35:39 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.864s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.network.neutron [req-7c2a595f-b7c5-4313-8929-f295782ad147 req-da7c76dd-937d-4d9d-9b82-e66183b4d4a7 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updated VIF entry in instance network info cache for port 026ddb45-5a8b-4434-906c-7350c6e6f878. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.network.neutron [req-7c2a595f-b7c5-4313-8929-f295782ad147 req-da7c76dd-937d-4d9d-9b82-e66183b4d4a7 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [{"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7df92582-df3e-4666-8afc-0fa41fa10d27", "address": "fa:16:3e:c0:57:d2", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df92582-df", "ovs_interfaceid": "7df92582-df3e-4666-8afc-0fa41fa10d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "address": "fa:16:3e:6a:c7:b1", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0976de-f4", "ovs_interfaceid": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "441e94f2-f857-4b09-886a-b958df41483a", "address": "fa:16:3e:00:9b:13", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441e94f2-f8", "ovs_interfaceid": "441e94f2-f857-4b09-886a-b958df41483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52cf6915-a26b-4126-9f42-6741a35e66c9", "address": "fa:16:3e:1f:66:ac", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52cf6915-a2", "ovs_interfaceid": "52cf6915-a26b-4126-9f42-6741a35e66c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7c2a595f-b7c5-4313-8929-f295782ad147 req-da7c76dd-937d-4d9d-9b82-e66183b4d4a7 service nova] Releasing lock "refresh_cache-d8328382-e998-44b8-9c34-a1dbf74746e7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:40 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Took 2.70 seconds to deallocate network for instance.
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-6081963c-6543-4ba7-be79-299fa773bfc2 req-faaa1451-060f-4302-afa7-354a72a07427 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-unplugged-2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6081963c-6543-4ba7-be79-299fa773bfc2 req-faaa1451-060f-4302-afa7-354a72a07427 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6081963c-6543-4ba7-be79-299fa773bfc2 req-faaa1451-060f-4302-afa7-354a72a07427 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6081963c-6543-4ba7-be79-299fa773bfc2 req-faaa1451-060f-4302-afa7-354a72a07427 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-6081963c-6543-4ba7-be79-299fa773bfc2 req-faaa1451-060f-4302-afa7-354a72a07427 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-unplugged-2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-6081963c-6543-4ba7-be79-299fa773bfc2 req-faaa1451-060f-4302-afa7-354a72a07427 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-unplugged-2304dd64-2456-475f-bc90-16143352b18a for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received event network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] Acquiring lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] No waiting events found dispatching network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:40 user nova-compute[75672]: WARNING nova.compute.manager [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received unexpected event network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 for instance with vm_state deleted and task_state None.
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received event network-vif-unplugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] Acquiring lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] No waiting events found dispatching network-vif-unplugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:40 user nova-compute[75672]: WARNING nova.compute.manager [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received unexpected event network-vif-unplugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 for instance with vm_state deleted and task_state None.
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received event network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] Acquiring lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] No waiting events found dispatching network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:40 user nova-compute[75672]: WARNING nova.compute.manager [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received unexpected event network-vif-plugged-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 for instance with vm_state deleted and task_state None.
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] [instance: 22619e89-6f9e-402b-9a73-2af94c1e59a5] Received event network-vif-deleted-32c6ac7e-d869-4c4a-8d1a-3419048d9a00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-unplugged-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-unplugged-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-84e2915c-aff9-4875-a1c3-69ddd949e0ab req-ac1706e6-9882-4b3c-ae9d-8b22e8a03c0e service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-unplugged-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-c816356d-87eb-4ab7-a2bd-52c5b83312fc req-1d65f032-826f-4eff-b6fd-270639d46ad9 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-unplugged-195140fe-5a34-44cd-a93f-cbcc015f67d0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c816356d-87eb-4ab7-a2bd-52c5b83312fc req-1d65f032-826f-4eff-b6fd-270639d46ad9 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c816356d-87eb-4ab7-a2bd-52c5b83312fc req-1d65f032-826f-4eff-b6fd-270639d46ad9 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c816356d-87eb-4ab7-a2bd-52c5b83312fc req-1d65f032-826f-4eff-b6fd-270639d46ad9 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-c816356d-87eb-4ab7-a2bd-52c5b83312fc req-1d65f032-826f-4eff-b6fd-270639d46ad9 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-unplugged-195140fe-5a34-44cd-a93f-cbcc015f67d0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-c816356d-87eb-4ab7-a2bd-52c5b83312fc req-1d65f032-826f-4eff-b6fd-270639d46ad9 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-unplugged-195140fe-5a34-44cd-a93f-cbcc015f67d0 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.858s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:41 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Deleted allocations for instance 22619e89-6f9e-402b-9a73-2af94c1e59a5
Nov 30 12:35:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06761996-d0b9-45af-ba79-82f21ad19c33 tempest-VolumesAssistedSnapshotsTest-313696671 tempest-VolumesAssistedSnapshotsTest-313696671-project-member] Lock "22619e89-6f9e-402b-9a73-2af94c1e59a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.130s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:41 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Instance destroyed successfully.
Nov 30 12:35:41 user nova-compute[75672]: DEBUG nova.objects.instance [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lazy-loading 'resources' on Instance uuid 35ef80cd-d7d8-421b-8296-44b107b1bce4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2304dd64-2456-475f-bc90-16143352b18a", "address": "fa:16:3e:6c:fe:34", "network": {"id": "82ff3f53-fea3-4dd1-9e10-f56b442ef619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-814518059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2304dd64-24", "ovs_interfaceid": "2304dd64-2456-475f-bc90-16143352b18a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "2304dd64-2456-475f-bc90-16143352b18a", "address": "fa:16:3e:6c:fe:34", "network": {"id": "82ff3f53-fea3-4dd1-9e10-f56b442ef619", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-814518059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2304dd64-24", "ovs_interfaceid": "2304dd64-2456-475f-bc90-16143352b18a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:fe:34,bridge_name='br-int',has_traffic_filtering=True,id=2304dd64-2456-475f-bc90-16143352b18a,network=Network(82ff3f53-fea3-4dd1-9e10-f56b442ef619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2304dd64-24') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG os_vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:fe:34,bridge_name='br-int',has_traffic_filtering=True,id=2304dd64-2456-475f-bc90-16143352b18a,network=Network(82ff3f53-fea3-4dd1-9e10-f56b442ef619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2304dd64-24') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2304dd64-24, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e29a4377-4879-467a-b9fd-94f7d431a920) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: INFO os_vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:fe:34,bridge_name='br-int',has_traffic_filtering=True,id=2304dd64-2456-475f-bc90-16143352b18a,network=Network(82ff3f53-fea3-4dd1-9e10-f56b442ef619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2304dd64-24')
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:e5:61,bridge_name='br-int',has_traffic_filtering=True,id=9f5fce50-73ed-465d-bf21-f3902157d044,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f5fce50-73') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG os_vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:e5:61,bridge_name='br-int',has_traffic_filtering=True,id=9f5fce50-73ed-465d-bf21-f3902157d044,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f5fce50-73') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f5fce50-73, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29cef846-19ec-44fd-86fc-d28ddd0d45d4) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: INFO os_vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:e5:61,bridge_name='br-int',has_traffic_filtering=True,id=9f5fce50-73ed-465d-bf21-f3902157d044,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f5fce50-73')
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:af:0b,bridge_name='br-int',has_traffic_filtering=True,id=927378ac-2059-4e53-a96b-ab629c814942,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap927378ac-20') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG os_vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:af:0b,bridge_name='br-int',has_traffic_filtering=True,id=927378ac-2059-4e53-a96b-ab629c814942,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap927378ac-20') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap927378ac-20, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42b5fec8-c3ff-48e6-8c16-3be36adaa170) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: INFO os_vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:af:0b,bridge_name='br-int',has_traffic_filtering=True,id=927378ac-2059-4e53-a96b-ab629c814942,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap927378ac-20')
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "address": "fa:16:3e:26:f7:c2", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4ff97-44", "ovs_interfaceid": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "address": "fa:16:3e:26:f7:c2", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4ff97-44", "ovs_interfaceid": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:f7:c2,bridge_name='br-int',has_traffic_filtering=True,id=c2a4ff97-44d0-4b5d-971b-c7015d3e54f8,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a4ff97-44') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG os_vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:f7:c2,bridge_name='br-int',has_traffic_filtering=True,id=c2a4ff97-44d0-4b5d-971b-c7015d3e54f8,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a4ff97-44') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2a4ff97-44, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:42 user nova-compute[75672]: INFO nova.compute.manager [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Terminating instance
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cca6d54c-55e7-4ac9-9a4d-4fb620aa9c47) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: INFO os_vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:f7:c2,bridge_name='br-int',has_traffic_filtering=True,id=c2a4ff97-44d0-4b5d-971b-c7015d3e54f8,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a4ff97-44')
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "address": "fa:16:3e:96:81:8b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195140fe-5a", "ovs_interfaceid": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "address": "fa:16:3e:96:81:8b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195140fe-5a", "ovs_interfaceid": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:81:8b,bridge_name='br-int',has_traffic_filtering=True,id=195140fe-5a34-44cd-a93f-cbcc015f67d0,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195140fe-5a') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG os_vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:81:8b,bridge_name='br-int',has_traffic_filtering=True,id=195140fe-5a34-44cd-a93f-cbcc015f67d0,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195140fe-5a') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap195140fe-5a, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:35:42 user nova-compute[75672]: INFO nova.compute.claims [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Claim successful on node user
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7777c995-e7ee-4979-bd24-1fb9690c7d38) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: INFO os_vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:81:8b,bridge_name='br-int',has_traffic_filtering=True,id=195140fe-5a34-44cd-a93f-cbcc015f67d0,network=Network(c9fcc20a-69c4-4532-9d6a-2b8eea2849a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195140fe-5a')
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9177927-6e30-497f-9080-78798e05686c", "address": "fa:16:3e:a4:a7:f2", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9177927-6e", "ovs_interfaceid": "d9177927-6e30-497f-9080-78798e05686c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "d9177927-6e30-497f-9080-78798e05686c", "address": "fa:16:3e:a4:a7:f2", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9177927-6e", "ovs_interfaceid": "d9177927-6e30-497f-9080-78798e05686c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a7:f2,bridge_name='br-int',has_traffic_filtering=True,id=d9177927-6e30-497f-9080-78798e05686c,network=Network(61781429-98eb-4e65-9a1d-d2f04625dadf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9177927-6e') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG os_vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a7:f2,bridge_name='br-int',has_traffic_filtering=True,id=d9177927-6e30-497f-9080-78798e05686c,network=Network(61781429-98eb-4e65-9a1d-d2f04625dadf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9177927-6e') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9177927-6e, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:42 user nova-compute[75672]: WARNING nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-2304dd64-2456-475f-bc90-16143352b18a for instance with vm_state active and task_state deleting.
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-unplugged-9f5fce50-73ed-465d-bf21-f3902157d044 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-unplugged-9f5fce50-73ed-465d-bf21-f3902157d044 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-unplugged-9f5fce50-73ed-465d-bf21-f3902157d044 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-9f5fce50-73ed-465d-bf21-f3902157d044 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-9f5fce50-73ed-465d-bf21-f3902157d044 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:42 user nova-compute[75672]: WARNING nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-9f5fce50-73ed-465d-bf21-f3902157d044 for instance with vm_state active and task_state deleting.
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-unplugged-927378ac-2059-4e53-a96b-ab629c814942 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-unplugged-927378ac-2059-4e53-a96b-ab629c814942 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-unplugged-927378ac-2059-4e53-a96b-ab629c814942 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-927378ac-2059-4e53-a96b-ab629c814942 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-927378ac-2059-4e53-a96b-ab629c814942 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:42 user nova-compute[75672]: WARNING nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-927378ac-2059-4e53-a96b-ab629c814942 for instance with vm_state active and task_state deleting.
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-unplugged-d9177927-6e30-497f-9080-78798e05686c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-unplugged-d9177927-6e30-497f-9080-78798e05686c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4df374b-5515-43aa-94c8-b92813b7a444 req-f4b5936a-5f33-4439-bc64-b5435dbd576f service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-unplugged-d9177927-6e30-497f-9080-78798e05686c for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eabef2ec-3280-46e7-95b4-8b3cfa8e5d9c) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-dfb1c0ad-d566-4510-8b4a-26da6bfd5580 req-992e0787-f2bd-4d06-969e-0b4319a338e4 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dfb1c0ad-d566-4510-8b4a-26da6bfd5580 req-992e0787-f2bd-4d06-969e-0b4319a338e4 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dfb1c0ad-d566-4510-8b4a-26da6bfd5580 req-992e0787-f2bd-4d06-969e-0b4319a338e4 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dfb1c0ad-d566-4510-8b4a-26da6bfd5580 req-992e0787-f2bd-4d06-969e-0b4319a338e4 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-dfb1c0ad-d566-4510-8b4a-26da6bfd5580 req-992e0787-f2bd-4d06-969e-0b4319a338e4 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:42 user nova-compute[75672]: WARNING nova.compute.manager [req-dfb1c0ad-d566-4510-8b4a-26da6bfd5580 req-992e0787-f2bd-4d06-969e-0b4319a338e4 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 for instance with vm_state active and task_state deleting.
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-dfb1c0ad-d566-4510-8b4a-26da6bfd5580 req-992e0787-f2bd-4d06-969e-0b4319a338e4 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-unplugged-026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dfb1c0ad-d566-4510-8b4a-26da6bfd5580 req-992e0787-f2bd-4d06-969e-0b4319a338e4 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dfb1c0ad-d566-4510-8b4a-26da6bfd5580 req-992e0787-f2bd-4d06-969e-0b4319a338e4 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dfb1c0ad-d566-4510-8b4a-26da6bfd5580 req-992e0787-f2bd-4d06-969e-0b4319a338e4 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-dfb1c0ad-d566-4510-8b4a-26da6bfd5580 req-992e0787-f2bd-4d06-969e-0b4319a338e4 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-unplugged-026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-dfb1c0ad-d566-4510-8b4a-26da6bfd5580 req-992e0787-f2bd-4d06-969e-0b4319a338e4 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-unplugged-026ddb45-5a8b-4434-906c-7350c6e6f878 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-4c9a8e19-12e9-4e55-81c2-3191d1630988 req-ecb0fee5-020d-4669-93cf-b14e13cb929d service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-195140fe-5a34-44cd-a93f-cbcc015f67d0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4c9a8e19-12e9-4e55-81c2-3191d1630988 req-ecb0fee5-020d-4669-93cf-b14e13cb929d service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4c9a8e19-12e9-4e55-81c2-3191d1630988 req-ecb0fee5-020d-4669-93cf-b14e13cb929d service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4c9a8e19-12e9-4e55-81c2-3191d1630988 req-ecb0fee5-020d-4669-93cf-b14e13cb929d service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-4c9a8e19-12e9-4e55-81c2-3191d1630988 req-ecb0fee5-020d-4669-93cf-b14e13cb929d service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-195140fe-5a34-44cd-a93f-cbcc015f67d0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:42 user nova-compute[75672]: WARNING nova.compute.manager [req-4c9a8e19-12e9-4e55-81c2-3191d1630988 req-ecb0fee5-020d-4669-93cf-b14e13cb929d service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-195140fe-5a34-44cd-a93f-cbcc015f67d0 for instance with vm_state active and task_state deleting.
Nov 30 12:35:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: INFO os_vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a7:f2,bridge_name='br-int',has_traffic_filtering=True,id=d9177927-6e30-497f-9080-78798e05686c,network=Network(61781429-98eb-4e65-9a1d-d2f04625dadf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9177927-6e')
Nov 30 12:35:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1190961203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1190961203',id=11,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi4FzYoos7KXQmDVFSmMZbGRFAo11iS/4K0Hg2/AuuOPLAEk1Wq02PI8yuIa4XT+QE6uzD+awnVc0rEU2bOBo/F86kqGhHyfpfoxjMDwzWURpsdlBDdPzXqVAr3O5jFfg==',key_name='tempest-keypair-1013353688',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec663862ec640dcaba59b031512fe30',ramdisk_id='',reservation_id='r-ro5je0tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1911046419',owner_user_name='tempest-TaggedBootDevicesTest_v242-1911046419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ab9a7339334ee39a17b7911e2ebfde',uuid=35ef80cd-d7d8-421b-8296-44b107b1bce4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converting VIF {"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:86:05,bridge_name='br-int',has_traffic_filtering=True,id=288fbe5b-c2d5-434b-9ce1-82364edc246f,network=Network(61781429-98eb-4e65-9a1d-d2f04625dadf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288fbe5b-c2') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:86:05,bridge_name='br-int',has_traffic_filtering=True,id=288fbe5b-c2d5-434b-9ce1-82364edc246f,network=Network(61781429-98eb-4e65-9a1d-d2f04625dadf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288fbe5b-c2') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap288fbe5b-c2, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d15a436-d29b-4643-b887-2c5a360e8b87) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG nova.network.neutron [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: INFO os_vif [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:86:05,bridge_name='br-int',has_traffic_filtering=True,id=288fbe5b-c2d5-434b-9ce1-82364edc246f,network=Network(61781429-98eb-4e65-9a1d-d2f04625dadf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288fbe5b-c2')
Nov 30 12:35:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iYMOquIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:35:43 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:43 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:35:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.048s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a32e45-3370-486f-b1ae-02361f3056c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:35:43 user nova-compute[75672]: No targets found.
Nov 30 12:35:43 user nova-compute[75672]: iSNS:
Nov 30 12:35:43 user nova-compute[75672]: No targets found.
Nov 30 12:35:43 user nova-compute[75672]: STATIC:
Nov 30 12:35:43 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:35:43 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:43 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:43 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63
Nov 30 12:35:43 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:43 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:43 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f
Nov 30 12:35:43 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:43 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:43 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b
Nov 30 12:35:43 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:43 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:43 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629
Nov 30 12:35:43 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:43 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:43 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:35:43 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:43 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:43 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71
Nov 30 12:35:43 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:43 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:43 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c
Nov 30 12:35:43 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:43 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:43 user nova-compute[75672]: FIRMWARE:
Nov 30 12:35:43 user nova-compute[75672]: No targets found.
Nov 30 12:35:43 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:35:43 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:35:43 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07b3f1d-bd90-40a0-b421-45ac15a02992]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG nova.policy [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15791a052aef4d7a9bc79c97075cbdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51606113e3d1460894fdc500924cb37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b92e6c-6fb5-47b3-80ac-f6754bd5dc45]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:35:43 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:35:43 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:43 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:35:43 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:43 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:35:43 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:43 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:43 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:35:43 user nova-compute[75672]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 (non-flash)
Nov 30 12:35:43 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:43 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:35:43 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:43 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:35:43 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:43 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:43 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd4104f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63'): ({'sdc'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Removing single pathed devices sdc {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f05056-3c48-4670-8afd-d978038a658d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd27889-5bf7-451b-a70c-82c3f8789dfa]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Flushing IO for device /dev/sdc {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9bb0eb-805a-4464-a80f-1c4bacbbfd65]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:35:43 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Creating image(s)
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "/opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "/opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "/opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.071s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1710a4-c71a-4344-98f2-15d7295087de]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd103bd5-b5d2-457b-b789-71e3360708ea]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.113s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[637625f4-429c-45e7-b95d-4a29e709fda0]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63, portal: 172.16.0.220,3260]
Nov 30 12:35:43 user nova-compute[75672]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63, portal: 172.16.0.220,3260] successful.
Nov 30 12:35:43 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.222s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f97df5-26e7-4dc8-a5cc-38c192302b63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.056s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aae41c6-ae5c-49ed-ae44-570ea2093365]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.601s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] <== disconnect_volume: return (604ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eXPrnTvw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:35:44 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[06accd2a-c47e-4a68-9b3f-3320ebe6c2e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:35:44 user nova-compute[75672]: No targets found.
Nov 30 12:35:44 user nova-compute[75672]: iSNS:
Nov 30 12:35:44 user nova-compute[75672]: No targets found.
Nov 30 12:35:44 user nova-compute[75672]: STATIC:
Nov 30 12:35:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:35:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f
Nov 30 12:35:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b
Nov 30 12:35:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629
Nov 30 12:35:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:35:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71
Nov 30 12:35:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c
Nov 30 12:35:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:44 user nova-compute[75672]: FIRMWARE:
Nov 30 12:35:44 user nova-compute[75672]: No targets found.
Nov 30 12:35:44 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:35:44 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:35:44 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b102291-5e25-47a2-9b48-8822593bdd30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c789113c-59aa-41ec-84c4-1509fb20c519]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd4295480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b'): ({'sde'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Removing single pathed devices sde {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0903a36-a3fb-4cef-8394-3685fc1524e3]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.247s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.065s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5847859a-b5e6-4b8f-9213-8a297987456d]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Flushing IO for device /dev/sde {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk 1073741824" returned: 0 in 0.108s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.359s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.037s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[467381cd-7f00-48cc-a583-f561b830e32b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e1b5ee-b71e-4518-a4d5-6bc1739c86a4]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] SCSI volumes sde have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad2406d-9316-4171-8a5b-bb0a3e18b82a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.196s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Instance destroyed successfully.
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lazy-loading 'resources' on Instance uuid d8328382-e998-44b8-9c34-a1dbf74746e7 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:63:ab,bridge_name='br-int',has_traffic_filtering=True,id=026ddb45-5a8b-4434-906c-7350c6e6f878,network=Network(a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026ddb45-5a') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:63:ab,bridge_name='br-int',has_traffic_filtering=True,id=026ddb45-5a8b-4434-906c-7350c6e6f878,network=Network(a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026ddb45-5a') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.115s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7544a98-8d52-49db-9f00-134d35c3bde9]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b, portal: 172.16.0.220,3260]
Nov 30 12:35:44 user nova-compute[75672]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b, portal: 172.16.0.220,3260] successful.
Nov 30 12:35:44 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap026ddb45-5a, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31189b16-d950-46e3-ab69-6729febf2c1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a7689e-7187-499b-8725-ebc334244d6a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.600s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] <== disconnect_volume: return (601ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVNLUSPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:35:44 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca541616-8e6c-451f-bfe9-b4678740bef0) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3ecfd9-9efb-4578-a69e-1e9a3e1178e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:35:44 user nova-compute[75672]: No targets found.
Nov 30 12:35:44 user nova-compute[75672]: iSNS:
Nov 30 12:35:44 user nova-compute[75672]: No targets found.
Nov 30 12:35:44 user nova-compute[75672]: STATIC:
Nov 30 12:35:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:35:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f
Nov 30 12:35:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629
Nov 30 12:35:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:35:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71
Nov 30 12:35:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c
Nov 30 12:35:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:44 user nova-compute[75672]: FIRMWARE:
Nov 30 12:35:44 user nova-compute[75672]: No targets found.
Nov 30 12:35:44 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:35:44 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:35:44 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[620e532e-2400-4c67-90a0-f0c2d7726e40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Cannot resize image /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Ensure instance console log exists: /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.network.neutron [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Successfully created port: e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[849aa8ef-4246-4335-9dd2-085e2df85b81]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:44 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd435d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f'): ({'sdg'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Removing single pathed devices sdg {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: INFO os_vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:63:ab,bridge_name='br-int',has_traffic_filtering=True,id=026ddb45-5a8b-4434-906c-7350c6e6f878,network=Network(a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026ddb45-5a')
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:de:b4,bridge_name='br-int',has_traffic_filtering=True,id=f50a4265-e775-4197-a5ec-5980f4cd0485,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf50a4265-e7') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:de:b4,bridge_name='br-int',has_traffic_filtering=True,id=f50a4265-e775-4197-a5ec-5980f4cd0485,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf50a4265-e7') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-d9177927-6e30-497f-9080-78798e05686c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-d9177927-6e30-497f-9080-78798e05686c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:44 user nova-compute[75672]: WARNING nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-d9177927-6e30-497f-9080-78798e05686c for instance with vm_state active and task_state deleting.
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-unplugged-288fbe5b-c2d5-434b-9ce1-82364edc246f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-unplugged-288fbe5b-c2d5-434b-9ce1-82364edc246f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-unplugged-288fbe5b-c2d5-434b-9ce1-82364edc246f for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-plugged-288fbe5b-c2d5-434b-9ce1-82364edc246f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Acquiring lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] No waiting events found dispatching network-vif-plugged-288fbe5b-c2d5-434b-9ce1-82364edc246f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:44 user nova-compute[75672]: WARNING nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received unexpected event network-vif-plugged-288fbe5b-c2d5-434b-9ce1-82364edc246f for instance with vm_state active and task_state deleting.
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-unplugged-f50a4265-e775-4197-a5ec-5980f4cd0485 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-unplugged-f50a4265-e775-4197-a5ec-5980f4cd0485 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-unplugged-f50a4265-e775-4197-a5ec-5980f4cd0485 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-f50a4265-e775-4197-a5ec-5980f4cd0485 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-f50a4265-e775-4197-a5ec-5980f4cd0485 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:44 user nova-compute[75672]: WARNING nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-f50a4265-e775-4197-a5ec-5980f4cd0485 for instance with vm_state active and task_state deleting.
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-unplugged-7df92582-df3e-4666-8afc-0fa41fa10d27 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-unplugged-7df92582-df3e-4666-8afc-0fa41fa10d27 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-unplugged-7df92582-df3e-4666-8afc-0fa41fa10d27 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-7df92582-df3e-4666-8afc-0fa41fa10d27 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-7df92582-df3e-4666-8afc-0fa41fa10d27 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:44 user nova-compute[75672]: WARNING nova.compute.manager [req-8de6a00e-2756-4a01-a9c7-fd0853e71ed2 req-6953645b-66be-461a-8f01-b21621c626e9 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-7df92582-df3e-4666-8afc-0fa41fa10d27 for instance with vm_state active and task_state deleting.
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdfc108-8c92-4202-b4ff-324493b8110a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf50a4265-e7, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b117883-2f73-4c13-be42-9f37dae12967]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Flushing IO for device /dev/sdg {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2df0b5-fe11-404d-ad75-3921e19ac721]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ddce618e-0eb6-4511-a594-b8d64d1f4655) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e308d3a5-0429-451e-b6a9-b7d62771b2e2]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] SCSI volumes sdg have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8a1f4e-6052-4835-ac15-9f568883e044]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:44 user nova-compute[75672]: INFO os_vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:de:b4,bridge_name='br-int',has_traffic_filtering=True,id=f50a4265-e775-4197-a5ec-5980f4cd0485,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf50a4265-e7')
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:be:df,bridge_name='br-int',has_traffic_filtering=True,id=bffe61b1-46cc-476d-b96e-c4cb5b81fb63,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbffe61b1-46') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG os_vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:be:df,bridge_name='br-int',has_traffic_filtering=True,id=bffe61b1-46cc-476d-b96e-c4cb5b81fb63,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbffe61b1-46') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbffe61b1-46, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80b7f8fb-ac7f-4238-b013-2303435e9948) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[728c2f59-ba85-4a5c-b39b-32f1631fade4]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f, portal: 172.16.0.220,3260]
Nov 30 12:35:45 user nova-compute[75672]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f, portal: 172.16.0.220,3260] successful.
Nov 30 12:35:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:45 user nova-compute[75672]: WARNING nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-026ddb45-5a8b-4434-906c-7350c6e6f878 for instance with vm_state active and task_state deleting.
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-unplugged-bffe61b1-46cc-476d-b96e-c4cb5b81fb63 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-unplugged-bffe61b1-46cc-476d-b96e-c4cb5b81fb63 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-unplugged-bffe61b1-46cc-476d-b96e-c4cb5b81fb63 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-bffe61b1-46cc-476d-b96e-c4cb5b81fb63 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-bffe61b1-46cc-476d-b96e-c4cb5b81fb63 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:45 user nova-compute[75672]: WARNING nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-bffe61b1-46cc-476d-b96e-c4cb5b81fb63 for instance with vm_state active and task_state deleting.
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-unplugged-2f0976de-f44c-4de2-9eb1-4a9f98c16672 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-unplugged-2f0976de-f44c-4de2-9eb1-4a9f98c16672 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-unplugged-2f0976de-f44c-4de2-9eb1-4a9f98c16672 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-2f0976de-f44c-4de2-9eb1-4a9f98c16672 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-2f0976de-f44c-4de2-9eb1-4a9f98c16672 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:45 user nova-compute[75672]: WARNING nova.compute.manager [req-f854086a-c86d-4298-af50-c51987f6ac7c req-fdc33bab-de9c-459d-8185-8c15d403d69d service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-2f0976de-f44c-4de2-9eb1-4a9f98c16672 for instance with vm_state active and task_state deleting.
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00529119-c8a8-4898-ac85-9c3f7e99da7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaef63d-8462-4972-967a-af03fdcbb9da]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] <== disconnect_volume: return (389ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:35:45 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Deleting instance files /opt/stack/data/nova/instances/35ef80cd-d7d8-421b-8296-44b107b1bce4_del
Nov 30 12:35:45 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Deletion of /opt/stack/data/nova/instances/35ef80cd-d7d8-421b-8296-44b107b1bce4_del complete
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-unplugged-441e94f2-f857-4b09-886a-b958df41483a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-unplugged-441e94f2-f857-4b09-886a-b958df41483a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-unplugged-441e94f2-f857-4b09-886a-b958df41483a for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-441e94f2-f857-4b09-886a-b958df41483a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-441e94f2-f857-4b09-886a-b958df41483a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:45 user nova-compute[75672]: WARNING nova.compute.manager [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-441e94f2-f857-4b09-886a-b958df41483a for instance with vm_state active and task_state deleting.
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-unplugged-52cf6915-a26b-4126-9f42-6741a35e66c9 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-unplugged-52cf6915-a26b-4126-9f42-6741a35e66c9 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-unplugged-52cf6915-a26b-4126-9f42-6741a35e66c9 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-plugged-52cf6915-a26b-4126-9f42-6741a35e66c9 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] Acquiring lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] No waiting events found dispatching network-vif-plugged-52cf6915-a26b-4126-9f42-6741a35e66c9 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:45 user nova-compute[75672]: WARNING nova.compute.manager [req-3b2a0315-814e-4a3e-a6dd-e821a0134a94 req-b646e621-8af4-4a22-8da2-8002e6de0be0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received unexpected event network-vif-plugged-52cf6915-a26b-4126-9f42-6741a35e66c9 for instance with vm_state active and task_state deleting.
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: INFO os_vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:be:df,bridge_name='br-int',has_traffic_filtering=True,id=bffe61b1-46cc-476d-b96e-c4cb5b81fb63,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbffe61b1-46')
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7df92582-df3e-4666-8afc-0fa41fa10d27", "address": "fa:16:3e:c0:57:d2", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df92582-df", "ovs_interfaceid": "7df92582-df3e-4666-8afc-0fa41fa10d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "7df92582-df3e-4666-8afc-0fa41fa10d27", "address": "fa:16:3e:c0:57:d2", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df92582-df", "ovs_interfaceid": "7df92582-df3e-4666-8afc-0fa41fa10d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:57:d2,bridge_name='br-int',has_traffic_filtering=True,id=7df92582-df3e-4666-8afc-0fa41fa10d27,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df92582-df') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:57:d2,bridge_name='br-int',has_traffic_filtering=True,id=7df92582-df3e-4666-8afc-0fa41fa10d27,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df92582-df') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7df92582-df, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:45 user nova-compute[75672]: INFO nova.compute.manager [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Took 5.29 seconds to destroy the instance on the hypervisor.
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebb1a345-42b7-4e03-bf8f-88d26d382c40) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: INFO os_vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:57:d2,bridge_name='br-int',has_traffic_filtering=True,id=7df92582-df3e-4666-8afc-0fa41fa10d27,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df92582-df')
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "address": "fa:16:3e:6a:c7:b1", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0976de-f4", "ovs_interfaceid": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "address": "fa:16:3e:6a:c7:b1", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0976de-f4", "ovs_interfaceid": "2f0976de-f44c-4de2-9eb1-4a9f98c16672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c7:b1,bridge_name='br-int',has_traffic_filtering=True,id=2f0976de-f44c-4de2-9eb1-4a9f98c16672,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0976de-f4') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c7:b1,bridge_name='br-int',has_traffic_filtering=True,id=2f0976de-f44c-4de2-9eb1-4a9f98c16672,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0976de-f4') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f0976de-f4, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=643bfd43-ef97-4b48-b9ff-7384f526a07d) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: INFO os_vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c7:b1,bridge_name='br-int',has_traffic_filtering=True,id=2f0976de-f44c-4de2-9eb1-4a9f98c16672,network=Network(136b26d4-1c5d-44da-8ec0-e31567ea28d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0976de-f4')
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "441e94f2-f857-4b09-886a-b958df41483a", "address": "fa:16:3e:00:9b:13", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441e94f2-f8", "ovs_interfaceid": "441e94f2-f857-4b09-886a-b958df41483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "441e94f2-f857-4b09-886a-b958df41483a", "address": "fa:16:3e:00:9b:13", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441e94f2-f8", "ovs_interfaceid": "441e94f2-f857-4b09-886a-b958df41483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:9b:13,bridge_name='br-int',has_traffic_filtering=True,id=441e94f2-f857-4b09-886a-b958df41483a,network=Network(816f5a3b-528a-4f69-aa12-624766d6c89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441e94f2-f8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9b:13,bridge_name='br-int',has_traffic_filtering=True,id=441e94f2-f857-4b09-886a-b958df41483a,network=Network(816f5a3b-528a-4f69-aa12-624766d6c89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441e94f2-f8') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap441e94f2-f8, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecfb09ee-53dc-4504-af96-8f11a0a47f40) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: INFO os_vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9b:13,bridge_name='br-int',has_traffic_filtering=True,id=441e94f2-f857-4b09-886a-b958df41483a,network=Network(816f5a3b-528a-4f69-aa12-624766d6c89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441e94f2-f8')
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1820842440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1820842440',id=12,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4LByLorYpkkYtWTVcDHPqY4oRkPuw5OHEztAKmjZArjCbHSANtJHIMpOdoXwUG1FX3r/W29afBGtDl26L2KLqHB0lGd1i52WtGdSrr65oz/SRXbF/Ns/+q+SzuAl4oQ==',key_name='tempest-keypair-1591005591',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5eff920517bb4adc87f684e992617e3c',ramdisk_id='',reservation_id='r-d1hd49vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-386009414',owner_user_name='tempest-TaggedBootDevicesTest-386009414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c8bc724a68b48eca9f210b9c875ac80',uuid=d8328382-e998-44b8-9c34-a1dbf74746e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52cf6915-a26b-4126-9f42-6741a35e66c9", "address": "fa:16:3e:1f:66:ac", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52cf6915-a2", "ovs_interfaceid": "52cf6915-a26b-4126-9f42-6741a35e66c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converting VIF {"id": "52cf6915-a26b-4126-9f42-6741a35e66c9", "address": "fa:16:3e:1f:66:ac", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52cf6915-a2", "ovs_interfaceid": "52cf6915-a26b-4126-9f42-6741a35e66c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:66:ac,bridge_name='br-int',has_traffic_filtering=True,id=52cf6915-a26b-4126-9f42-6741a35e66c9,network=Network(816f5a3b-528a-4f69-aa12-624766d6c89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52cf6915-a2') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:66:ac,bridge_name='br-int',has_traffic_filtering=True,id=52cf6915-a26b-4126-9f42-6741a35e66c9,network=Network(816f5a3b-528a-4f69-aa12-624766d6c89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52cf6915-a2') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52cf6915-a2, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=558d259b-c089-41fe-8236-022247469a53) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: INFO os_vif [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:66:ac,bridge_name='br-int',has_traffic_filtering=True,id=52cf6915-a26b-4126-9f42-6741a35e66c9,network=Network(816f5a3b-528a-4f69-aa12-624766d6c89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52cf6915-a2')
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MieHjUNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:35:45 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4a4cdf-9202-46fb-a15e-ff35f7267d55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:35:45 user nova-compute[75672]: No targets found.
Nov 30 12:35:45 user nova-compute[75672]: iSNS:
Nov 30 12:35:45 user nova-compute[75672]: No targets found.
Nov 30 12:35:45 user nova-compute[75672]: STATIC:
Nov 30 12:35:45 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:35:45 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:45 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:45 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629
Nov 30 12:35:45 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:45 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:45 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:35:45 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:45 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:45 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71
Nov 30 12:35:45 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:45 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:45 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c
Nov 30 12:35:45 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:45 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:45 user nova-compute[75672]: FIRMWARE:
Nov 30 12:35:45 user nova-compute[75672]: No targets found.
Nov 30 12:35:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:35:45 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:35:45 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a0a36b-0450-4b35-b025-465e850700fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2768f8f8-eef3-4487-ac51-c3805c7a58a6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:35:45 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:45 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:45 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:45 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 (non-flash)
Nov 30 12:35:45 user nova-compute[75672]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:45 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:45 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:45 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd4669bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[62250309-2987-4dfc-9b12-2bc90d7317fb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7405344-53eb-4776-be22-cf0dff1fabc1]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d35c49-9267-49bd-afdb-4f698d0a78c5]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed78475-f3be-45ce-b619-a3b6f799933e]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[94caaf8c-e819-4286-be9c-a5dd5bb0a97b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.network.neutron [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Successfully updated port: e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa25e2fc-ae42-4391-a467-9806e47b0689]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71, portal: 172.16.0.220,3260]
Nov 30 12:35:45 user nova-compute[75672]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71, portal: 172.16.0.220,3260] successful.
Nov 30 12:35:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "refresh_cache-3338ed96-33ff-45e6-b3da-05fbb242a3a9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquired lock "refresh_cache-3338ed96-33ff-45e6-b3da-05fbb242a3a9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.network.neutron [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff4f1f-381a-463d-ae72-ecf5c174fd71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[131d9b34-4d00-4401-8f7e-d1a922abf03f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] <== disconnect_volume: return (344ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aqHFfgWO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:35:45 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e36c382-fc66-4cde-9c4c-12e2ad61d772]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:35:45 user nova-compute[75672]: No targets found.
Nov 30 12:35:45 user nova-compute[75672]: iSNS:
Nov 30 12:35:45 user nova-compute[75672]: No targets found.
Nov 30 12:35:45 user nova-compute[75672]: STATIC:
Nov 30 12:35:45 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:35:45 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:45 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:45 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629
Nov 30 12:35:45 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:45 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:45 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:35:45 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:45 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:45 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c
Nov 30 12:35:45 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:45 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:45 user nova-compute[75672]: FIRMWARE:
Nov 30 12:35:45 user nova-compute[75672]: No targets found.
Nov 30 12:35:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:35:45 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:35:45 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b1ef0e-1eef-401c-a45d-0c325a9f8297]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG nova.network.neutron [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf49c1cc-8569-4faf-bc02-edc22bf16a3d]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:45 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:45 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:45 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c (non-flash)
Nov 30 12:35:45 user nova-compute[75672]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:45 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:45 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd42be3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c'): ({'sdd'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Removing single pathed devices sdd {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa443bf-f0c3-4ff7-82d5-a8f42f407de1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5cd9ec-92a9-4f75-a4fc-ef8a5c6f085d]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Flushing IO for device /dev/sdd {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[004202d6-3fc1-4939-8f5f-eda750181dde]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5cce13-916e-43bf-ad0e-d1b5c0307de1]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] SCSI volumes sdd have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a91e6a-5a22-459c-bb0e-b50474eda1d4]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63176f3-cac3-465a-8b80-9c948ac9b193]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c, portal: 172.16.0.220,3260]
Nov 30 12:35:45 user nova-compute[75672]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c, portal: 172.16.0.220,3260] successful.
Nov 30 12:35:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a3c4e6-bb1e-4241-9004-509bbd493e5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2641d344-04c7-41e3-9631-ed52bfe145ad]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] <== disconnect_volume: return (318ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qekKBwMd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:35:46 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7eb1526-eb84-4992-bed5-8e7d52b3b6a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:35:46 user nova-compute[75672]: No targets found.
Nov 30 12:35:46 user nova-compute[75672]: iSNS:
Nov 30 12:35:46 user nova-compute[75672]: No targets found.
Nov 30 12:35:46 user nova-compute[75672]: STATIC:
Nov 30 12:35:46 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:35:46 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:46 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:46 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629
Nov 30 12:35:46 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:46 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:46 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:35:46 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:46 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:46 user nova-compute[75672]: FIRMWARE:
Nov 30 12:35:46 user nova-compute[75672]: No targets found.
Nov 30 12:35:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:35:46 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:35:46 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ae4912-2161-481b-843f-3793c10e2aff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bb00bd-5145-4569-8644-e9789a50fb11]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:46 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:46 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 (non-flash)
Nov 30 12:35:46 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:46 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd450c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629'): ({'sdf'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Removing single pathed devices sdf {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb9275e-aa39-48b6-84fb-0fcd384dc6d4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Updating instance_info_cache with network_info: [{"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f8a78c-7151-4a99-8426-638c1c7369dc]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Flushing IO for device /dev/sdf {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaf2855-7fc0-4b83-b05d-946233ef6509]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Releasing lock "refresh_cache-3338ed96-33ff-45e6-b3da-05fbb242a3a9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Instance network_info: |[{"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Start _get_guest_xml network_info=[{"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:35:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:35:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1391619292',display_name='tempest-tempest.common.compute-instance-1391619292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1391619292',id=16,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT+FpkNSPv7BTuQ0cGiU6Rv4YtX1ZWV5lv1HhpDo1sUC2n4QhYREUMjOJX6ptwW8wmUBY31zFAipq19+jfVo+chxFhdwghv2LqDjZfmlGZs/5ZFvO1nsasH0J73l3NYfQ==',key_name='tempest-keypair-21714305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-40qany06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:35:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=3338ed96-33ff-45e6-b3da-05fbb242a3a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:20:54,bridge_name='br-int',has_traffic_filtering=True,id=e6b0f7c3-fddc-4725-991e-7155b341322e,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b0f7c3-fd') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.objects.instance [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lazy-loading 'pci_devices' on Instance uuid 3338ed96-33ff-45e6-b3da-05fbb242a3a9 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aaa8e9-6d10-4e90-b91d-d26324a36b14]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] SCSI volumes sdf have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:35:46 user nova-compute[75672]:   <uuid>3338ed96-33ff-45e6-b3da-05fbb242a3a9</uuid>
Nov 30 12:35:46 user nova-compute[75672]:   <name>instance-00000010</name>
Nov 30 12:35:46 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:35:46 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:35:46 user nova-compute[75672]:   <metadata>
Nov 30 12:35:46 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:35:46 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:35:46 user nova-compute[75672]:       <nova:name>tempest-tempest.common.compute-instance-1391619292</nova:name>
Nov 30 12:35:46 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:35:46</nova:creationTime>
Nov 30 12:35:46 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:35:46 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:35:46 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:35:46 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:35:46 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:35:46 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:35:46 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:35:46 user nova-compute[75672]:       <nova:owner>
Nov 30 12:35:46 user nova-compute[75672]:         <nova:user uuid="15791a052aef4d7a9bc79c97075cbdc9">tempest-ServerActionsTestOtherA-2076465849-project-member</nova:user>
Nov 30 12:35:46 user nova-compute[75672]:         <nova:project uuid="51606113e3d1460894fdc500924cb37a">tempest-ServerActionsTestOtherA-2076465849</nova:project>
Nov 30 12:35:46 user nova-compute[75672]:       </nova:owner>
Nov 30 12:35:46 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:35:46 user nova-compute[75672]:       <nova:ports>
Nov 30 12:35:46 user nova-compute[75672]:         <nova:port uuid="e6b0f7c3-fddc-4725-991e-7155b341322e">
Nov 30 12:35:46 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 12:35:46 user nova-compute[75672]:         </nova:port>
Nov 30 12:35:46 user nova-compute[75672]:       </nova:ports>
Nov 30 12:35:46 user nova-compute[75672]:     </nova:instance>
Nov 30 12:35:46 user nova-compute[75672]:   </metadata>
Nov 30 12:35:46 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:35:46 user nova-compute[75672]:     <system>
Nov 30 12:35:46 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:35:46 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:35:46 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:35:46 user nova-compute[75672]:       <entry name="serial">3338ed96-33ff-45e6-b3da-05fbb242a3a9</entry>
Nov 30 12:35:46 user nova-compute[75672]:       <entry name="uuid">3338ed96-33ff-45e6-b3da-05fbb242a3a9</entry>
Nov 30 12:35:46 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:35:46 user nova-compute[75672]:     </system>
Nov 30 12:35:46 user nova-compute[75672]:   </sysinfo>
Nov 30 12:35:46 user nova-compute[75672]:   <os>
Nov 30 12:35:46 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:35:46 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:35:46 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:35:46 user nova-compute[75672]:   </os>
Nov 30 12:35:46 user nova-compute[75672]:   <features>
Nov 30 12:35:46 user nova-compute[75672]:     <acpi/>
Nov 30 12:35:46 user nova-compute[75672]:     <apic/>
Nov 30 12:35:46 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:35:46 user nova-compute[75672]:   </features>
Nov 30 12:35:46 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:35:46 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:35:46 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:35:46 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:35:46 user nova-compute[75672]:   </clock>
Nov 30 12:35:46 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:35:46 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:35:46 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:35:46 user nova-compute[75672]:   </cpu>
Nov 30 12:35:46 user nova-compute[75672]:   <devices>
Nov 30 12:35:46 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:35:46 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:35:46 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk"/>
Nov 30 12:35:46 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:35:46 user nova-compute[75672]:     </disk>
Nov 30 12:35:46 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:35:46 user nova-compute[75672]:       <mac address="fa:16:3e:57:20:54"/>
Nov 30 12:35:46 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:35:46 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:35:46 user nova-compute[75672]:       <target dev="tape6b0f7c3-fd"/>
Nov 30 12:35:46 user nova-compute[75672]:     </interface>
Nov 30 12:35:46 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:35:46 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/console.log" append="off"/>
Nov 30 12:35:46 user nova-compute[75672]:     </serial>
Nov 30 12:35:46 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:35:46 user nova-compute[75672]:     <video>
Nov 30 12:35:46 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:35:46 user nova-compute[75672]:     </video>
Nov 30 12:35:46 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:35:46 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:35:46 user nova-compute[75672]:     </rng>
Nov 30 12:35:46 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:35:46 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:35:46 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:35:46 user nova-compute[75672]:     </memballoon>
Nov 30 12:35:46 user nova-compute[75672]:   </devices>
Nov 30 12:35:46 user nova-compute[75672]: </domain>
Nov 30 12:35:46 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1391619292',display_name='tempest-tempest.common.compute-instance-1391619292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1391619292',id=16,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT+FpkNSPv7BTuQ0cGiU6Rv4YtX1ZWV5lv1HhpDo1sUC2n4QhYREUMjOJX6ptwW8wmUBY31zFAipq19+jfVo+chxFhdwghv2LqDjZfmlGZs/5ZFvO1nsasH0J73l3NYfQ==',key_name='tempest-keypair-21714305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-40qany06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:35:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=3338ed96-33ff-45e6-b3da-05fbb242a3a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:20:54,bridge_name='br-int',has_traffic_filtering=True,id=e6b0f7c3-fddc-4725-991e-7155b341322e,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b0f7c3-fd') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_vif [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:20:54,bridge_name='br-int',has_traffic_filtering=True,id=e6b0f7c3-fddc-4725-991e-7155b341322e,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b0f7c3-fd') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0992a04c-56fa-436a-b93e-8e104552a57b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db2148c4-57c6-5216-819b-6da365435171', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6b0f7c3-fd, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6b0f7c3-fd, col_values=(('qos', UUID('accf239c-a2d8-4cb9-b0f8-64bb965bbf68')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6b0f7c3-fd, col_values=(('external_ids', {'iface-id': 'e6b0f7c3-fddc-4725-991e-7155b341322e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:20:54', 'vm-uuid': '3338ed96-33ff-45e6-b3da-05fbb242a3a9'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:46 user nova-compute[75672]: INFO os_vif [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:20:54,bridge_name='br-int',has_traffic_filtering=True,id=e6b0f7c3-fddc-4725-991e-7155b341322e,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b0f7c3-fd')
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d60016-675b-4aac-973e-cff8349ff377]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629, portal: 172.16.0.220,3260]
Nov 30 12:35:46 user nova-compute[75672]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629, portal: 172.16.0.220,3260] successful.
Nov 30 12:35:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417630b1-4b40-4ed4-acef-5309c9f42629 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc88cc5-c78f-4d91-a6f6-6c27c09abe59]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] <== disconnect_volume: return (350ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:35:46 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Deleting instance files /opt/stack/data/nova/instances/d8328382-e998-44b8-9c34-a1dbf74746e7_del
Nov 30 12:35:46 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Deletion of /opt/stack/data/nova/instances/d8328382-e998-44b8-9c34-a1dbf74746e7_del complete
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] No VIF found with MAC fa:16:3e:57:20:54, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:35:46 user nova-compute[75672]: INFO nova.compute.manager [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Took 4.02 seconds to destroy the instance on the hypervisor.
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:46 user nova-compute[75672]: INFO nova.compute.manager [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Terminating instance
Nov 30 12:35:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-faa7f3e6-801a-414d-b32d-8054dbb75def req-3083e708-91be-4b5d-8d91-eb6adce5f134 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received event network-changed-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-faa7f3e6-801a-414d-b32d-8054dbb75def req-3083e708-91be-4b5d-8d91-eb6adce5f134 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Refreshing instance network info cache due to event network-changed-e6b0f7c3-fddc-4725-991e-7155b341322e. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-faa7f3e6-801a-414d-b32d-8054dbb75def req-3083e708-91be-4b5d-8d91-eb6adce5f134 service nova] Acquiring lock "refresh_cache-3338ed96-33ff-45e6-b3da-05fbb242a3a9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-faa7f3e6-801a-414d-b32d-8054dbb75def req-3083e708-91be-4b5d-8d91-eb6adce5f134 service nova] Acquired lock "refresh_cache-3338ed96-33ff-45e6-b3da-05fbb242a3a9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG nova.network.neutron [req-faa7f3e6-801a-414d-b32d-8054dbb75def req-3083e708-91be-4b5d-8d91-eb6adce5f134 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Refreshing network info cache for port e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-f67f9ceb-3199-43c8-b963-ce39bd5b9972 req-7f63697c-92b9-4482-9a17-5ace5be9f761 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received event network-vif-unplugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f67f9ceb-3199-43c8-b963-ce39bd5b9972 req-7f63697c-92b9-4482-9a17-5ace5be9f761 service nova] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f67f9ceb-3199-43c8-b963-ce39bd5b9972 req-7f63697c-92b9-4482-9a17-5ace5be9f761 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f67f9ceb-3199-43c8-b963-ce39bd5b9972 req-7f63697c-92b9-4482-9a17-5ace5be9f761 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-f67f9ceb-3199-43c8-b963-ce39bd5b9972 req-7f63697c-92b9-4482-9a17-5ace5be9f761 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] No waiting events found dispatching network-vif-unplugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-f67f9ceb-3199-43c8-b963-ce39bd5b9972 req-7f63697c-92b9-4482-9a17-5ace5be9f761 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received event network-vif-unplugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:47 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Instance destroyed successfully.
Nov 30 12:35:47 user nova-compute[75672]: DEBUG nova.objects.instance [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lazy-loading 'resources' on Instance uuid 84f3ca7c-05db-4714-a685-3598bc6134d3 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:32:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-500770239',display_name='tempest-TestVolumeSwap-server-500770239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-500770239',id=7,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk0/7Z/SxM9DFaYc2+TMknW9VHTXmMYv1R8MjNRjbGp/rVM3jARoBr3XKwKN6Pd14IJSPOkMrpYiSTwxeAVUUqFAtDNNawDeqKd/wbQ5WLEYafztJdMtZ02+EPbi2oulg==',key_name='tempest-keypair-3013591',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39eae439dda0405e84c7e37b768e28a0',ramdisk_id='',reservation_id='r-1w4tom8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1206325901',owner_user_name='tempest-TestVolumeSwap-1206325901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:32:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='743a7b7ec097405a936c7ae01f870d36',uuid=84f3ca7c-05db-4714-a685-3598bc6134d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "address": "fa:16:3e:36:eb:96", "network": {"id": "c905cd92-2463-450c-9c3e-6fef670e27e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1410834846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39eae439dda0405e84c7e37b768e28a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ffba33-19", "ovs_interfaceid": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Converting VIF {"id": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "address": "fa:16:3e:36:eb:96", "network": {"id": "c905cd92-2463-450c-9c3e-6fef670e27e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1410834846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39eae439dda0405e84c7e37b768e28a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ffba33-19", "ovs_interfaceid": "19ffba33-190e-4fe0-bb72-53d8e79bbbd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:eb:96,bridge_name='br-int',has_traffic_filtering=True,id=19ffba33-190e-4fe0-bb72-53d8e79bbbd0,network=Network(c905cd92-2463-450c-9c3e-6fef670e27e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ffba33-19') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG os_vif [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:eb:96,bridge_name='br-int',has_traffic_filtering=True,id=19ffba33-190e-4fe0-bb72-53d8e79bbbd0,network=Network(c905cd92-2463-450c-9c3e-6fef670e27e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ffba33-19') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19ffba33-19, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6808f5cf-a9d1-4c1e-b107-15a422dcbb0c) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:47 user nova-compute[75672]: INFO os_vif [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:eb:96,bridge_name='br-int',has_traffic_filtering=True,id=19ffba33-190e-4fe0-bb72-53d8e79bbbd0,network=Network(c905cd92-2463-450c-9c3e-6fef670e27e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ffba33-19')
Nov 30 12:35:47 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Deleting instance files /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3_del
Nov 30 12:35:47 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Deletion of /opt/stack/data/nova/instances/84f3ca7c-05db-4714-a685-3598bc6134d3_del complete
Nov 30 12:35:47 user nova-compute[75672]: INFO nova.compute.manager [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 30 12:35:47 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:35:47 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:35:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:48 user nova-compute[75672]: DEBUG nova.network.neutron [req-faa7f3e6-801a-414d-b32d-8054dbb75def req-3083e708-91be-4b5d-8d91-eb6adce5f134 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Updated VIF entry in instance network info cache for port e6b0f7c3-fddc-4725-991e-7155b341322e. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:35:48 user nova-compute[75672]: DEBUG nova.network.neutron [req-faa7f3e6-801a-414d-b32d-8054dbb75def req-3083e708-91be-4b5d-8d91-eb6adce5f134 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Updating instance_info_cache with network_info: [{"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-faa7f3e6-801a-414d-b32d-8054dbb75def req-3083e708-91be-4b5d-8d91-eb6adce5f134 service nova] Releasing lock "refresh_cache-3338ed96-33ff-45e6-b3da-05fbb242a3a9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:35:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received event network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] No waiting events found dispatching network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:49 user nova-compute[75672]: WARNING nova.compute.manager [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received unexpected event network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e for instance with vm_state building and task_state spawning.
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-deleted-2304dd64-2456-475f-bc90-16143352b18a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:49 user nova-compute[75672]: INFO nova.compute.manager [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Neutron deleted interface 2304dd64-2456-475f-bc90-16143352b18a; detaching it from the instance and deleting it from the info cache
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.network.neutron [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating instance_info_cache with network_info: [{"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "address": "fa:16:3e:26:f7:c2", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4ff97-44", "ovs_interfaceid": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "address": "fa:16:3e:96:81:8b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195140fe-5a", "ovs_interfaceid": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9177927-6e30-497f-9080-78798e05686c", "address": "fa:16:3e:a4:a7:f2", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9177927-6e", "ovs_interfaceid": "d9177927-6e30-497f-9080-78798e05686c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Detach interface failed, port_id=2304dd64-2456-475f-bc90-16143352b18a, reason: Instance 35ef80cd-d7d8-421b-8296-44b107b1bce4 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received event network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] No waiting events found dispatching network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:49 user nova-compute[75672]: WARNING nova.compute.manager [req-046103c6-edcb-460d-a31e-16f4b2062172 req-0fd919fa-6656-4381-8cea-752ce73e47ee service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received unexpected event network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e for instance with vm_state building and task_state spawning.
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-aba977a7-4602-4afb-a958-0a99e0e2374d req-1e9292cf-e0be-4e24-9a9a-2c6dbaaf3479 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received event network-vif-deleted-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:49 user nova-compute[75672]: INFO nova.compute.manager [req-aba977a7-4602-4afb-a958-0a99e0e2374d req-1e9292cf-e0be-4e24-9a9a-2c6dbaaf3479 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Neutron deleted interface 19ffba33-190e-4fe0-bb72-53d8e79bbbd0; detaching it from the instance and deleting it from the info cache
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.network.neutron [req-aba977a7-4602-4afb-a958-0a99e0e2374d req-1e9292cf-e0be-4e24-9a9a-2c6dbaaf3479 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:49 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Took 1.34 seconds to deallocate network for instance.
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-aba977a7-4602-4afb-a958-0a99e0e2374d req-1e9292cf-e0be-4e24-9a9a-2c6dbaaf3479 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Detach interface failed, port_id=19ffba33-190e-4fe0-bb72-53d8e79bbbd0, reason: Instance 84f3ca7c-05db-4714-a685-3598bc6134d3 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received event network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] No waiting events found dispatching network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:49 user nova-compute[75672]: WARNING nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received unexpected event network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 for instance with vm_state deleted and task_state None.
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received event network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] No waiting events found dispatching network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:49 user nova-compute[75672]: WARNING nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received unexpected event network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 for instance with vm_state deleted and task_state None.
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received event network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] No waiting events found dispatching network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:49 user nova-compute[75672]: WARNING nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received unexpected event network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 for instance with vm_state deleted and task_state None.
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received event network-vif-unplugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] No waiting events found dispatching network-vif-unplugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:49 user nova-compute[75672]: WARNING nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received unexpected event network-vif-unplugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 for instance with vm_state deleted and task_state None.
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received event network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Acquiring lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] No waiting events found dispatching network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:49 user nova-compute[75672]: WARNING nova.compute.manager [req-3c9ed201-40cb-44ec-a468-357dc311d305 req-a810ba8b-3b76-4dcf-839e-50100c105ec4 service nova] [instance: 84f3ca7c-05db-4714-a685-3598bc6134d3] Received unexpected event network-vif-plugged-19ffba33-190e-4fe0-bb72-53d8e79bbbd0 for instance with vm_state deleted and task_state None.
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.objects.instance [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'flavor' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquired lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.network.neutron [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.objects.instance [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'info_cache' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:49 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Deleted allocations for instance 84f3ca7c-05db-4714-a685-3598bc6134d3
Nov 30 12:35:49 user nova-compute[75672]: DEBUG nova.objects.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Object Instance<1fba8af1-8074-4ce8-be23-912e9850fc41> lazy-loaded attributes: flavor,info_cache {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4a543de0-fad0-4ced-9778-cb2e0002b575 tempest-TestVolumeSwap-1206325901 tempest-TestVolumeSwap-1206325901-project-member] Lock "84f3ca7c-05db-4714-a685-3598bc6134d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.365s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:35:50 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Instance spawned successfully.
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:35:50 user nova-compute[75672]: INFO nova.compute.manager [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Took 6.84 seconds to spawn the instance on the hypervisor.
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:50 user nova-compute[75672]: INFO nova.compute.manager [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Took 8.13 seconds to build instance.
Nov 30 12:35:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0ae2d331-b02e-45d7-a732-9af46686811c tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.261s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.network.neutron [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Updating instance_info_cache with network_info: [{"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Releasing lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:35:50 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Instance destroyed successfully.
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.objects.instance [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'resources' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.objects.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Object Instance<1fba8af1-8074-4ce8-be23-912e9850fc41> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1561719818',display_name='tempest-AttachVolumeTestJSON-server-1561719818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1561719818',id=4,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdea+lvE9UsOmP6FYZGbGByAYyZUFyR2cvDgR8GqqqfKWiRxkUCGs+K9HROvIA5wapQ0MyZOJSLL3feZaXU9b6HVLyibqADHJmmyyoRAcM/oJWT1i+VE463gQZDjaPsHw==',key_name='tempest-keypair-145731974',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:32:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7a0ca8eb58644e058b2019a4faa41a46',ramdisk_id='',reservation_id='r-crpjd40b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2004678694',owner_user_name='tempest-AttachVolumeTestJSON-2004678694-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98ee9bd3b604b39a3f6013a40398642',uuid=1fba8af1-8074-4ce8-be23-912e9850fc41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converting VIF {"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG os_vif [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bfc6970-5d, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e40ab38-74a5-4dbe-ac52-4a9411ad577f) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:50 user nova-compute[75672]: INFO os_vif [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d')
Nov 30 12:35:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKkbRgPw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:35:50 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:35:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7ec877-9ee2-450c-b696-e26c48968f52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:35:50 user nova-compute[75672]: No targets found.
Nov 30 12:35:50 user nova-compute[75672]: iSNS:
Nov 30 12:35:50 user nova-compute[75672]: No targets found.
Nov 30 12:35:50 user nova-compute[75672]: STATIC:
Nov 30 12:35:50 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:35:50 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:50 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:50 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:35:50 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:35:50 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:35:50 user nova-compute[75672]: FIRMWARE:
Nov 30 12:35:50 user nova-compute[75672]: No targets found.
Nov 30 12:35:50 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:35:50 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:35:50 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:35:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c01915-cbc0-41e6-ae2a-1e16f516d9b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c57cc62-c7a6-4536-b041-48d3395eff73]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:51 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:51 user nova-compute[75672]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd42bf130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93'): ({'sdi'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Removing single pathed devices sdi {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[af737ce1-8e73-4da3-86c9-ff46e3cd659e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc593677-5dda-4b40-bd4b-2f008cc2b3b4]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Flushing IO for device /dev/sdi {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[60684485-c2b0-419d-9fb3-f72439057095]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.048s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d39e7c-b767-43c7-a8d9-a194ee30a0b5]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] SCSI volumes sdi have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[160b7bf5-4bad-4589-8b76-8e2bc5f30f7a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-deleted-d9177927-6e30-497f-9080-78798e05686c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:51 user nova-compute[75672]: INFO nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Neutron deleted interface d9177927-6e30-497f-9080-78798e05686c; detaching it from the instance and deleting it from the info cache
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.network.neutron [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating instance_info_cache with network_info: [{"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "address": "fa:16:3e:26:f7:c2", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4ff97-44", "ovs_interfaceid": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "address": "fa:16:3e:96:81:8b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195140fe-5a", "ovs_interfaceid": "195140fe-5a34-44cd-a93f-cbcc015f67d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Detach interface failed, port_id=d9177927-6e30-497f-9080-78798e05686c, reason: Instance 35ef80cd-d7d8-421b-8296-44b107b1bce4 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-deleted-195140fe-5a34-44cd-a93f-cbcc015f67d0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:51 user nova-compute[75672]: INFO nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Neutron deleted interface 195140fe-5a34-44cd-a93f-cbcc015f67d0; detaching it from the instance and deleting it from the info cache
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.network.neutron [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating instance_info_cache with network_info: [{"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "address": "fa:16:3e:26:f7:c2", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4ff97-44", "ovs_interfaceid": "c2a4ff97-44d0-4b5d-971b-c7015d3e54f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c34cf20-3f8f-411a-8d64-6806151a7651]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260]
Nov 30 12:35:51 user nova-compute[75672]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260] successful.
Nov 30 12:35:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c96f110-cf2d-493b-a445-60604eeff31b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] <== disconnect_volume: return (358ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-e1277c39-f695-4c10-a3fa-269b01be05d0 req-8c6d15fa-7eae-414a-9d45-32327164e586 service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Received event network-changed-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-e1277c39-f695-4c10-a3fa-269b01be05d0 req-8c6d15fa-7eae-414a-9d45-32327164e586 service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Refreshing instance network info cache due to event network-changed-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e1277c39-f695-4c10-a3fa-269b01be05d0 req-8c6d15fa-7eae-414a-9d45-32327164e586 service nova] Acquiring lock "refresh_cache-c8333c65-42ab-4de2-abc4-6cc672746b2b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e1277c39-f695-4c10-a3fa-269b01be05d0 req-8c6d15fa-7eae-414a-9d45-32327164e586 service nova] Acquired lock "refresh_cache-c8333c65-42ab-4de2-abc4-6cc672746b2b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.network.neutron [req-e1277c39-f695-4c10-a3fa-269b01be05d0 req-8c6d15fa-7eae-414a-9d45-32327164e586 service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Refreshing network info cache for port fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Detach interface failed, port_id=195140fe-5a34-44cd-a93f-cbcc015f67d0, reason: Instance 35ef80cd-d7d8-421b-8296-44b107b1bce4 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-deleted-2f0976de-f44c-4de2-9eb1-4a9f98c16672 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:51 user nova-compute[75672]: INFO nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Neutron deleted interface 2f0976de-f44c-4de2-9eb1-4a9f98c16672; detaching it from the instance and deleting it from the info cache
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.network.neutron [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [{"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7df92582-df3e-4666-8afc-0fa41fa10d27", "address": "fa:16:3e:c0:57:d2", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df92582-df", "ovs_interfaceid": "7df92582-df3e-4666-8afc-0fa41fa10d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "441e94f2-f857-4b09-886a-b958df41483a", "address": "fa:16:3e:00:9b:13", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441e94f2-f8", "ovs_interfaceid": "441e94f2-f857-4b09-886a-b958df41483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52cf6915-a26b-4126-9f42-6741a35e66c9", "address": "fa:16:3e:1f:66:ac", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52cf6915-a2", "ovs_interfaceid": "52cf6915-a26b-4126-9f42-6741a35e66c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Start _get_guest_xml network_info=[{"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '99f69182-b3b3-4539-a061-fecd49842cac', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKkbRgPw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '1fba8af1-8074-4ce8-be23-912e9850fc41', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6f5b089-e352-4270-b369-e79ce8349e93', 'serial': 'c6f5b089-e352-4270-b369-e79ce8349e93'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.objects.instance [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'numa_topology' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Detach interface failed, port_id=2f0976de-f44c-4de2-9eb1-4a9f98c16672, reason: Instance d8328382-e998-44b8-9c34-a1dbf74746e7 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-deleted-c2a4ff97-44d0-4b5d-971b-c7015d3e54f8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:51 user nova-compute[75672]: INFO nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Neutron deleted interface c2a4ff97-44d0-4b5d-971b-c7015d3e54f8; detaching it from the instance and deleting it from the info cache
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.network.neutron [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating instance_info_cache with network_info: [{"id": "9f5fce50-73ed-465d-bf21-f3902157d044", "address": "fa:16:3e:f6:e5:61", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f5fce50-73", "ovs_interfaceid": "9f5fce50-73ed-465d-bf21-f3902157d044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "927378ac-2059-4e53-a96b-ab629c814942", "address": "fa:16:3e:8b:af:0b", "network": {"id": "c9fcc20a-69c4-4532-9d6a-2b8eea2849a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1911078464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927378ac-20", "ovs_interfaceid": "927378ac-2059-4e53-a96b-ab629c814942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "address": "fa:16:3e:f6:86:05", "network": {"id": "61781429-98eb-4e65-9a1d-d2f04625dadf", "bridge": "br-int", "label": "tempest-device-tagging-net2-143147496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4ec663862ec640dcaba59b031512fe30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap288fbe5b-c2", "ovs_interfaceid": "288fbe5b-c2d5-434b-9ce1-82364edc246f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.objects.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Object Instance<1fba8af1-8074-4ce8-be23-912e9850fc41> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Detach interface failed, port_id=c2a4ff97-44d0-4b5d-971b-c7015d3e54f8, reason: Instance 35ef80cd-d7d8-421b-8296-44b107b1bce4 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-deleted-7df92582-df3e-4666-8afc-0fa41fa10d27 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:51 user nova-compute[75672]: INFO nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Neutron deleted interface 7df92582-df3e-4666-8afc-0fa41fa10d27; detaching it from the instance and deleting it from the info cache
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.network.neutron [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [{"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "441e94f2-f857-4b09-886a-b958df41483a", "address": "fa:16:3e:00:9b:13", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441e94f2-f8", "ovs_interfaceid": "441e94f2-f857-4b09-886a-b958df41483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52cf6915-a26b-4126-9f42-6741a35e66c9", "address": "fa:16:3e:1f:66:ac", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52cf6915-a2", "ovs_interfaceid": "52cf6915-a26b-4126-9f42-6741a35e66c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:51 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:35:51 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "c8333c65-42ab-4de2-abc4-6cc672746b2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "c8333c65-42ab-4de2-abc4-6cc672746b2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:51 user nova-compute[75672]: INFO nova.compute.manager [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Terminating instance
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.objects.instance [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-faece321-a793-4682-a989-5f458abbc96a req-9c3abb7f-0cf6-4506-bdfa-2a9bddc509b0 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Detach interface failed, port_id=7df92582-df3e-4666-8afc-0fa41fa10d27, reason: Instance d8328382-e998-44b8-9c34-a1dbf74746e7 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.objects.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Object Instance<1fba8af1-8074-4ce8-be23-912e9850fc41> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKkbRgPw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:35:51 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:35:51 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:35:51 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabab980-949d-43f1-a706-fa064e0b96f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:35:51 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ef6111-7c7a-4551-8333-bd18e5d0f94b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93] added
Nov 30 12:35:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:51 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Took 6.45 seconds to deallocate network for instance.
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d911f8-4534-4b5f-a1a3-d8ca5e40dd09]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c254da8-4f2d-4e0f-9517-ce66c13aea01]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKkbRgPw {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKkbRgPw" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e08d87-b75c-4a68-b00e-75d829d8d59a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iKkbRgPw'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4756f415-f54f-4a79-b015-ef4e0775eb3f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aac8d7-9bf1-48ad-a5fb-756b98e2b410]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabc5c75-a369-47e2-87ed-a046beaa1717]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260]
Nov 30 12:35:51 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260] successful.
Nov 30 12:35:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[83381377-0c13-4d3c-aa8d-ce016cc5b34c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e290154f-7dd6-419e-a4ed-9913277ba172]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:51 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:35:51 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:35:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3b9ed7-5479-46eb-aa98-299b9883532c]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:35:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKkbRgPw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.network.neutron [req-e1277c39-f695-4c10-a3fa-269b01be05d0 req-8c6d15fa-7eae-414a-9d45-32327164e586 service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Updated VIF entry in instance network info cache for port fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.network.neutron [req-e1277c39-f695-4c10-a3fa-269b01be05d0 req-8c6d15fa-7eae-414a-9d45-32327164e586 service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Updating instance_info_cache with network_info: [{"id": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "address": "fa:16:3e:57:e4:6e", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa8f95ae-9b", "ovs_interfaceid": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e1277c39-f695-4c10-a3fa-269b01be05d0 req-8c6d15fa-7eae-414a-9d45-32327164e586 service nova] Releasing lock "refresh_cache-c8333c65-42ab-4de2-abc4-6cc672746b2b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:35:52 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Instance destroyed successfully.
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.objects.instance [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'resources' on Instance uuid c8333c65-42ab-4de2-abc4-6cc672746b2b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:33:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-569767320',display_name='tempest-AttachVolumeNegativeTest-server-569767320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-569767320',id=13,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsAqUbkJX6+z0xMgs6Va9GYr95uHTgVijYiZLM8xjokvkeiqtWvKfDBxKWp11n47bP+vBioA23/H+uIyQtVqQTcSLrYSui1Wz0UKZA+Ug6hNeb62Sz7JgDloiN2WBbsuQ==',key_name='tempest-keypair-1376892281',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:34:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04f07019e3584771af197e865b6877cc',ramdisk_id='',reservation_id='r-jg1khlv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1224349538',owner_user_name='tempest-AttachVolumeNegativeTest-1224349538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:34:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3166f2b3dee4aa4aa738f1f15ca7d19',uuid=c8333c65-42ab-4de2-abc4-6cc672746b2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "address": "fa:16:3e:57:e4:6e", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa8f95ae-9b", "ovs_interfaceid": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converting VIF {"id": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "address": "fa:16:3e:57:e4:6e", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa8f95ae-9b", "ovs_interfaceid": "fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e4:6e,bridge_name='br-int',has_traffic_filtering=True,id=fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa8f95ae-9b') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG os_vif [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e4:6e,bridge_name='br-int',has_traffic_filtering=True,id=fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa8f95ae-9b') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa8f95ae-9b, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c203708c-acae-4ea0-8cab-d184e932d4fd) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:52 user nova-compute[75672]: INFO os_vif [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e4:6e,bridge_name='br-int',has_traffic_filtering=True,id=fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa8f95ae-9b')
Nov 30 12:35:52 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Deleting instance files /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b_del
Nov 30 12:35:52 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Deletion of /opt/stack/data/nova/instances/c8333c65-42ab-4de2-abc4-6cc672746b2b_del complete
Nov 30 12:35:52 user nova-compute[75672]: INFO nova.compute.manager [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 30 12:35:52 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '26132383232323864', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132383232323864', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1561719818',display_name='tempest-AttachVolumeTestJSON-server-1561719818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1561719818',id=4,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdea+lvE9UsOmP6FYZGbGByAYyZUFyR2cvDgR8GqqqfKWiRxkUCGs+K9HROvIA5wapQ0MyZOJSLL3feZaXU9b6HVLyibqADHJmmyyoRAcM/oJWT1i+VE463gQZDjaPsHw==',key_name='tempest-keypair-145731974',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:32:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7a0ca8eb58644e058b2019a4faa41a46',ramdisk_id='',reservation_id='r-crpjd40b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2004678694',owner_user_name='tempest-AttachVolumeTestJSON-2004678694-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98ee9bd3b604b39a3f6013a40398642',uuid=1fba8af1-8074-4ce8-be23-912e9850fc41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converting VIF {"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.objects.instance [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.objects.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Object Instance<1fba8af1-8074-4ce8-be23-912e9850fc41> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:35:52 user nova-compute[75672]:   <uuid>1fba8af1-8074-4ce8-be23-912e9850fc41</uuid>
Nov 30 12:35:52 user nova-compute[75672]:   <name>instance-00000004</name>
Nov 30 12:35:52 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:35:52 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:35:52 user nova-compute[75672]:   <metadata>
Nov 30 12:35:52 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:35:52 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:35:52 user nova-compute[75672]:       <nova:name>tempest-AttachVolumeTestJSON-server-1561719818</nova:name>
Nov 30 12:35:52 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:35:51</nova:creationTime>
Nov 30 12:35:52 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:35:52 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:35:52 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:35:52 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:35:52 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:35:52 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:35:52 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:35:52 user nova-compute[75672]:       <nova:owner>
Nov 30 12:35:52 user nova-compute[75672]:         <nova:user uuid="e98ee9bd3b604b39a3f6013a40398642">tempest-AttachVolumeTestJSON-2004678694-project-member</nova:user>
Nov 30 12:35:52 user nova-compute[75672]:         <nova:project uuid="7a0ca8eb58644e058b2019a4faa41a46">tempest-AttachVolumeTestJSON-2004678694</nova:project>
Nov 30 12:35:52 user nova-compute[75672]:       </nova:owner>
Nov 30 12:35:52 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:35:52 user nova-compute[75672]:       <nova:ports>
Nov 30 12:35:52 user nova-compute[75672]:         <nova:port uuid="5bfc6970-5d97-4f13-8603-d508342c282a">
Nov 30 12:35:52 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 12:35:52 user nova-compute[75672]:         </nova:port>
Nov 30 12:35:52 user nova-compute[75672]:       </nova:ports>
Nov 30 12:35:52 user nova-compute[75672]:     </nova:instance>
Nov 30 12:35:52 user nova-compute[75672]:   </metadata>
Nov 30 12:35:52 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:35:52 user nova-compute[75672]:     <system>
Nov 30 12:35:52 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:35:52 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:35:52 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:35:52 user nova-compute[75672]:       <entry name="serial">1fba8af1-8074-4ce8-be23-912e9850fc41</entry>
Nov 30 12:35:52 user nova-compute[75672]:       <entry name="uuid">1fba8af1-8074-4ce8-be23-912e9850fc41</entry>
Nov 30 12:35:52 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:35:52 user nova-compute[75672]:     </system>
Nov 30 12:35:52 user nova-compute[75672]:   </sysinfo>
Nov 30 12:35:52 user nova-compute[75672]:   <os>
Nov 30 12:35:52 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:35:52 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:35:52 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:35:52 user nova-compute[75672]:   </os>
Nov 30 12:35:52 user nova-compute[75672]:   <features>
Nov 30 12:35:52 user nova-compute[75672]:     <acpi/>
Nov 30 12:35:52 user nova-compute[75672]:     <apic/>
Nov 30 12:35:52 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:35:52 user nova-compute[75672]:   </features>
Nov 30 12:35:52 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:35:52 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:35:52 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:35:52 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:35:52 user nova-compute[75672]:   </clock>
Nov 30 12:35:52 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:35:52 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:35:52 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:35:52 user nova-compute[75672]:   </cpu>
Nov 30 12:35:52 user nova-compute[75672]:   <devices>
Nov 30 12:35:52 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:35:52 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:35:52 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk"/>
Nov 30 12:35:52 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:35:52 user nova-compute[75672]:     </disk>
Nov 30 12:35:52 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:35:52 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:35:52 user nova-compute[75672]:       <source dev="/dev/sdb"/>
Nov 30 12:35:52 user nova-compute[75672]:       <target dev="vdb" bus="virtio"/>
Nov 30 12:35:52 user nova-compute[75672]:       <serial>c6f5b089-e352-4270-b369-e79ce8349e93</serial>
Nov 30 12:35:52 user nova-compute[75672]:     </disk>
Nov 30 12:35:52 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:35:52 user nova-compute[75672]:       <mac address="fa:16:3e:99:e9:ab"/>
Nov 30 12:35:52 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:35:52 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:35:52 user nova-compute[75672]:       <target dev="tap5bfc6970-5d"/>
Nov 30 12:35:52 user nova-compute[75672]:     </interface>
Nov 30 12:35:52 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:35:52 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/console.log" append="off"/>
Nov 30 12:35:52 user nova-compute[75672]:     </serial>
Nov 30 12:35:52 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:35:52 user nova-compute[75672]:     <video>
Nov 30 12:35:52 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:35:52 user nova-compute[75672]:     </video>
Nov 30 12:35:52 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:35:52 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:35:52 user nova-compute[75672]:     </rng>
Nov 30 12:35:52 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:35:52 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:35:52 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:35:52 user nova-compute[75672]:     </memballoon>
Nov 30 12:35:52 user nova-compute[75672]:   </devices>
Nov 30 12:35:52 user nova-compute[75672]: </domain>
Nov 30 12:35:52 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:35:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Received event network-vif-deleted-288fbe5b-c2d5-434b-9ce1-82364edc246f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-deleted-52cf6915-a26b-4126-9f42-6741a35e66c9 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:53 user nova-compute[75672]: INFO nova.compute.manager [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Neutron deleted interface 52cf6915-a26b-4126-9f42-6741a35e66c9; detaching it from the instance and deleting it from the info cache
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.network.neutron [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [{"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "441e94f2-f857-4b09-886a-b958df41483a", "address": "fa:16:3e:00:9b:13", "network": {"id": "816f5a3b-528a-4f69-aa12-624766d6c89c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1241934291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441e94f2-f8", "ovs_interfaceid": "441e94f2-f857-4b09-886a-b958df41483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:53 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Took 6.88 seconds to deallocate network for instance.
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:53 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Took 0.91 seconds to deallocate network for instance.
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Detach interface failed, port_id=52cf6915-a26b-4126-9f42-6741a35e66c9, reason: Instance d8328382-e998-44b8-9c34-a1dbf74746e7 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Received event network-vif-unplugged-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] Acquiring lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] Lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] Lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] No waiting events found dispatching network-vif-unplugged-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Received event network-vif-unplugged-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Received event network-vif-plugged-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] Acquiring lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] Lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] Lock "c8333c65-42ab-4de2-abc4-6cc672746b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] No waiting events found dispatching network-vif-plugged-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:53 user nova-compute[75672]: WARNING nova.compute.manager [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Received unexpected event network-vif-plugged-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c for instance with vm_state active and task_state deleting.
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-deleted-441e94f2-f857-4b09-886a-b958df41483a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:53 user nova-compute[75672]: INFO nova.compute.manager [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Neutron deleted interface 441e94f2-f857-4b09-886a-b958df41483a; detaching it from the instance and deleting it from the info cache
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.network.neutron [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [{"id": "026ddb45-5a8b-4434-906c-7350c6e6f878", "address": "fa:16:3e:09:63:ab", "network": {"id": "a7a4a09c-2a4a-42f1-bc4d-54e2e1e7dc7d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-530366532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026ddb45-5a", "ovs_interfaceid": "026ddb45-5a8b-4434-906c-7350c6e6f878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-d7f9854f-0a6c-4bc4-9d70-b69c74ae560b req-b7fa4f74-c38f-4308-a9fe-b18de2d8691d service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Received event network-vif-deleted-fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:53 user nova-compute[75672]: INFO nova.compute.manager [req-d7f9854f-0a6c-4bc4-9d70-b69c74ae560b req-b7fa4f74-c38f-4308-a9fe-b18de2d8691d service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Neutron deleted interface fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c; detaching it from the instance and deleting it from the info cache
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.network.neutron [req-d7f9854f-0a6c-4bc4-9d70-b69c74ae560b req-b7fa4f74-c38f-4308-a9fe-b18de2d8691d service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.objects.instance [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-095cb7c2-8e1b-496e-adea-0481ef3591d5 req-225abf1d-5944-4858-83b1-3c60cf8527dd service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Detach interface failed, port_id=441e94f2-f857-4b09-886a-b958df41483a, reason: Instance d8328382-e998-44b8-9c34-a1dbf74746e7 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.objects.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Object Instance<1fba8af1-8074-4ce8-be23-912e9850fc41> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-d7f9854f-0a6c-4bc4-9d70-b69c74ae560b req-b7fa4f74-c38f-4308-a9fe-b18de2d8691d service nova] [instance: c8333c65-42ab-4de2-abc4-6cc672746b2b] Detach interface failed, port_id=fa8f95ae-9ba3-4b41-9fe0-76e9bddc943c, reason: Instance c8333c65-42ab-4de2-abc4-6cc672746b2b could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.229s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Cannot resize image /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.objects.instance [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'migration_context' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.objects.base [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Object Instance<1fba8af1-8074-4ce8-be23-912e9850fc41> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1561719818',display_name='tempest-AttachVolumeTestJSON-server-1561719818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1561719818',id=4,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdea+lvE9UsOmP6FYZGbGByAYyZUFyR2cvDgR8GqqqfKWiRxkUCGs+K9HROvIA5wapQ0MyZOJSLL3feZaXU9b6HVLyibqADHJmmyyoRAcM/oJWT1i+VE463gQZDjaPsHw==',key_name='tempest-keypair-145731974',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:32:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7a0ca8eb58644e058b2019a4faa41a46',ramdisk_id='',reservation_id='r-crpjd40b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2004678694',owner_user_name='tempest-AttachVolumeTestJSON-2004678694-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98ee9bd3b604b39a3f6013a40398642',uuid=1fba8af1-8074-4ce8-be23-912e9850fc41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converting VIF {"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG os_vif [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5487a777-6857-54ac-86e5-c2478f878475', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bfc6970-5d, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bfc6970-5d, col_values=(('qos', UUID('b659b5b4-29b8-4260-99cd-576b978217a5')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bfc6970-5d, col_values=(('external_ids', {'iface-id': '5bfc6970-5d97-4f13-8603-d508342c282a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:e9:ab', 'vm-uuid': '1fba8af1-8074-4ce8-be23-912e9850fc41'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:35:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:53 user nova-compute[75672]: INFO os_vif [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d')
Nov 30 12:35:54 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:35:54 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:35:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.627s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:54 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Deleted allocations for instance c8333c65-42ab-4de2-abc4-6cc672746b2b
Nov 30 12:35:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-706ba155-ce29-4117-a031-a1f1f83a1dbc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "c8333c65-42ab-4de2-abc4-6cc672746b2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.860s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:54 user nova-compute[75672]: INFO nova.compute.manager [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] [instance: 35ef80cd-d7d8-421b-8296-44b107b1bce4] Took 3.23 seconds to detach 3 volumes for instance.
Nov 30 12:35:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:55 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:35:55 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:35:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.558s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-b7d08206-0581-4878-91a4-5acfc3a49721 req-514d8eb1-3794-4a32-9576-05e3bbad9c31 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Received event network-vif-deleted-026ddb45-5a8b-4434-906c-7350c6e6f878 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:55 user nova-compute[75672]: INFO nova.compute.manager [req-b7d08206-0581-4878-91a4-5acfc3a49721 req-514d8eb1-3794-4a32-9576-05e3bbad9c31 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Neutron deleted interface 026ddb45-5a8b-4434-906c-7350c6e6f878; detaching it from the instance and deleting it from the info cache
Nov 30 12:35:55 user nova-compute[75672]: DEBUG nova.network.neutron [req-b7d08206-0581-4878-91a4-5acfc3a49721 req-514d8eb1-3794-4a32-9576-05e3bbad9c31 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Updating instance_info_cache with network_info: [{"id": "f50a4265-e775-4197-a5ec-5980f4cd0485", "address": "fa:16:3e:78:de:b4", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a4265-e7", "ovs_interfaceid": "f50a4265-e775-4197-a5ec-5980f4cd0485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "address": "fa:16:3e:56:be:df", "network": {"id": "136b26d4-1c5d-44da-8ec0-e31567ea28d1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1923655637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5eff920517bb4adc87f684e992617e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffe61b1-46", "ovs_interfaceid": "bffe61b1-46cc-476d-b96e-c4cb5b81fb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:35:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-b7d08206-0581-4878-91a4-5acfc3a49721 req-514d8eb1-3794-4a32-9576-05e3bbad9c31 service nova] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Detach interface failed, port_id=026ddb45-5a8b-4434-906c-7350c6e6f878, reason: Instance d8328382-e998-44b8-9c34-a1dbf74746e7 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:35:55 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Deleted allocations for instance 35ef80cd-d7d8-421b-8296-44b107b1bce4
Nov 30 12:35:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f5e00e97-d622-4f1f-990f-16c498f5b1f6 tempest-TaggedBootDevicesTest_v242-1911046419 tempest-TaggedBootDevicesTest_v242-1911046419-project-member] Lock "35ef80cd-d7d8-421b-8296-44b107b1bce4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.991s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:56 user nova-compute[75672]: INFO nova.compute.manager [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] [instance: d8328382-e998-44b8-9c34-a1dbf74746e7] Took 2.92 seconds to detach 3 volumes for instance.
Nov 30 12:35:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:35:56 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:35:56 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:35:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:56 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Deleted allocations for instance d8328382-e998-44b8-9c34-a1dbf74746e7
Nov 30 12:35:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e123d993-557a-4c95-b373-004394220042 tempest-TaggedBootDevicesTest-386009414 tempest-TaggedBootDevicesTest-386009414-project-member] Lock "d8328382-e998-44b8-9c34-a1dbf74746e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.391s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-3ee82269-323f-42f6-ac3e-07ee932f1cc4 req-941b1812-a4b5-4b9c-965e-45f62a282750 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3ee82269-323f-42f6-ac3e-07ee932f1cc4 req-941b1812-a4b5-4b9c-965e-45f62a282750 service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3ee82269-323f-42f6-ac3e-07ee932f1cc4 req-941b1812-a4b5-4b9c-965e-45f62a282750 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3ee82269-323f-42f6-ac3e-07ee932f1cc4 req-941b1812-a4b5-4b9c-965e-45f62a282750 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-3ee82269-323f-42f6-ac3e-07ee932f1cc4 req-941b1812-a4b5-4b9c-965e-45f62a282750 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:57 user nova-compute[75672]: WARNING nova.compute.manager [req-3ee82269-323f-42f6-ac3e-07ee932f1cc4 req-941b1812-a4b5-4b9c-965e-45f62a282750 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state stopped and task_state powering-on.
Nov 30 12:35:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-3ee82269-323f-42f6-ac3e-07ee932f1cc4 req-941b1812-a4b5-4b9c-965e-45f62a282750 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:35:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3ee82269-323f-42f6-ac3e-07ee932f1cc4 req-941b1812-a4b5-4b9c-965e-45f62a282750 service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3ee82269-323f-42f6-ac3e-07ee932f1cc4 req-941b1812-a4b5-4b9c-965e-45f62a282750 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3ee82269-323f-42f6-ac3e-07ee932f1cc4 req-941b1812-a4b5-4b9c-965e-45f62a282750 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-3ee82269-323f-42f6-ac3e-07ee932f1cc4 req-941b1812-a4b5-4b9c-965e-45f62a282750 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:35:57 user nova-compute[75672]: WARNING nova.compute.manager [req-3ee82269-323f-42f6-ac3e-07ee932f1cc4 req-941b1812-a4b5-4b9c-965e-45f62a282750 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state stopped and task_state powering-on.
Nov 30 12:35:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:35:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Instance rebooted successfully.
Nov 30 12:35:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8532fcf8-39d4-498a-8e9e-10f9edece007 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG nova.objects.instance [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'flavor' on Instance uuid 4382544b-6fb7-4164-9b6b-302a6e24bc52 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:35:58 user nova-compute[75672]: INFO nova.compute.manager [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Attaching volume 58d8f807-5f0b-4fdf-9896-b190ebe120a7 to /dev/vdb
Nov 30 12:35:58 user nova-compute[75672]: DEBUG os_brick.utils [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[10543025-348c-4dca-8a6d-56cf1ac545b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d443246a-fa81-4bed-b996-26c3b82e125e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcbf517-f92a-436d-b4ef-1f5e26351c65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e1570d-a279-4e7e-97d2-33b50ccca290]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:35:58 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:35:58 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1588fd6e-e9d1-49f1-8ac1-9e9af383d711]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG os_brick.utils [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updating existing volume attachment record: 8de63cc5-75d3-41e6-810e-91d9165c406c {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:35:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHRsdpVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:36:09 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:36:09 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:36:09 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9272e15-4a70-4c38-980e-9680b1ba3e51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:36:09 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6e244c-bf8a-4485-847d-c953b6e4d9f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7] added
Nov 30 12:36:09 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[caec9671-b256-42b0-957d-ec094b153fd9]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6ec223-470c-4911-9dfb-8870de39300a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YHRsdpVg {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YHRsdpVg" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7108e8f9-ad43-41e8-9319-1bec307b2b5c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YHRsdpVg'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b751e1f-aef3-4edd-af44-3051a2071285]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d272a92-8d29-4291-af3c-040ce5179678]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:36:09 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:36:09 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:36:09 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:36:09 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab280917-01df-460c-a982-135330b6f055]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260]
Nov 30 12:36:09 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260] successful.
Nov 30 12:36:09 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1870b43b-0756-4199-9400-9f2982eeba0d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f62d4a-c747-4dd4-b3a8-9bfe56dcc35e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:36:09 user nova-compute[75672]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:36:09 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:36:09 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:36:09 user nova-compute[75672]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:36:09 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:36:09 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[302469ee-d199-4913-be9d-21c0ecede0b6]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:36:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHRsdpVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:36:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:36:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23330356331326564', 'path': '/dev/sdc'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:36:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330356331326564', 'path': '/dev/sdc'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:36:10 user nova-compute[75672]: DEBUG nova.objects.instance [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'flavor' on Instance uuid 4382544b-6fb7-4164-9b6b-302a6e24bc52 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:36:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:36:10 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:36:10 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 12:36:10 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:36:10 user nova-compute[75672]:   <serial>58d8f807-5f0b-4fdf-9896-b190ebe120a7</serial>
Nov 30 12:36:10 user nova-compute[75672]: </disk>
Nov 30 12:36:10 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:36:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:36:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:36:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] No VIF found with MAC fa:16:3e:5b:7d:cb, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:36:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-edfc060a-cb6c-4635-8a81-94e7b55b1115 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.871s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:36:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:18 user nova-compute[75672]: DEBUG nova.compute.manager [req-1eb11b48-46de-4c83-8299-d10c0ac76db0 req-13f783d5-1828-454a-a6b2-da1e39f8fad1 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received event network-changed-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:36:18 user nova-compute[75672]: DEBUG nova.compute.manager [req-1eb11b48-46de-4c83-8299-d10c0ac76db0 req-13f783d5-1828-454a-a6b2-da1e39f8fad1 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Refreshing instance network info cache due to event network-changed-d229eaa1-29dc-4b3f-b468-d5a8f24d7514. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:36:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1eb11b48-46de-4c83-8299-d10c0ac76db0 req-13f783d5-1828-454a-a6b2-da1e39f8fad1 service nova] Acquiring lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:36:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1eb11b48-46de-4c83-8299-d10c0ac76db0 req-13f783d5-1828-454a-a6b2-da1e39f8fad1 service nova] Acquired lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:36:18 user nova-compute[75672]: DEBUG nova.network.neutron [req-1eb11b48-46de-4c83-8299-d10c0ac76db0 req-13f783d5-1828-454a-a6b2-da1e39f8fad1 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Refreshing network info cache for port d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:36:18 user nova-compute[75672]: DEBUG nova.network.neutron [req-1eb11b48-46de-4c83-8299-d10c0ac76db0 req-13f783d5-1828-454a-a6b2-da1e39f8fad1 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updated VIF entry in instance network info cache for port d229eaa1-29dc-4b3f-b468-d5a8f24d7514. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:36:18 user nova-compute[75672]: DEBUG nova.network.neutron [req-1eb11b48-46de-4c83-8299-d10c0ac76db0 req-13f783d5-1828-454a-a6b2-da1e39f8fad1 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updating instance_info_cache with network_info: [{"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:36:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1eb11b48-46de-4c83-8299-d10c0ac76db0 req-13f783d5-1828-454a-a6b2-da1e39f8fad1 service nova] Releasing lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:36:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-5d9666f7-545d-45c0-9f6f-cc61f2072879 req-12750e0f-d701-4058-8b80-de0b13789383 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received event network-changed-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:36:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-5d9666f7-545d-45c0-9f6f-cc61f2072879 req-12750e0f-d701-4058-8b80-de0b13789383 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Refreshing instance network info cache due to event network-changed-d229eaa1-29dc-4b3f-b468-d5a8f24d7514. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:36:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5d9666f7-545d-45c0-9f6f-cc61f2072879 req-12750e0f-d701-4058-8b80-de0b13789383 service nova] Acquiring lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:36:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5d9666f7-545d-45c0-9f6f-cc61f2072879 req-12750e0f-d701-4058-8b80-de0b13789383 service nova] Acquired lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:36:20 user nova-compute[75672]: DEBUG nova.network.neutron [req-5d9666f7-545d-45c0-9f6f-cc61f2072879 req-12750e0f-d701-4058-8b80-de0b13789383 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Refreshing network info cache for port d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:36:21 user nova-compute[75672]: DEBUG nova.network.neutron [req-5d9666f7-545d-45c0-9f6f-cc61f2072879 req-12750e0f-d701-4058-8b80-de0b13789383 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updated VIF entry in instance network info cache for port d229eaa1-29dc-4b3f-b468-d5a8f24d7514. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:36:21 user nova-compute[75672]: DEBUG nova.network.neutron [req-5d9666f7-545d-45c0-9f6f-cc61f2072879 req-12750e0f-d701-4058-8b80-de0b13789383 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updating instance_info_cache with network_info: [{"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:36:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5d9666f7-545d-45c0-9f6f-cc61f2072879 req-12750e0f-d701-4058-8b80-de0b13789383 service nova] Releasing lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:36:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:36:26 user nova-compute[75672]: INFO nova.compute.manager [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Rebooting instance
Nov 30 12:36:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquired lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG nova.network.neutron [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG nova.network.neutron [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updating instance_info_cache with network_info: [{"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Releasing lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:36:26 user nova-compute[75672]: INFO nova.compute.manager [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Rescuing
Nov 30 12:36:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquired lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG nova.network.neutron [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-7a6599d5-8720-437a-af2f-d650477dea7d req-75259114-6ddb-424d-83d0-7d3013d3c451 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received event network-vif-unplugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7a6599d5-8720-437a-af2f-d650477dea7d req-75259114-6ddb-424d-83d0-7d3013d3c451 service nova] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7a6599d5-8720-437a-af2f-d650477dea7d req-75259114-6ddb-424d-83d0-7d3013d3c451 service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7a6599d5-8720-437a-af2f-d650477dea7d req-75259114-6ddb-424d-83d0-7d3013d3c451 service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:36:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-7a6599d5-8720-437a-af2f-d650477dea7d req-75259114-6ddb-424d-83d0-7d3013d3c451 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] No waiting events found dispatching network-vif-unplugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:36:26 user nova-compute[75672]: WARNING nova.compute.manager [req-7a6599d5-8720-437a-af2f-d650477dea7d req-75259114-6ddb-424d-83d0-7d3013d3c451 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received unexpected event network-vif-unplugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 for instance with vm_state active and task_state reboot_started_hard.
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Updating instance_info_cache with network_info: [{"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Releasing lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:27 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Instance destroyed successfully.
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.objects.instance [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'resources' on Instance uuid 4382544b-6fb7-4164-9b6b-302a6e24bc52 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-711672773',display_name='tempest-TestMinimumBasicScenario-server-711672773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-711672773',id=14,image_ref='c866fbbf-29c3-4e1b-8464-0648755b20e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOniC84tdYnYlJswjjRC4kKmNmB0tBzcdJaPVjXX2wcc4T+DibHFv1jYbqqzIDwZXYmRjVVueGyQD3b6liZnaDVWOLMtKxt+1Icj/6dsoFWFdwDT8Mgl2jBx4KBOz3cFsQ==',key_name='tempest-TestMinimumBasicScenario-2113508187',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:34:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc2e7dfcbff457c9e394b1e5d0d23e6',ramdisk_id='',reservation_id='r-ekl1jzdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c866fbbf-29c3-4e1b-8464-0648755b20e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-950497565',owner_user_name='tempest-TestMinimumBasicScenario-950497565-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:36:27Z,user_data=None,user_id='c663fb001aa64ec6a8e5861449ec2bbb',uuid=4382544b-6fb7-4164-9b6b-302a6e24bc52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converting VIF {"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:7d:cb,bridge_name='br-int',has_traffic_filtering=True,id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd229eaa1-29') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_vif [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:7d:cb,bridge_name='br-int',has_traffic_filtering=True,id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd229eaa1-29') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd229eaa1-29, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2aeeaac-a86b-4be2-88f1-dca244fae061) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:27 user nova-compute[75672]: INFO os_vif [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:7d:cb,bridge_name='br-int',has_traffic_filtering=True,id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd229eaa1-29')
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHRsdpVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:36:27 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[abddb3c6-70f6-4b9d-b1fd-d9ba8ba9358d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:36:27 user nova-compute[75672]: No targets found.
Nov 30 12:36:27 user nova-compute[75672]: iSNS:
Nov 30 12:36:27 user nova-compute[75672]: No targets found.
Nov 30 12:36:27 user nova-compute[75672]: STATIC:
Nov 30 12:36:27 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:36:27 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:36:27 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:36:27 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7
Nov 30 12:36:27 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:36:27 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:36:27 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:36:27 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:36:27 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:36:27 user nova-compute[75672]: FIRMWARE:
Nov 30 12:36:27 user nova-compute[75672]: No targets found.
Nov 30 12:36:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:36:27 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:36:27 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74bce23-806e-4261-821d-2c4ca61f559a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabaf42c-cbbb-4400-96e5-98dedee1e1cd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:36:27 user nova-compute[75672]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:36:27 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:36:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:36:27 user nova-compute[75672]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:36:27 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:36:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd41076d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7'): ({'sdc'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Removing single pathed devices sdc {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceae672c-1fe2-4327-9149-2371871107d5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1fe068-94ac-4b88-8f40-09b3bdd91362]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Flushing IO for device /dev/sdc {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[13052ec3-5ff9-417a-b7e9-1140ed881ffb]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dac2ae-2740-48f9-bf21-e3fc210e6a8c]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f1e351-34fa-4bc1-93d2-3384dcbd8aa8]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a188b60-9ae1-46c7-93d1-7d3f5b57448b]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260]
Nov 30 12:36:27 user nova-compute[75672]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260] successful.
Nov 30 12:36:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d655c735-0c58-483c-a20b-c6730adc97aa]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] <== disconnect_volume: return (338ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Start _get_guest_xml network_info=[{"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c866fbbf-29c3-4e1b-8464-0648755b20e3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'c866fbbf-29c3-4e1b-8464-0648755b20e3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '8de63cc5-75d3-41e6-810e-91d9165c406c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHRsdpVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '4382544b-6fb7-4164-9b6b-302a6e24bc52', 'attached_at': '', 'detached_at': '', 'volume_id': '58d8f807-5f0b-4fdf-9896-b190ebe120a7', 'serial': '58d8f807-5f0b-4fdf-9896-b190ebe120a7'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:36:27 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:36:27 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c866fbbf-29c3-4e1b-8464-0648755b20e3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.objects.instance [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4382544b-6fb7-4164-9b6b-302a6e24bc52 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:36:27 user nova-compute[75672]: DEBUG nova.objects.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Object Instance<4382544b-6fb7-4164-9b6b-302a6e24bc52> lazy-loaded attributes: resources,vcpu_model {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHRsdpVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:36:28 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:36:28 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:36:28 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55354fb-35a0-4c01-b3f6-76cd031ac5a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:36:28 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbe9cf8-aac6-4d2a-9eef-ca36d25b69b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7] added
Nov 30 12:36:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:28 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Instance destroyed successfully.
Nov 30 12:36:28 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Attempting rescue
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75672) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Instance directory exists: not creating {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Nov 30 12:36:28 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Creating image(s)
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "/opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "/opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "/opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'trusted_certs' on Instance uuid 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1642114a-1efc-493e-b8bb-7e753f793d39]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32f9a97-f618-41ea-950d-94f632160b1b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YHRsdpVg {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YHRsdpVg" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59e2295-6f0b-435e-8f83-313cfa43f4cb]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YHRsdpVg'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[84925a5c-a027-4b94-843c-9093f4d0e019]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c899c4-6d27-4ea6-a3c8-312bd74b8da4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:36:28 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:36:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:36:28 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:36:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8813914-4508-4f22-836c-2dfae634a865]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260]
Nov 30 12:36:28 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260] successful.
Nov 30 12:36:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.188s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.rescue {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f31f1c-03c5-4a4e-8ffa-307c8ff40703]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.rescue" returned: 0 in 0.055s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'migration_context' on Instance uuid 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d7c6ae-12d0-4892-9988-7541371ab0c0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:36:28 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:36:28 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:36:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:36:28 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:36:28 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:36:28 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.objects.base [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<76aeb1d1-590a-44b3-b4fd-c9ebdedf603b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Start _get_guest_xml network_info=[{"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "vif_mac": "fa:16:3e:01:69:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'resources' on Instance uuid 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e726e48b-f4dc-484b-a346-b74f8d679055]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHRsdpVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.objects.base [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<76aeb1d1-590a-44b3-b4fd-c9ebdedf603b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'numa_topology' on Instance uuid 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.objects.base [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<76aeb1d1-590a-44b3-b4fd-c9ebdedf603b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:36:28 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:36:28 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.objects.base [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<76aeb1d1-590a-44b3-b4fd-c9ebdedf603b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-599375833',display_name='tempest-ServerRescueNegativeTestJSON-server-599375833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-599375833',id=1,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='601d2f3e56844b68b3a0c71f8a7f5454',ramdisk_id='',reservation_id='r-3q5auhoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-928198583',owner_user_name='tempest-ServerRescueNegativeTestJSON-928198583-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:31:59Z,user_data=None,user_id='61c6bf770dfe4eadba28f371b29f1d79',uuid=76aeb1d1-590a-44b3-b4fd-c9ebdedf603b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "vif_mac": "fa:16:3e:01:69:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converting VIF {"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "vif_mac": "fa:16:3e:01:69:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:69:fe,bridge_name='br-int',has_traffic_filtering=True,id=fbe1de56-aab3-47e7-914b-e51e070c8679,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe1de56-aa') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'pci_devices' on Instance uuid 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.objects.base [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<76aeb1d1-590a-44b3-b4fd-c9ebdedf603b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:36:28 user nova-compute[75672]:   <uuid>76aeb1d1-590a-44b3-b4fd-c9ebdedf603b</uuid>
Nov 30 12:36:28 user nova-compute[75672]:   <name>instance-00000001</name>
Nov 30 12:36:28 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:36:28 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:36:28 user nova-compute[75672]:   <metadata>
Nov 30 12:36:28 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:36:28 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:36:28 user nova-compute[75672]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-599375833</nova:name>
Nov 30 12:36:28 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:36:28</nova:creationTime>
Nov 30 12:36:28 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:36:28 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:36:28 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:36:28 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:36:28 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:36:28 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:36:28 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:36:28 user nova-compute[75672]:       <nova:owner>
Nov 30 12:36:28 user nova-compute[75672]:         <nova:user uuid="61c6bf770dfe4eadba28f371b29f1d79">tempest-ServerRescueNegativeTestJSON-928198583-project-member</nova:user>
Nov 30 12:36:28 user nova-compute[75672]:         <nova:project uuid="601d2f3e56844b68b3a0c71f8a7f5454">tempest-ServerRescueNegativeTestJSON-928198583</nova:project>
Nov 30 12:36:28 user nova-compute[75672]:       </nova:owner>
Nov 30 12:36:28 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:36:28 user nova-compute[75672]:       <nova:ports>
Nov 30 12:36:28 user nova-compute[75672]:         <nova:port uuid="fbe1de56-aab3-47e7-914b-e51e070c8679">
Nov 30 12:36:28 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 12:36:28 user nova-compute[75672]:         </nova:port>
Nov 30 12:36:28 user nova-compute[75672]:       </nova:ports>
Nov 30 12:36:28 user nova-compute[75672]:     </nova:instance>
Nov 30 12:36:28 user nova-compute[75672]:   </metadata>
Nov 30 12:36:28 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:36:28 user nova-compute[75672]:     <system>
Nov 30 12:36:28 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:36:28 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:36:28 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:36:28 user nova-compute[75672]:       <entry name="serial">76aeb1d1-590a-44b3-b4fd-c9ebdedf603b</entry>
Nov 30 12:36:28 user nova-compute[75672]:       <entry name="uuid">76aeb1d1-590a-44b3-b4fd-c9ebdedf603b</entry>
Nov 30 12:36:28 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:36:28 user nova-compute[75672]:     </system>
Nov 30 12:36:28 user nova-compute[75672]:   </sysinfo>
Nov 30 12:36:28 user nova-compute[75672]:   <os>
Nov 30 12:36:28 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:36:28 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:36:28 user nova-compute[75672]:   </os>
Nov 30 12:36:28 user nova-compute[75672]:   <features>
Nov 30 12:36:28 user nova-compute[75672]:     <acpi/>
Nov 30 12:36:28 user nova-compute[75672]:     <apic/>
Nov 30 12:36:28 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:36:28 user nova-compute[75672]:   </features>
Nov 30 12:36:28 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:36:28 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:36:28 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:36:28 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:36:28 user nova-compute[75672]:   </clock>
Nov 30 12:36:28 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:36:28 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:36:28 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:36:28 user nova-compute[75672]:   </cpu>
Nov 30 12:36:28 user nova-compute[75672]:   <devices>
Nov 30 12:36:28 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:36:28 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:36:28 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.rescue"/>
Nov 30 12:36:28 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:36:28 user nova-compute[75672]:     </disk>
Nov 30 12:36:28 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:36:28 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:36:28 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk"/>
Nov 30 12:36:28 user nova-compute[75672]:       <target dev="vdb" bus="virtio"/>
Nov 30 12:36:28 user nova-compute[75672]:     </disk>
Nov 30 12:36:28 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:36:28 user nova-compute[75672]:       <mac address="fa:16:3e:01:69:fe"/>
Nov 30 12:36:28 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:36:28 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:36:28 user nova-compute[75672]:       <target dev="tapfbe1de56-aa"/>
Nov 30 12:36:28 user nova-compute[75672]:     </interface>
Nov 30 12:36:28 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:36:28 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/console.log" append="off"/>
Nov 30 12:36:28 user nova-compute[75672]:     </serial>
Nov 30 12:36:28 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:36:28 user nova-compute[75672]:     <video>
Nov 30 12:36:28 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:36:28 user nova-compute[75672]:     </video>
Nov 30 12:36:28 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:36:28 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:36:28 user nova-compute[75672]:     </rng>
Nov 30 12:36:28 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:36:28 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:36:28 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:36:28 user nova-compute[75672]:     </memballoon>
Nov 30 12:36:28 user nova-compute[75672]:   </devices>
Nov 30 12:36:28 user nova-compute[75672]: </domain>
Nov 30 12:36:28 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:36:28 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Instance destroyed successfully.
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:36:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No VIF found with MAC fa:16:3e:01:69:fe, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received event network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] No waiting events found dispatching network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:36:29 user nova-compute[75672]: WARNING nova.compute.manager [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received unexpected event network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 for instance with vm_state active and task_state reboot_started_hard.
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-vif-unplugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] No waiting events found dispatching network-vif-unplugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:36:29 user nova-compute[75672]: WARNING nova.compute.manager [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received unexpected event network-vif-unplugged-fbe1de56-aab3-47e7-914b-e51e070c8679 for instance with vm_state active and task_state rescuing.
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] No waiting events found dispatching network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:36:29 user nova-compute[75672]: WARNING nova.compute.manager [req-06208cbc-9bb0-4cc3-b4ff-c577693066c1 req-5ca6a0e6-39c8-4445-8ad2-38f9b815dda0 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received unexpected event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 for instance with vm_state active and task_state rescuing.
Nov 30 12:36:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23330356331326564', 'path': '/dev/sdc'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330356331326564', 'path': '/dev/sdc'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-711672773',display_name='tempest-TestMinimumBasicScenario-server-711672773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-711672773',id=14,image_ref='c866fbbf-29c3-4e1b-8464-0648755b20e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOniC84tdYnYlJswjjRC4kKmNmB0tBzcdJaPVjXX2wcc4T+DibHFv1jYbqqzIDwZXYmRjVVueGyQD3b6liZnaDVWOLMtKxt+1Icj/6dsoFWFdwDT8Mgl2jBx4KBOz3cFsQ==',key_name='tempest-TestMinimumBasicScenario-2113508187',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:34:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc2e7dfcbff457c9e394b1e5d0d23e6',ramdisk_id='',reservation_id='r-ekl1jzdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c866fbbf-29c3-4e1b-8464-0648755b20e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-950497565',owner_user_name='tempest-TestMinimumBasicScenario-950497565-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:36:27Z,user_data=None,user_id='c663fb001aa64ec6a8e5861449ec2bbb',uuid=4382544b-6fb7-4164-9b6b-302a6e24bc52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converting VIF {"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:7d:cb,bridge_name='br-int',has_traffic_filtering=True,id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd229eaa1-29') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.objects.instance [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'pci_devices' on Instance uuid 4382544b-6fb7-4164-9b6b-302a6e24bc52 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.objects.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Object Instance<4382544b-6fb7-4164-9b6b-302a6e24bc52> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:36:29 user nova-compute[75672]:   <uuid>4382544b-6fb7-4164-9b6b-302a6e24bc52</uuid>
Nov 30 12:36:29 user nova-compute[75672]:   <name>instance-0000000e</name>
Nov 30 12:36:29 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:36:29 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:36:29 user nova-compute[75672]:   <metadata>
Nov 30 12:36:29 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:36:29 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:36:29 user nova-compute[75672]:       <nova:name>tempest-TestMinimumBasicScenario-server-711672773</nova:name>
Nov 30 12:36:29 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:36:27</nova:creationTime>
Nov 30 12:36:29 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:36:29 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:36:29 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:36:29 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:36:29 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:36:29 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:36:29 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:36:29 user nova-compute[75672]:       <nova:owner>
Nov 30 12:36:29 user nova-compute[75672]:         <nova:user uuid="c663fb001aa64ec6a8e5861449ec2bbb">tempest-TestMinimumBasicScenario-950497565-project-member</nova:user>
Nov 30 12:36:29 user nova-compute[75672]:         <nova:project uuid="ebc2e7dfcbff457c9e394b1e5d0d23e6">tempest-TestMinimumBasicScenario-950497565</nova:project>
Nov 30 12:36:29 user nova-compute[75672]:       </nova:owner>
Nov 30 12:36:29 user nova-compute[75672]:       <nova:root type="image" uuid="c866fbbf-29c3-4e1b-8464-0648755b20e3"/>
Nov 30 12:36:29 user nova-compute[75672]:       <nova:ports>
Nov 30 12:36:29 user nova-compute[75672]:         <nova:port uuid="d229eaa1-29dc-4b3f-b468-d5a8f24d7514">
Nov 30 12:36:29 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 12:36:29 user nova-compute[75672]:         </nova:port>
Nov 30 12:36:29 user nova-compute[75672]:       </nova:ports>
Nov 30 12:36:29 user nova-compute[75672]:     </nova:instance>
Nov 30 12:36:29 user nova-compute[75672]:   </metadata>
Nov 30 12:36:29 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:36:29 user nova-compute[75672]:     <system>
Nov 30 12:36:29 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:36:29 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:36:29 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:36:29 user nova-compute[75672]:       <entry name="serial">4382544b-6fb7-4164-9b6b-302a6e24bc52</entry>
Nov 30 12:36:29 user nova-compute[75672]:       <entry name="uuid">4382544b-6fb7-4164-9b6b-302a6e24bc52</entry>
Nov 30 12:36:29 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:36:29 user nova-compute[75672]:     </system>
Nov 30 12:36:29 user nova-compute[75672]:   </sysinfo>
Nov 30 12:36:29 user nova-compute[75672]:   <os>
Nov 30 12:36:29 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:36:29 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:36:29 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:36:29 user nova-compute[75672]:   </os>
Nov 30 12:36:29 user nova-compute[75672]:   <features>
Nov 30 12:36:29 user nova-compute[75672]:     <acpi/>
Nov 30 12:36:29 user nova-compute[75672]:     <apic/>
Nov 30 12:36:29 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:36:29 user nova-compute[75672]:   </features>
Nov 30 12:36:29 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:36:29 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:36:29 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:36:29 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:36:29 user nova-compute[75672]:   </clock>
Nov 30 12:36:29 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:36:29 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:36:29 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:36:29 user nova-compute[75672]:   </cpu>
Nov 30 12:36:29 user nova-compute[75672]:   <devices>
Nov 30 12:36:29 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:36:29 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:36:29 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk"/>
Nov 30 12:36:29 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:36:29 user nova-compute[75672]:     </disk>
Nov 30 12:36:29 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:36:29 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:36:29 user nova-compute[75672]:       <source dev="/dev/sdc"/>
Nov 30 12:36:29 user nova-compute[75672]:       <target dev="vdb" bus="virtio"/>
Nov 30 12:36:29 user nova-compute[75672]:       <serial>58d8f807-5f0b-4fdf-9896-b190ebe120a7</serial>
Nov 30 12:36:29 user nova-compute[75672]:     </disk>
Nov 30 12:36:29 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:36:29 user nova-compute[75672]:       <mac address="fa:16:3e:5b:7d:cb"/>
Nov 30 12:36:29 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:36:29 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:36:29 user nova-compute[75672]:       <target dev="tapd229eaa1-29"/>
Nov 30 12:36:29 user nova-compute[75672]:     </interface>
Nov 30 12:36:29 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:36:29 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/console.log" append="off"/>
Nov 30 12:36:29 user nova-compute[75672]:     </serial>
Nov 30 12:36:29 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:36:29 user nova-compute[75672]:     <video>
Nov 30 12:36:29 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:36:29 user nova-compute[75672]:     </video>
Nov 30 12:36:29 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:36:29 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:36:29 user nova-compute[75672]:     </rng>
Nov 30 12:36:29 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:36:29 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:36:29 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:36:29 user nova-compute[75672]:     </memballoon>
Nov 30 12:36:29 user nova-compute[75672]:   </devices>
Nov 30 12:36:29 user nova-compute[75672]: </domain>
Nov 30 12:36:29 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.objects.instance [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4382544b-6fb7-4164-9b6b-302a6e24bc52 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG nova.objects.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Object Instance<4382544b-6fb7-4164-9b6b-302a6e24bc52> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2 --force-share --output=json" returned: 0 in 0.192s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Cannot resize image /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG nova.objects.instance [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'migration_context' on Instance uuid 4382544b-6fb7-4164-9b6b-302a6e24bc52 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG nova.objects.base [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Object Instance<4382544b-6fb7-4164-9b6b-302a6e24bc52> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-711672773',display_name='tempest-TestMinimumBasicScenario-server-711672773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-711672773',id=14,image_ref='c866fbbf-29c3-4e1b-8464-0648755b20e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOniC84tdYnYlJswjjRC4kKmNmB0tBzcdJaPVjXX2wcc4T+DibHFv1jYbqqzIDwZXYmRjVVueGyQD3b6liZnaDVWOLMtKxt+1Icj/6dsoFWFdwDT8Mgl2jBx4KBOz3cFsQ==',key_name='tempest-TestMinimumBasicScenario-2113508187',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:34:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='ebc2e7dfcbff457c9e394b1e5d0d23e6',ramdisk_id='',reservation_id='r-ekl1jzdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c866fbbf-29c3-4e1b-8464-0648755b20e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-950497565',owner_user_name='tempest-TestMinimumBasicScenario-950497565-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:36:27Z,user_data=None,user_id='c663fb001aa64ec6a8e5861449ec2bbb',uuid=4382544b-6fb7-4164-9b6b-302a6e24bc52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converting VIF {"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:7d:cb,bridge_name='br-int',has_traffic_filtering=True,id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd229eaa1-29') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG os_vif [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:7d:cb,bridge_name='br-int',has_traffic_filtering=True,id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd229eaa1-29') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffd5efad-3897-5686-b169-b8dc69c4c3c4', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd229eaa1-29, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd229eaa1-29, col_values=(('qos', UUID('a2b259b9-e507-48c8-bf0f-b5e2eb191921')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd229eaa1-29, col_values=(('external_ids', {'iface-id': 'd229eaa1-29dc-4b3f-b468-d5a8f24d7514', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:7d:cb', 'vm-uuid': '4382544b-6fb7-4164-9b6b-302a6e24bc52'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:30 user nova-compute[75672]: INFO os_vif [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:7d:cb,bridge_name='br-int',has_traffic_filtering=True,id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd229eaa1-29')
Nov 30 12:36:30 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:36:30 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-f0ee965e-6290-428d-923d-4d930378cda9 req-a123768a-86c1-4ca9-acc9-8787a3ce364c service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f0ee965e-6290-428d-923d-4d930378cda9 req-a123768a-86c1-4ca9-acc9-8787a3ce364c service nova] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f0ee965e-6290-428d-923d-4d930378cda9 req-a123768a-86c1-4ca9-acc9-8787a3ce364c service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f0ee965e-6290-428d-923d-4d930378cda9 req-a123768a-86c1-4ca9-acc9-8787a3ce364c service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-f0ee965e-6290-428d-923d-4d930378cda9 req-a123768a-86c1-4ca9-acc9-8787a3ce364c service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] No waiting events found dispatching network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:36:31 user nova-compute[75672]: WARNING nova.compute.manager [req-f0ee965e-6290-428d-923d-4d930378cda9 req-a123768a-86c1-4ca9-acc9-8787a3ce364c service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received unexpected event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 for instance with vm_state active and task_state rescuing.
Nov 30 12:36:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-f0ee965e-6290-428d-923d-4d930378cda9 req-a123768a-86c1-4ca9-acc9-8787a3ce364c service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f0ee965e-6290-428d-923d-4d930378cda9 req-a123768a-86c1-4ca9-acc9-8787a3ce364c service nova] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f0ee965e-6290-428d-923d-4d930378cda9 req-a123768a-86c1-4ca9-acc9-8787a3ce364c service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f0ee965e-6290-428d-923d-4d930378cda9 req-a123768a-86c1-4ca9-acc9-8787a3ce364c service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-f0ee965e-6290-428d-923d-4d930378cda9 req-a123768a-86c1-4ca9-acc9-8787a3ce364c service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] No waiting events found dispatching network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:36:31 user nova-compute[75672]: WARNING nova.compute.manager [req-f0ee965e-6290-428d-923d-4d930378cda9 req-a123768a-86c1-4ca9-acc9-8787a3ce364c service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received unexpected event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 for instance with vm_state active and task_state rescuing.
Nov 30 12:36:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updating instance_info_cache with network_info: [{"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:36:31 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:36:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-deca85f5-c250-4651-9f90-1225f6c99b8c req-d03dc3d0-85d7-4851-a265-3f58772efcd2 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received event network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:36:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-deca85f5-c250-4651-9f90-1225f6c99b8c req-d03dc3d0-85d7-4851-a265-3f58772efcd2 service nova] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:36:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-deca85f5-c250-4651-9f90-1225f6c99b8c req-d03dc3d0-85d7-4851-a265-3f58772efcd2 service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:36:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-deca85f5-c250-4651-9f90-1225f6c99b8c req-d03dc3d0-85d7-4851-a265-3f58772efcd2 service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:36:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-deca85f5-c250-4651-9f90-1225f6c99b8c req-d03dc3d0-85d7-4851-a265-3f58772efcd2 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] No waiting events found dispatching network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:36:33 user nova-compute[75672]: WARNING nova.compute.manager [req-deca85f5-c250-4651-9f90-1225f6c99b8c req-d03dc3d0-85d7-4851-a265-3f58772efcd2 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received unexpected event network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 for instance with vm_state active and task_state reboot_started_hard.
Nov 30 12:36:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-deca85f5-c250-4651-9f90-1225f6c99b8c req-d03dc3d0-85d7-4851-a265-3f58772efcd2 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received event network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:36:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-deca85f5-c250-4651-9f90-1225f6c99b8c req-d03dc3d0-85d7-4851-a265-3f58772efcd2 service nova] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:36:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-deca85f5-c250-4651-9f90-1225f6c99b8c req-d03dc3d0-85d7-4851-a265-3f58772efcd2 service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:36:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-deca85f5-c250-4651-9f90-1225f6c99b8c req-d03dc3d0-85d7-4851-a265-3f58772efcd2 service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:36:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-deca85f5-c250-4651-9f90-1225f6c99b8c req-d03dc3d0-85d7-4851-a265-3f58772efcd2 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] No waiting events found dispatching network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:36:33 user nova-compute[75672]: WARNING nova.compute.manager [req-deca85f5-c250-4651-9f90-1225f6c99b8c req-d03dc3d0-85d7-4851-a265-3f58772efcd2 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received unexpected event network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 for instance with vm_state active and task_state reboot_started_hard.
Nov 30 12:36:33 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d6274298-11c4-4eb0-82a3-b3ddfaf31277 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:36:33 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:36:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:36:34 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Instance rebooted successfully.
Nov 30 12:36:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:36:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-48bce0d1-14c0-4c42-ada0-7baba47dbbbe tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.092s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:36:34 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:36:34 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:36:34 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:36:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:36:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:36:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:36:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:36:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:36:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.268s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6/disk --force-share --output=json" returned: 0 in 0.419s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:36:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:36:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:36:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:36:41 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:36:41 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:36:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7628MB free_disk=25.357284545898438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:36:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:36:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:36:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:36:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:36:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:36:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 1fba8af1-8074-4ce8-be23-912e9850fc41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:36:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:36:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 85f7c21c-b973-422f-a10c-8fb3635879f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:36:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 4382544b-6fb7-4164-9b6b-302a6e24bc52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:36:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 444b860d-f24e-4d21-8390-be86076bc3d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:36:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 3338ed96-33ff-45e6-b3da-05fbb242a3a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:36:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:36:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:36:42 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:36:42 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:36:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:36:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.443s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:36:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:43 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:36:43 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:36:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:36:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:36:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:36:44 user nova-compute[75672]: INFO nova.compute.manager [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Detaching volume 8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:36:44 user nova-compute[75672]: INFO nova.virt.block_device [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Attempting to driver detach volume 8c415004-90c8-4076-9f15-6a67a3a262b0 from mountpoint /dev/vdb
Nov 30 12:36:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Attempting to detach device vdb from instance dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:36:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:36:44 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:36:44 user nova-compute[75672]:   <source dev="/dev/sdh"/>
Nov 30 12:36:44 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:36:44 user nova-compute[75672]:   <serial>8c415004-90c8-4076-9f15-6a67a3a262b0</serial>
Nov 30 12:36:44 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:36:44 user nova-compute[75672]: </disk>
Nov 30 12:36:44 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:36:44 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Successfully detached device vdb from instance dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 from the persistent domain config.
Nov 30 12:36:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:36:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:36:44 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:36:44 user nova-compute[75672]:   <source dev="/dev/sdh"/>
Nov 30 12:36:44 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:36:44 user nova-compute[75672]:   <serial>8c415004-90c8-4076-9f15-6a67a3a262b0</serial>
Nov 30 12:36:44 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:36:44 user nova-compute[75672]: </disk>
Nov 30 12:36:44 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:36:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:36:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:36:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:36:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:36:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:36:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:36:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "444b860d-f24e-4d21-8390-be86076bc3d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "444b860d-f24e-4d21-8390-be86076bc3d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "444b860d-f24e-4d21-8390-be86076bc3d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "444b860d-f24e-4d21-8390-be86076bc3d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "444b860d-f24e-4d21-8390-be86076bc3d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:04 user nova-compute[75672]: INFO nova.compute.manager [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Terminating instance
Nov 30 12:37:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:37:04 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 is timed out.
Nov 30 12:37:04 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Successfully detached device vdb from instance dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 from the live domain config.
Nov 30 12:37:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUfZhIDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:37:04 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:37:04 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aa4c57-5948-4183-b6c2-f8fc983c2d19]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:37:04 user nova-compute[75672]: No targets found.
Nov 30 12:37:04 user nova-compute[75672]: iSNS:
Nov 30 12:37:04 user nova-compute[75672]: No targets found.
Nov 30 12:37:04 user nova-compute[75672]: STATIC:
Nov 30 12:37:04 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:37:04 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:37:04 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:37:04 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7
Nov 30 12:37:04 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:37:04 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:37:04 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0
Nov 30 12:37:04 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:37:04 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:37:04 user nova-compute[75672]: FIRMWARE:
Nov 30 12:37:04 user nova-compute[75672]: No targets found.
Nov 30 12:37:04 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:37:04 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:37:04 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a7676f-dac7-4817-9539-1d1e44ba1d8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c08c1eb-1ae2-4399-b4cc-4198d158cc13]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:04 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:04 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:37:04 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:04 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:04 user nova-compute[75672]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 (non-flash)
Nov 30 12:37:04 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd42c63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0'): ({'sdh'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Removing single pathed devices sdh {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:37:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1d9b2d-dc46-4c37-b093-18e5e546a3ca]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[360090aa-204c-4fff-bc23-a57fc1d067a2]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Flushing IO for device /dev/sdh {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab87e77-3ac9-4c51-99aa-24e13cffb6fe]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d8046a-4746-4b14-af31-631311c06377]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] SCSI volumes sdh have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2af346-d478-4fec-9631-c455b607922d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a434321e-be7f-423f-8240-db994928972d]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0, portal: 172.16.0.220,3260]
Nov 30 12:37:05 user nova-compute[75672]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0, portal: 172.16.0.220,3260] successful.
Nov 30 12:37:05 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c415004-90c8-4076-9f15-6a67a3a262b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a587362-730c-4a45-a521-7b82ec932f31]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] <== disconnect_volume: return (435ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Instance destroyed successfully.
Nov 30 12:37:05 user nova-compute[75672]: DEBUG nova.objects.instance [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lazy-loading 'resources' on Instance uuid 444b860d-f24e-4d21-8390-be86076bc3d6 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-956677902',display_name='tempest-VolumesAdminNegativeTest-server-956677902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-956677902',id=15,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:35:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36a602a0e3614e5bafc9d70e26368f66',ramdisk_id='',reservation_id='r-820q02vb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1737879306',owner_user_name='tempest-VolumesAdminNegativeTest-1737879306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:35:13Z,user_data=None,user_id='1fe27c1bb48c454082be1109311db96f',uuid=444b860d-f24e-4d21-8390-be86076bc3d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "address": "fa:16:3e:01:da:56", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2b6458-36", "ovs_interfaceid": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Converting VIF {"id": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "address": "fa:16:3e:01:da:56", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2b6458-36", "ovs_interfaceid": "9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:56,bridge_name='br-int',has_traffic_filtering=True,id=9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb,network=Network(6c45d0f0-6bba-476f-8c7b-83f86f13ff55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2b6458-36') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG os_vif [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:56,bridge_name='br-int',has_traffic_filtering=True,id=9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb,network=Network(6c45d0f0-6bba-476f-8c7b-83f86f13ff55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2b6458-36') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b2b6458-36, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=313465d7-5c4b-4b53-9950-35097b545193) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:05 user nova-compute[75672]: INFO os_vif [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:56,bridge_name='br-int',has_traffic_filtering=True,id=9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb,network=Network(6c45d0f0-6bba-476f-8c7b-83f86f13ff55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2b6458-36')
Nov 30 12:37:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Deleting instance files /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6_del
Nov 30 12:37:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Deletion of /opt/stack/data/nova/instances/444b860d-f24e-4d21-8390-be86076bc3d6_del complete
Nov 30 12:37:05 user nova-compute[75672]: INFO nova.compute.manager [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 30 12:37:05 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:06 user nova-compute[75672]: DEBUG nova.objects.instance [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'flavor' on Instance uuid dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:37:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2fd9fd97-a3da-427e-9ab1-a3c1e967e598 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.216s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:06 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:37:06 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Took 0.64 seconds to deallocate network for instance.
Nov 30 12:37:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-3bdacc7d-dbf2-482e-b4f4-1b3c9849698f req-e613e949-086c-47ae-9822-fb900b1b3298 service nova] [instance: 444b860d-f24e-4d21-8390-be86076bc3d6] Received event network-vif-deleted-9b2b6458-364d-4e1b-a5fa-8e225ec6ebfb {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:06 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:37:06 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:37:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.601s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:07 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Deleted allocations for instance 444b860d-f24e-4d21-8390-be86076bc3d6
Nov 30 12:37:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9712f26c-975f-4298-8f18-c2691b04d7c7 tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "444b860d-f24e-4d21-8390-be86076bc3d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.413s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:37:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:14 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:37:14 user nova-compute[75672]: INFO nova.compute.claims [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Claim successful on node user
Nov 30 12:37:15 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG nova.compute.manager [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG nova.compute.manager [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG nova.network.neutron [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:37:15 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:37:15 user nova-compute[75672]: DEBUG nova.compute.manager [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG nova.compute.manager [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:37:15 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Creating image(s)
Nov 30 12:37:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG nova.policy [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9544ed3bcf2407fac6a6a41e68e2a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c117afa27d447fd9c8c0eb0d59c5d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.188s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.212s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk 1073741824" returned: 0 in 0.060s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.193s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:16 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:37:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:16 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Cannot resize image /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:37:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:37:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Ensure instance console log exists: /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:37:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:17 user nova-compute[75672]: DEBUG nova.network.neutron [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Successfully created port: 20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.network.neutron [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Successfully updated port: 20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquired lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.network.neutron [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.compute.manager [req-772e4350-6594-499d-a8c1-72b36970352e req-dce49436-e3d8-48f0-8843-df7c3cca2004 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received event network-changed-20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.compute.manager [req-772e4350-6594-499d-a8c1-72b36970352e req-dce49436-e3d8-48f0-8843-df7c3cca2004 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Refreshing instance network info cache due to event network-changed-20e0a542-befb-47a2-bc78-f9d4bc75ef67. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-772e4350-6594-499d-a8c1-72b36970352e req-dce49436-e3d8-48f0-8843-df7c3cca2004 service nova] Acquiring lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.network.neutron [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.network.neutron [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Updating instance_info_cache with network_info: [{"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Releasing lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.compute.manager [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Instance network_info: |[{"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-772e4350-6594-499d-a8c1-72b36970352e req-dce49436-e3d8-48f0-8843-df7c3cca2004 service nova] Acquired lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.network.neutron [req-772e4350-6594-499d-a8c1-72b36970352e req-dce49436-e3d8-48f0-8843-df7c3cca2004 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Refreshing network info cache for port 20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Start _get_guest_xml network_info=[{"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:37:18 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:37:18 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-128968609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-128968609',id=17,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl6klT0bzM05mjTlIY/+hxTDH4pH81fsasTPeFhXIw9kr7DGRshU4ifFY299yAb2HtCh0ILgMcRORtuH+9N2Hw5W6pQ+sfpRUATNL8WBx7USNA23ssXCHaD8O36MbtQ5g==',key_name='tempest-keypair-2079457822',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c117afa27d447fd9c8c0eb0d59c5d28',ramdisk_id='',reservation_id='r-j719jspw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1737137422',owner_user_name='tempest-TaggedAttachmentsTest-1737137422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:37:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9544ed3bcf2407fac6a6a41e68e2a9c',uuid=f53f77ca-8471-4c62-a779-f64a0a4e57aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Converting VIF {"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:94:83,bridge_name='br-int',has_traffic_filtering=True,id=20e0a542-befb-47a2-bc78-f9d4bc75ef67,network=Network(95b8d2af-4f27-444f-a163-88e0d148f972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e0a542-be') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lazy-loading 'pci_devices' on Instance uuid f53f77ca-8471-4c62-a779-f64a0a4e57aa {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:37:18 user nova-compute[75672]:   <uuid>f53f77ca-8471-4c62-a779-f64a0a4e57aa</uuid>
Nov 30 12:37:18 user nova-compute[75672]:   <name>instance-00000011</name>
Nov 30 12:37:18 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:37:18 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:37:18 user nova-compute[75672]:   <metadata>
Nov 30 12:37:18 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:37:18 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:37:18 user nova-compute[75672]:       <nova:name>tempest-device-tagging-server-128968609</nova:name>
Nov 30 12:37:18 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:37:18</nova:creationTime>
Nov 30 12:37:18 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:37:18 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:37:18 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:37:18 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:37:18 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:37:18 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:37:18 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:37:18 user nova-compute[75672]:       <nova:owner>
Nov 30 12:37:18 user nova-compute[75672]:         <nova:user uuid="b9544ed3bcf2407fac6a6a41e68e2a9c">tempest-TaggedAttachmentsTest-1737137422-project-member</nova:user>
Nov 30 12:37:18 user nova-compute[75672]:         <nova:project uuid="3c117afa27d447fd9c8c0eb0d59c5d28">tempest-TaggedAttachmentsTest-1737137422</nova:project>
Nov 30 12:37:18 user nova-compute[75672]:       </nova:owner>
Nov 30 12:37:18 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:37:18 user nova-compute[75672]:       <nova:ports>
Nov 30 12:37:18 user nova-compute[75672]:         <nova:port uuid="20e0a542-befb-47a2-bc78-f9d4bc75ef67">
Nov 30 12:37:18 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 12:37:18 user nova-compute[75672]:         </nova:port>
Nov 30 12:37:18 user nova-compute[75672]:       </nova:ports>
Nov 30 12:37:18 user nova-compute[75672]:     </nova:instance>
Nov 30 12:37:18 user nova-compute[75672]:   </metadata>
Nov 30 12:37:18 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:37:18 user nova-compute[75672]:     <system>
Nov 30 12:37:18 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:37:18 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:37:18 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:37:18 user nova-compute[75672]:       <entry name="serial">f53f77ca-8471-4c62-a779-f64a0a4e57aa</entry>
Nov 30 12:37:18 user nova-compute[75672]:       <entry name="uuid">f53f77ca-8471-4c62-a779-f64a0a4e57aa</entry>
Nov 30 12:37:18 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:37:18 user nova-compute[75672]:     </system>
Nov 30 12:37:18 user nova-compute[75672]:   </sysinfo>
Nov 30 12:37:18 user nova-compute[75672]:   <os>
Nov 30 12:37:18 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:37:18 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:37:18 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:37:18 user nova-compute[75672]:   </os>
Nov 30 12:37:18 user nova-compute[75672]:   <features>
Nov 30 12:37:18 user nova-compute[75672]:     <acpi/>
Nov 30 12:37:18 user nova-compute[75672]:     <apic/>
Nov 30 12:37:18 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:37:18 user nova-compute[75672]:   </features>
Nov 30 12:37:18 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:37:18 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:37:18 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:37:18 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:37:18 user nova-compute[75672]:   </clock>
Nov 30 12:37:18 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:37:18 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:37:18 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:37:18 user nova-compute[75672]:   </cpu>
Nov 30 12:37:18 user nova-compute[75672]:   <devices>
Nov 30 12:37:18 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:37:18 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:37:18 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk"/>
Nov 30 12:37:18 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:37:18 user nova-compute[75672]:     </disk>
Nov 30 12:37:18 user nova-compute[75672]:     <disk type="file" device="cdrom">
Nov 30 12:37:18 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 12:37:18 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk.config"/>
Nov 30 12:37:18 user nova-compute[75672]:       <target dev="hda" bus="ide"/>
Nov 30 12:37:18 user nova-compute[75672]:     </disk>
Nov 30 12:37:18 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:37:18 user nova-compute[75672]:       <mac address="fa:16:3e:ed:94:83"/>
Nov 30 12:37:18 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:37:18 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:37:18 user nova-compute[75672]:       <target dev="tap20e0a542-be"/>
Nov 30 12:37:18 user nova-compute[75672]:     </interface>
Nov 30 12:37:18 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:37:18 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/console.log" append="off"/>
Nov 30 12:37:18 user nova-compute[75672]:     </serial>
Nov 30 12:37:18 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:37:18 user nova-compute[75672]:     <video>
Nov 30 12:37:18 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:37:18 user nova-compute[75672]:     </video>
Nov 30 12:37:18 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:37:18 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:37:18 user nova-compute[75672]:     </rng>
Nov 30 12:37:18 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:37:18 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:37:18 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:37:18 user nova-compute[75672]:     </memballoon>
Nov 30 12:37:18 user nova-compute[75672]:   </devices>
Nov 30 12:37:18 user nova-compute[75672]: </domain>
Nov 30 12:37:18 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-128968609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-128968609',id=17,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl6klT0bzM05mjTlIY/+hxTDH4pH81fsasTPeFhXIw9kr7DGRshU4ifFY299yAb2HtCh0ILgMcRORtuH+9N2Hw5W6pQ+sfpRUATNL8WBx7USNA23ssXCHaD8O36MbtQ5g==',key_name='tempest-keypair-2079457822',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c117afa27d447fd9c8c0eb0d59c5d28',ramdisk_id='',reservation_id='r-j719jspw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1737137422',owner_user_name='tempest-TaggedAttachmentsTest-1737137422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:37:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9544ed3bcf2407fac6a6a41e68e2a9c',uuid=f53f77ca-8471-4c62-a779-f64a0a4e57aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Converting VIF {"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:94:83,bridge_name='br-int',has_traffic_filtering=True,id=20e0a542-befb-47a2-bc78-f9d4bc75ef67,network=Network(95b8d2af-4f27-444f-a163-88e0d148f972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e0a542-be') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG os_vif [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:94:83,bridge_name='br-int',has_traffic_filtering=True,id=20e0a542-befb-47a2-bc78-f9d4bc75ef67,network=Network(95b8d2af-4f27-444f-a163-88e0d148f972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e0a542-be') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb61c635-adda-5a5a-8207-704681773880', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20e0a542-be, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20e0a542-be, col_values=(('qos', UUID('1cdbd595-706f-4349-89cd-87d1f738309f')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20e0a542-be, col_values=(('external_ids', {'iface-id': '20e0a542-befb-47a2-bc78-f9d4bc75ef67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:94:83', 'vm-uuid': 'f53f77ca-8471-4c62-a779-f64a0a4e57aa'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:18 user nova-compute[75672]: INFO os_vif [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:94:83,bridge_name='br-int',has_traffic_filtering=True,id=20e0a542-befb-47a2-bc78-f9d4bc75ef67,network=Network(95b8d2af-4f27-444f-a163-88e0d148f972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e0a542-be')
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] No BDM found with device name hda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:37:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] No VIF found with MAC fa:16:3e:ed:94:83, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:37:18 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Using config drive
Nov 30 12:37:19 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Creating config drive at /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk.config
Nov 30 12:37:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprvthzikj {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprvthzikj" returned: 0 in 0.053s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:19 user nova-compute[75672]: DEBUG nova.network.neutron [req-772e4350-6594-499d-a8c1-72b36970352e req-dce49436-e3d8-48f0-8843-df7c3cca2004 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Updated VIF entry in instance network info cache for port 20e0a542-befb-47a2-bc78-f9d4bc75ef67. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:37:19 user nova-compute[75672]: DEBUG nova.network.neutron [req-772e4350-6594-499d-a8c1-72b36970352e req-dce49436-e3d8-48f0-8843-df7c3cca2004 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Updating instance_info_cache with network_info: [{"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:37:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-772e4350-6594-499d-a8c1-72b36970352e req-dce49436-e3d8-48f0-8843-df7c3cca2004 service nova] Releasing lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:37:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:22 user nova-compute[75672]: DEBUG nova.compute.manager [req-c9de9f12-1eba-4682-9ccd-d9533226c163 req-cdf6a24b-1da9-45b3-97a6-125e4f6ede46 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received event network-vif-plugged-20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c9de9f12-1eba-4682-9ccd-d9533226c163 req-cdf6a24b-1da9-45b3-97a6-125e4f6ede46 service nova] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c9de9f12-1eba-4682-9ccd-d9533226c163 req-cdf6a24b-1da9-45b3-97a6-125e4f6ede46 service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c9de9f12-1eba-4682-9ccd-d9533226c163 req-cdf6a24b-1da9-45b3-97a6-125e4f6ede46 service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:22 user nova-compute[75672]: DEBUG nova.compute.manager [req-c9de9f12-1eba-4682-9ccd-d9533226c163 req-cdf6a24b-1da9-45b3-97a6-125e4f6ede46 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] No waiting events found dispatching network-vif-plugged-20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:37:22 user nova-compute[75672]: WARNING nova.compute.manager [req-c9de9f12-1eba-4682-9ccd-d9533226c163 req-cdf6a24b-1da9-45b3-97a6-125e4f6ede46 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received unexpected event network-vif-plugged-20e0a542-befb-47a2-bc78-f9d4bc75ef67 for instance with vm_state building and task_state spawning.
Nov 30 12:37:23 user nova-compute[75672]: DEBUG nova.compute.manager [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:37:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:37:23 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Instance spawned successfully.
Nov 30 12:37:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:37:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:23 user nova-compute[75672]: INFO nova.compute.manager [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Took 7.80 seconds to spawn the instance on the hypervisor.
Nov 30 12:37:23 user nova-compute[75672]: DEBUG nova.compute.manager [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:37:23 user nova-compute[75672]: INFO nova.compute.manager [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Took 8.56 seconds to build instance.
Nov 30 12:37:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e345ebf2-7f21-4855-88dd-1ce2ae4b1089 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.710s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-9c6bdcbd-3671-4bf4-9485-d6dfc71dc184 req-84b654e6-74d8-4e5c-931f-49e4d5878632 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received event network-vif-plugged-20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9c6bdcbd-3671-4bf4-9485-d6dfc71dc184 req-84b654e6-74d8-4e5c-931f-49e4d5878632 service nova] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9c6bdcbd-3671-4bf4-9485-d6dfc71dc184 req-84b654e6-74d8-4e5c-931f-49e4d5878632 service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9c6bdcbd-3671-4bf4-9485-d6dfc71dc184 req-84b654e6-74d8-4e5c-931f-49e4d5878632 service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-9c6bdcbd-3671-4bf4-9485-d6dfc71dc184 req-84b654e6-74d8-4e5c-931f-49e4d5878632 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] No waiting events found dispatching network-vif-plugged-20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:37:24 user nova-compute[75672]: WARNING nova.compute.manager [req-9c6bdcbd-3671-4bf4-9485-d6dfc71dc184 req-84b654e6-74d8-4e5c-931f-49e4d5878632 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received unexpected event network-vif-plugged-20e0a542-befb-47a2-bc78-f9d4bc75ef67 for instance with vm_state active and task_state None.
Nov 30 12:37:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:24 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:37:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:24 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:37:24 user nova-compute[75672]: INFO nova.compute.claims [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Claim successful on node user
Nov 30 12:37:25 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG nova.network.neutron [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:37:25 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:37:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG nova.policy [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68b5a0c78cb840038a79b946d02562a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69506305cadd4ab483ce9ee5e8da9625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:37:25 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Creating image(s)
Nov 30 12:37:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "/opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "/opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "/opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.182s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.192s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk 1073741824" returned: 0 in 0.061s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG nova.network.neutron [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Successfully created port: 955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Cannot resize image /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Ensure instance console log exists: /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG nova.network.neutron [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Successfully updated port: 955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquired lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:37:26 user nova-compute[75672]: DEBUG nova.network.neutron [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-b48f428a-f3b0-4fe8-a24d-83793d06b157 req-939335ba-3a56-45d8-a95a-c51870067943 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-changed-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-b48f428a-f3b0-4fe8-a24d-83793d06b157 req-939335ba-3a56-45d8-a95a-c51870067943 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Refreshing instance network info cache due to event network-changed-955b65e8-9d92-4ba6-a330-7ca8fd6433ca. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b48f428a-f3b0-4fe8-a24d-83793d06b157 req-939335ba-3a56-45d8-a95a-c51870067943 service nova] Acquiring lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updating instance_info_cache with network_info: [{"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Releasing lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Instance network_info: |[{"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b48f428a-f3b0-4fe8-a24d-83793d06b157 req-939335ba-3a56-45d8-a95a-c51870067943 service nova] Acquired lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.network.neutron [req-b48f428a-f3b0-4fe8-a24d-83793d06b157 req-939335ba-3a56-45d8-a95a-c51870067943 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Refreshing network info cache for port 955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Start _get_guest_xml network_info=[{"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:37:27 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:37:27 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-961439957',display_name='tempest-ServerActionsTestOtherB-server-961439957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-961439957',id=18,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9gzfXTAlw2XGf9HvtWm3alibDkZBaXqK6wU5D1XQgJAmyQFnvfR/7D9hAZOoFAhfgJYL3hqOw1f+3LmQPn02on/lNVBVazzydax1s8XfXwCPBkyn03q1zhUSD6eiHCpA==',key_name='tempest-keypair-1520780273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69506305cadd4ab483ce9ee5e8da9625',ramdisk_id='',reservation_id='r-k234blik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-372668652',owner_user_name='tempest-ServerActionsTestOtherB-372668652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68b5a0c78cb840038a79b946d02562a6',uuid=8de0a3f4-abcb-4302-90ea-aea9b8b996f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converting VIF {"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.objects.instance [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lazy-loading 'pci_devices' on Instance uuid 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:37:27 user nova-compute[75672]:   <uuid>8de0a3f4-abcb-4302-90ea-aea9b8b996f2</uuid>
Nov 30 12:37:27 user nova-compute[75672]:   <name>instance-00000012</name>
Nov 30 12:37:27 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:37:27 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:37:27 user nova-compute[75672]:   <metadata>
Nov 30 12:37:27 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:37:27 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:37:27 user nova-compute[75672]:       <nova:name>tempest-ServerActionsTestOtherB-server-961439957</nova:name>
Nov 30 12:37:27 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:37:27</nova:creationTime>
Nov 30 12:37:27 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:37:27 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:37:27 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:37:27 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:37:27 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:37:27 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:37:27 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:37:27 user nova-compute[75672]:       <nova:owner>
Nov 30 12:37:27 user nova-compute[75672]:         <nova:user uuid="68b5a0c78cb840038a79b946d02562a6">tempest-ServerActionsTestOtherB-372668652-project-member</nova:user>
Nov 30 12:37:27 user nova-compute[75672]:         <nova:project uuid="69506305cadd4ab483ce9ee5e8da9625">tempest-ServerActionsTestOtherB-372668652</nova:project>
Nov 30 12:37:27 user nova-compute[75672]:       </nova:owner>
Nov 30 12:37:27 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:37:27 user nova-compute[75672]:       <nova:ports>
Nov 30 12:37:27 user nova-compute[75672]:         <nova:port uuid="955b65e8-9d92-4ba6-a330-7ca8fd6433ca">
Nov 30 12:37:27 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 12:37:27 user nova-compute[75672]:         </nova:port>
Nov 30 12:37:27 user nova-compute[75672]:       </nova:ports>
Nov 30 12:37:27 user nova-compute[75672]:     </nova:instance>
Nov 30 12:37:27 user nova-compute[75672]:   </metadata>
Nov 30 12:37:27 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:37:27 user nova-compute[75672]:     <system>
Nov 30 12:37:27 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:37:27 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:37:27 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:37:27 user nova-compute[75672]:       <entry name="serial">8de0a3f4-abcb-4302-90ea-aea9b8b996f2</entry>
Nov 30 12:37:27 user nova-compute[75672]:       <entry name="uuid">8de0a3f4-abcb-4302-90ea-aea9b8b996f2</entry>
Nov 30 12:37:27 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:37:27 user nova-compute[75672]:     </system>
Nov 30 12:37:27 user nova-compute[75672]:   </sysinfo>
Nov 30 12:37:27 user nova-compute[75672]:   <os>
Nov 30 12:37:27 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:37:27 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:37:27 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:37:27 user nova-compute[75672]:   </os>
Nov 30 12:37:27 user nova-compute[75672]:   <features>
Nov 30 12:37:27 user nova-compute[75672]:     <acpi/>
Nov 30 12:37:27 user nova-compute[75672]:     <apic/>
Nov 30 12:37:27 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:37:27 user nova-compute[75672]:   </features>
Nov 30 12:37:27 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:37:27 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:37:27 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:37:27 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:37:27 user nova-compute[75672]:   </clock>
Nov 30 12:37:27 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:37:27 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:37:27 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:37:27 user nova-compute[75672]:   </cpu>
Nov 30 12:37:27 user nova-compute[75672]:   <devices>
Nov 30 12:37:27 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:37:27 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:37:27 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk"/>
Nov 30 12:37:27 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:37:27 user nova-compute[75672]:     </disk>
Nov 30 12:37:27 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:37:27 user nova-compute[75672]:       <mac address="fa:16:3e:f3:03:0e"/>
Nov 30 12:37:27 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:37:27 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:37:27 user nova-compute[75672]:       <target dev="tap955b65e8-9d"/>
Nov 30 12:37:27 user nova-compute[75672]:     </interface>
Nov 30 12:37:27 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:37:27 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/console.log" append="off"/>
Nov 30 12:37:27 user nova-compute[75672]:     </serial>
Nov 30 12:37:27 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:37:27 user nova-compute[75672]:     <video>
Nov 30 12:37:27 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:37:27 user nova-compute[75672]:     </video>
Nov 30 12:37:27 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:37:27 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:37:27 user nova-compute[75672]:     </rng>
Nov 30 12:37:27 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:37:27 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:37:27 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:37:27 user nova-compute[75672]:     </memballoon>
Nov 30 12:37:27 user nova-compute[75672]:   </devices>
Nov 30 12:37:27 user nova-compute[75672]: </domain>
Nov 30 12:37:27 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-961439957',display_name='tempest-ServerActionsTestOtherB-server-961439957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-961439957',id=18,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9gzfXTAlw2XGf9HvtWm3alibDkZBaXqK6wU5D1XQgJAmyQFnvfR/7D9hAZOoFAhfgJYL3hqOw1f+3LmQPn02on/lNVBVazzydax1s8XfXwCPBkyn03q1zhUSD6eiHCpA==',key_name='tempest-keypair-1520780273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69506305cadd4ab483ce9ee5e8da9625',ramdisk_id='',reservation_id='r-k234blik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-372668652',owner_user_name='tempest-ServerActionsTestOtherB-372668652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68b5a0c78cb840038a79b946d02562a6',uuid=8de0a3f4-abcb-4302-90ea-aea9b8b996f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converting VIF {"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG os_vif [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0f18934-5ac0-5905-b2ef-d84d01513dca', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap955b65e8-9d, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap955b65e8-9d, col_values=(('qos', UUID('b10d979a-42b0-49ba-9840-bbb5996e0811')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap955b65e8-9d, col_values=(('external_ids', {'iface-id': '955b65e8-9d92-4ba6-a330-7ca8fd6433ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:03:0e', 'vm-uuid': '8de0a3f4-abcb-4302-90ea-aea9b8b996f2'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:27 user nova-compute[75672]: INFO os_vif [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d')
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] No VIF found with MAC fa:16:3e:f3:03:0e, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.network.neutron [req-b48f428a-f3b0-4fe8-a24d-83793d06b157 req-939335ba-3a56-45d8-a95a-c51870067943 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updated VIF entry in instance network info cache for port 955b65e8-9d92-4ba6-a330-7ca8fd6433ca. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG nova.network.neutron [req-b48f428a-f3b0-4fe8-a24d-83793d06b157 req-939335ba-3a56-45d8-a95a-c51870067943 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updating instance_info_cache with network_info: [{"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:37:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b48f428a-f3b0-4fe8-a24d-83793d06b157 req-939335ba-3a56-45d8-a95a-c51870067943 service nova] Releasing lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:37:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "3df9c388-08c6-4153-9666-8e492acda60c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "3df9c388-08c6-4153-9666-8e492acda60c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:28 user nova-compute[75672]: DEBUG nova.compute.manager [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:37:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:37:28 user nova-compute[75672]: INFO nova.compute.claims [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Claim successful on node user
Nov 30 12:37:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG nova.compute.manager [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG nova.compute.manager [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG nova.network.neutron [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:37:29 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:37:29 user nova-compute[75672]: DEBUG nova.compute.manager [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG nova.policy [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8b5b87badbf493088f822838b837eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7e24ecd9d04dd4b8bccda3e63fa11d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:37:29 user nova-compute[75672]: INFO nova.virt.block_device [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Booting with volume 9764ed21-1fb1-4191-abba-933061358224 at /dev/vda
Nov 30 12:37:29 user nova-compute[75672]: DEBUG os_brick.utils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[62118070-44c9-4136-8bd1-ce6459b2762d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[31548eab-9bf8-4b0d-a6be-f13e420340d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fb03f3-6605-4ad2-bb90-39b861d20196]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ad3abb-37ae-4a15-8c89-77a6a2f7936c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:37:29 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:37:29 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a3bd05-dafe-4b82-bfb3-1a3baec14c32]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG os_brick.utils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Updating existing volume attachment record: cb98ecaf-562d-4c4a-8d03-e2b1880f4712 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:30 user nova-compute[75672]: DEBUG nova.network.neutron [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Successfully created port: b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:37:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:30 user nova-compute[75672]: DEBUG nova.network.neutron [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Successfully updated port: b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:37:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "refresh_cache-3df9c388-08c6-4153-9666-8e492acda60c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:37:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquired lock "refresh_cache-3df9c388-08c6-4153-9666-8e492acda60c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:37:30 user nova-compute[75672]: DEBUG nova.network.neutron [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-679eb610-1c37-428d-845f-17b976690437 req-df33f0a7-f5e7-4565-8b25-a1163dbf34b6 service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received event network-changed-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-679eb610-1c37-428d-845f-17b976690437 req-df33f0a7-f5e7-4565-8b25-a1163dbf34b6 service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Refreshing instance network info cache due to event network-changed-b14a6da4-b394-4ecc-bdbb-483cdbd2c581. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-679eb610-1c37-428d-845f-17b976690437 req-df33f0a7-f5e7-4565-8b25-a1163dbf34b6 service nova] Acquiring lock "refresh_cache-3df9c388-08c6-4153-9666-8e492acda60c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.network.neutron [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:37:31 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Instance spawned successfully.
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:37:31 user nova-compute[75672]: INFO nova.compute.manager [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:37:31 user nova-compute[75672]: INFO nova.compute.manager [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Took 6.79 seconds to build instance.
Nov 30 12:37:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-85f7c21c-b973-422f-a10c-8fb3635879f4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-85f7c21c-b973-422f-a10c-8fb3635879f4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3b6344ec-3109-4fd4-9022-254e472c7eaf tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.973s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.network.neutron [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Updating instance_info_cache with network_info: [{"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Releasing lock "refresh_cache-3df9c388-08c6-4153-9666-8e492acda60c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.compute.manager [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Instance network_info: |[{"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-679eb610-1c37-428d-845f-17b976690437 req-df33f0a7-f5e7-4565-8b25-a1163dbf34b6 service nova] Acquired lock "refresh_cache-3df9c388-08c6-4153-9666-8e492acda60c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:37:31 user nova-compute[75672]: DEBUG nova.network.neutron [req-679eb610-1c37-428d-845f-17b976690437 req-df33f0a7-f5e7-4565-8b25-a1163dbf34b6 service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Refreshing network info cache for port b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:37:32 user nova-compute[75672]: DEBUG nova.network.neutron [req-679eb610-1c37-428d-845f-17b976690437 req-df33f0a7-f5e7-4565-8b25-a1163dbf34b6 service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Updated VIF entry in instance network info cache for port b14a6da4-b394-4ecc-bdbb-483cdbd2c581. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:37:32 user nova-compute[75672]: DEBUG nova.network.neutron [req-679eb610-1c37-428d-845f-17b976690437 req-df33f0a7-f5e7-4565-8b25-a1163dbf34b6 service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Updating instance_info_cache with network_info: [{"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:37:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-679eb610-1c37-428d-845f-17b976690437 req-df33f0a7-f5e7-4565-8b25-a1163dbf34b6 service nova] Releasing lock "refresh_cache-3df9c388-08c6-4153-9666-8e492acda60c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:37:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:32 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Updating instance_info_cache with network_info: [{"id": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "address": "fa:16:3e:30:a9:02", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63d8e51-e8", "ovs_interfaceid": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:37:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-85f7c21c-b973-422f-a10c-8fb3635879f4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:37:32 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:37:32 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:37:32 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:37:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-528d0923-fffb-4438-b1ad-9968a958426f req-3ca166a7-b581-4e85-94ef-012f9aae36f4 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-528d0923-fffb-4438-b1ad-9968a958426f req-3ca166a7-b581-4e85-94ef-012f9aae36f4 service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-528d0923-fffb-4438-b1ad-9968a958426f req-3ca166a7-b581-4e85-94ef-012f9aae36f4 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-528d0923-fffb-4438-b1ad-9968a958426f req-3ca166a7-b581-4e85-94ef-012f9aae36f4 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-528d0923-fffb-4438-b1ad-9968a958426f req-3ca166a7-b581-4e85-94ef-012f9aae36f4 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:37:32 user nova-compute[75672]: WARNING nova.compute.manager [req-528d0923-fffb-4438-b1ad-9968a958426f req-3ca166a7-b581-4e85-94ef-012f9aae36f4 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received unexpected event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with vm_state active and task_state None.
Nov 30 12:37:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:33 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:37:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:33 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:37:33 user nova-compute[75672]: INFO nova.compute.claims [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Claim successful on node user
Nov 30 12:37:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-6c3319ab-21f6-4926-8c79-6fb1c9b5df5b req-315d79e9-10e4-4cf7-a94d-904bdac1b164 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received event network-changed-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-6c3319ab-21f6-4926-8c79-6fb1c9b5df5b req-315d79e9-10e4-4cf7-a94d-904bdac1b164 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Refreshing instance network info cache due to event network-changed-e6b0f7c3-fddc-4725-991e-7155b341322e. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:37:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6c3319ab-21f6-4926-8c79-6fb1c9b5df5b req-315d79e9-10e4-4cf7-a94d-904bdac1b164 service nova] Acquiring lock "refresh_cache-3338ed96-33ff-45e6-b3da-05fbb242a3a9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:37:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6c3319ab-21f6-4926-8c79-6fb1c9b5df5b req-315d79e9-10e4-4cf7-a94d-904bdac1b164 service nova] Acquired lock "refresh_cache-3338ed96-33ff-45e6-b3da-05fbb242a3a9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:37:33 user nova-compute[75672]: DEBUG nova.network.neutron [req-6c3319ab-21f6-4926-8c79-6fb1c9b5df5b req-315d79e9-10e4-4cf7-a94d-904bdac1b164 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Refreshing network info cache for port e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG nova.network.neutron [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:37:34 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:37:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:37:34 user nova-compute[75672]: INFO nova.virt.block_device [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Booting with volume snapshot a6bd37f0-762e-4f69-a26e-275c1c9330fb at /dev/vda
Nov 30 12:37:34 user nova-compute[75672]: DEBUG nova.policy [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '924cf8ff73154f8fadb371175a0d8fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513644b3a140400dbdf6b07e8e727dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG nova.network.neutron [req-6c3319ab-21f6-4926-8c79-6fb1c9b5df5b req-315d79e9-10e4-4cf7-a94d-904bdac1b164 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Updated VIF entry in instance network info cache for port e6b0f7c3-fddc-4725-991e-7155b341322e. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG nova.network.neutron [req-6c3319ab-21f6-4926-8c79-6fb1c9b5df5b req-315d79e9-10e4-4cf7-a94d-904bdac1b164 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Updating instance_info_cache with network_info: [{"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6c3319ab-21f6-4926-8c79-6fb1c9b5df5b req-315d79e9-10e4-4cf7-a94d-904bdac1b164 service nova] Releasing lock "refresh_cache-3338ed96-33ff-45e6-b3da-05fbb242a3a9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:34 user nova-compute[75672]: INFO nova.compute.manager [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Terminating instance
Nov 30 12:37:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG nova.objects.instance [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lazy-loading 'flavor' on Instance uuid 3338ed96-33ff-45e6-b3da-05fbb242a3a9 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:35 user nova-compute[75672]: INFO nova.compute.manager [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Attaching volume c675a5ae-91ed-48ce-a295-2f20fe60b721 to /dev/vdb
Nov 30 12:37:35 user nova-compute[75672]: DEBUG nova.compute.manager [req-3bf8e27f-f764-4af7-b559-fdcfd0606831 req-946ba071-fff7-41b8-9558-587ae4face6c service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3bf8e27f-f764-4af7-b559-fdcfd0606831 req-946ba071-fff7-41b8-9558-587ae4face6c service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3bf8e27f-f764-4af7-b559-fdcfd0606831 req-946ba071-fff7-41b8-9558-587ae4face6c service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3bf8e27f-f764-4af7-b559-fdcfd0606831 req-946ba071-fff7-41b8-9558-587ae4face6c service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG nova.compute.manager [req-3bf8e27f-f764-4af7-b559-fdcfd0606831 req-946ba071-fff7-41b8-9558-587ae4face6c service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:37:35 user nova-compute[75672]: WARNING nova.compute.manager [req-3bf8e27f-f764-4af7-b559-fdcfd0606831 req-946ba071-fff7-41b8-9558-587ae4face6c service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received unexpected event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with vm_state active and task_state None.
Nov 30 12:37:35 user nova-compute[75672]: DEBUG nova.compute.manager [req-475dd9e1-f162-42bf-9039-5c432dab6c99 req-63f0dcf1-d2b8-454b-b6ab-46cfb8bdeee5 service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Received event network-vif-unplugged-890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-475dd9e1-f162-42bf-9039-5c432dab6c99 req-63f0dcf1-d2b8-454b-b6ab-46cfb8bdeee5 service nova] Acquiring lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-475dd9e1-f162-42bf-9039-5c432dab6c99 req-63f0dcf1-d2b8-454b-b6ab-46cfb8bdeee5 service nova] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-475dd9e1-f162-42bf-9039-5c432dab6c99 req-63f0dcf1-d2b8-454b-b6ab-46cfb8bdeee5 service nova] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG nova.compute.manager [req-475dd9e1-f162-42bf-9039-5c432dab6c99 req-63f0dcf1-d2b8-454b-b6ab-46cfb8bdeee5 service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] No waiting events found dispatching network-vif-unplugged-890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG nova.compute.manager [req-475dd9e1-f162-42bf-9039-5c432dab6c99 req-63f0dcf1-d2b8-454b-b6ab-46cfb8bdeee5 service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Received event network-vif-unplugged-890df6ae-1036-4cfd-b155-04a5c16f093c for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG os_brick.utils [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5487b43-64e7-4c8b-9415-d218b0624b4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[83308f66-593e-4008-a2cf-87d35468d054]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f8edde-6dde-47bd-9de0-3aa0db1d1346]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b4b473-737d-4c3c-92bd-1e4b1d5a1564]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG nova.network.neutron [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Successfully created port: 31ba46ba-f0ae-40d4-ac4b-7914275839bb {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:37:35 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6c87e9-ad03-42f6-b322-06b35a15a25a]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG os_brick.utils [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Updating existing volume attachment record: d82933d0-3718-4b9e-8f33-0d611e8ca11d {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:37:35 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Instance destroyed successfully.
Nov 30 12:37:35 user nova-compute[75672]: DEBUG nova.objects.instance [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'resources' on Instance uuid dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2035650168',display_name='tempest-AttachVolumeNegativeTest-server-2035650168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2035650168',id=3,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvwa69budcC+O3KRetpHknkddPlXz9FOhlpMfvHilEsy/pcuVLdEh7P74ai+2PVmLrj6NKz7mDZGvVY7Vzr/Q7C6mC9R4ojWlxTTE5WJ1Vtr6BWDnnCgpODmJdqKNPllA==',key_name='tempest-keypair-124273081',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:32:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04f07019e3584771af197e865b6877cc',ramdisk_id='',reservation_id='r-7az41u58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1224349538',owner_user_name='tempest-AttachVolumeNegativeTest-1224349538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:32:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3166f2b3dee4aa4aa738f1f15ca7d19',uuid=dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "890df6ae-1036-4cfd-b155-04a5c16f093c", "address": "fa:16:3e:9e:f7:d3", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890df6ae-10", "ovs_interfaceid": "890df6ae-1036-4cfd-b155-04a5c16f093c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converting VIF {"id": "890df6ae-1036-4cfd-b155-04a5c16f093c", "address": "fa:16:3e:9e:f7:d3", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890df6ae-10", "ovs_interfaceid": "890df6ae-1036-4cfd-b155-04a5c16f093c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:f7:d3,bridge_name='br-int',has_traffic_filtering=True,id=890df6ae-1036-4cfd-b155-04a5c16f093c,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890df6ae-10') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG os_vif [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:f7:d3,bridge_name='br-int',has_traffic_filtering=True,id=890df6ae-1036-4cfd-b155-04a5c16f093c,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890df6ae-10') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap890df6ae-10, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bbed484-bb86-47f6-8a2b-f58c6d6e08a6) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:37:35 user nova-compute[75672]: INFO os_vif [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:f7:d3,bridge_name='br-int',has_traffic_filtering=True,id=890df6ae-1036-4cfd-b155-04a5c16f093c,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890df6ae-10')
Nov 30 12:37:35 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Deleting instance files /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6_del
Nov 30 12:37:35 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Deletion of /opt/stack/data/nova/instances/dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6_del complete
Nov 30 12:37:35 user nova-compute[75672]: INFO nova.compute.manager [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk.rescue --force-share --output=json" returned: 0 in 0.285s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG nova.network.neutron [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Successfully updated port: 31ba46ba-f0ae-40d4-ac4b-7914275839bb {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:37:36 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Took 1.13 seconds to deallocate network for instance.
Nov 30 12:37:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "refresh_cache-33acdb4c-16f6-4873-9af8-6297cbfda1c1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquired lock "refresh_cache-33acdb4c-16f6-4873-9af8-6297cbfda1c1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG nova.network.neutron [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-e6fedd0d-911f-468a-ad05-e80ed6ff5181 req-107448c5-98f9-4791-9435-de9c58d19548 service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Received event network-changed-31ba46ba-f0ae-40d4-ac4b-7914275839bb {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-e6fedd0d-911f-468a-ad05-e80ed6ff5181 req-107448c5-98f9-4791-9435-de9c58d19548 service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Refreshing instance network info cache due to event network-changed-31ba46ba-f0ae-40d4-ac4b-7914275839bb. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e6fedd0d-911f-468a-ad05-e80ed6ff5181 req-107448c5-98f9-4791-9435-de9c58d19548 service nova] Acquiring lock "refresh_cache-33acdb4c-16f6-4873-9af8-6297cbfda1c1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG nova.network.neutron [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-c15c51ea-2bc6-4205-85d7-009ece1f32d5 req-4b41bce0-0141-4964-a482-d505af1ffdce service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Received event network-vif-plugged-890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c15c51ea-2bc6-4205-85d7-009ece1f32d5 req-4b41bce0-0141-4964-a482-d505af1ffdce service nova] Acquiring lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c15c51ea-2bc6-4205-85d7-009ece1f32d5 req-4b41bce0-0141-4964-a482-d505af1ffdce service nova] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c15c51ea-2bc6-4205-85d7-009ece1f32d5 req-4b41bce0-0141-4964-a482-d505af1ffdce service nova] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-c15c51ea-2bc6-4205-85d7-009ece1f32d5 req-4b41bce0-0141-4964-a482-d505af1ffdce service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] No waiting events found dispatching network-vif-plugged-890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:37:37 user nova-compute[75672]: WARNING nova.compute.manager [req-c15c51ea-2bc6-4205-85d7-009ece1f32d5 req-4b41bce0-0141-4964-a482-d505af1ffdce service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Received unexpected event network-vif-plugged-890df6ae-1036-4cfd-b155-04a5c16f093c for instance with vm_state deleted and task_state None.
Nov 30 12:37:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-c15c51ea-2bc6-4205-85d7-009ece1f32d5 req-4b41bce0-0141-4964-a482-d505af1ffdce service nova] [instance: dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6] Received event network-vif-deleted-890df6ae-1036-4cfd-b155-04a5c16f093c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG nova.network.neutron [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Updating instance_info_cache with network_info: [{"id": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "address": "fa:16:3e:83:62:dc", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ba46ba-f0", "ovs_interfaceid": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Releasing lock "refresh_cache-33acdb4c-16f6-4873-9af8-6297cbfda1c1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Instance network_info: |[{"id": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "address": "fa:16:3e:83:62:dc", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ba46ba-f0", "ovs_interfaceid": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e6fedd0d-911f-468a-ad05-e80ed6ff5181 req-107448c5-98f9-4791-9435-de9c58d19548 service nova] Acquired lock "refresh_cache-33acdb4c-16f6-4873-9af8-6297cbfda1c1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG nova.network.neutron [req-e6fedd0d-911f-468a-ad05-e80ed6ff5181 req-107448c5-98f9-4791-9435-de9c58d19548 service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Refreshing network info cache for port 31ba46ba-f0ae-40d4-ac4b-7914275839bb {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.963s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json" returned: 0 in 0.454s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:37 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Deleted allocations for instance dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6
Nov 30 12:37:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7bb546d6-4b23-48dc-87d7-d455f155d5c2 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.536s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:38 user nova-compute[75672]: DEBUG nova.network.neutron [req-e6fedd0d-911f-468a-ad05-e80ed6ff5181 req-107448c5-98f9-4791-9435-de9c58d19548 service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Updated VIF entry in instance network info cache for port 31ba46ba-f0ae-40d4-ac4b-7914275839bb. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:37:38 user nova-compute[75672]: DEBUG nova.network.neutron [req-e6fedd0d-911f-468a-ad05-e80ed6ff5181 req-107448c5-98f9-4791-9435-de9c58d19548 service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Updating instance_info_cache with network_info: [{"id": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "address": "fa:16:3e:83:62:dc", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ba46ba-f0", "ovs_interfaceid": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:37:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e6fedd0d-911f-468a-ad05-e80ed6ff5181 req-107448c5-98f9-4791-9435-de9c58d19548 service nova] Releasing lock "refresh_cache-33acdb4c-16f6-4873-9af8-6297cbfda1c1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:37:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:38 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Error from libvirt while getting description of instance-00000003: [Error Code 42] Domain not found: no domain with matching uuid 'dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6' (instance-00000003): libvirt.libvirtError: Domain not found: no domain with matching uuid 'dcfd8c0c-e1d7-463f-a3f0-4402ae2956e6' (instance-00000003)
Nov 30 12:37:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:37:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG os_brick.utils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e03b62-e236-4076-990f-97f363abbf3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[84638d9f-2683-4f5f-af3b-232909d778fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[387037fa-b743-439e-b5e2-c4e2d2da4ad2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c64197c-53ce-4727-9ab3-472b74cf124a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:37:40 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ea294b-6a30-499d-9df2-bf80d0ca0d58]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG os_brick.utils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== get_connector_properties: return (253ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Updating existing volume attachment record: f94e82f8-86e7-4ba0-9af4-bb26a2d9eb28 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.compute.manager [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:37:41 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Creating image(s)
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Ensure instance console log exists: /opt/stack/data/nova/instances/3df9c388-08c6-4153-9666-8e492acda60c/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Start _get_guest_xml network_info=[{"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'cb98ecaf-562d-4c4a-8d03-e2b1880f4712', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lmCEdvRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3df9c388-08c6-4153-9666-8e492acda60c', 'attached_at': '', 'detached_at': '', 'volume_id': '9764ed21-1fb1-4191-abba-933061358224', 'serial': '9764ed21-1fb1-4191-abba-933061358224'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:37:41 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:37:41 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lmCEdvRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:37:41 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:37:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:37:41 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:37:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:37:41 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:37:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2149014-8e3b-462d-8956-87d18e888aa5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:37:41 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f804dea2-4bf0-4064-aca3-fcf3388f4d8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224] added
Nov 30 12:37:42 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:42 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:37:42 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7595MB free_disk=25.36505889892578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec66ced-4dbf-4ce9-8725-314ea17e6aa2]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc41bd71-d817-4eb6-9d6d-f2bccfcea462]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lmCEdvRt {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lmCEdvRt" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8fcb79-d8f3-436e-a00a-1edc0ef0d367]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lmCEdvRt'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b155f550-55e3-4319-b8e1-7a6dad24a34c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5422d459-d8a0-4480-9eef-9095285a6e04]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:42 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:42 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:42 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:42 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de88d15-8b84-4785-aae6-7d7b08994100]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260]
Nov 30 12:37:42 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260] successful.
Nov 30 12:37:42 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:42 user nova-compute[75672]: INFO nova.compute.manager [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Detaching volume c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[076d6c32-562c-40cd-b201-886823a988e1]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30474e8-0a59-4ad9-8349-60551f6e8a0c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:42 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:42 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:37:42 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:42 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:42 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:37:42 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.819s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5102141d-4e9d-4d1d-9c3d-60356d433c4b]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lmCEdvRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:37:42 user nova-compute[75672]: INFO nova.virt.block_device [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Attempting to driver detach volume c6f5b089-e352-4270-b369-e79ce8349e93 from mountpoint /dev/vdb
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Attempting to detach device vdb from instance 1fba8af1-8074-4ce8-be23-912e9850fc41 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:37:42 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:37:42 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 12:37:42 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:37:42 user nova-compute[75672]:   <serial>c6f5b089-e352-4270-b369-e79ce8349e93</serial>
Nov 30 12:37:42 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 12:37:42 user nova-compute[75672]: </disk>
Nov 30 12:37:42 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:37:42 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Successfully detached device vdb from instance 1fba8af1-8074-4ce8-be23-912e9850fc41 from the persistent domain config.
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1fba8af1-8074-4ce8-be23-912e9850fc41 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:37:42 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:37:42 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 12:37:42 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:37:42 user nova-compute[75672]:   <serial>c6f5b089-e352-4270-b369-e79ce8349e93</serial>
Nov 30 12:37:42 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 12:37:42 user nova-compute[75672]: </disk>
Nov 30 12:37:42 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 1fba8af1-8074-4ce8-be23-912e9850fc41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 85f7c21c-b973-422f-a10c-8fb3635879f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 4382544b-6fb7-4164-9b6b-302a6e24bc52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 3338ed96-33ff-45e6-b3da-05fbb242a3a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f53f77ca-8471-4c62-a779-f64a0a4e57aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 3df9c388-08c6-4153-9666-8e492acda60c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 33acdb4c-16f6-4873-9af8-6297cbfda1c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing inventories for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating ProviderTree inventory for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating inventory in ProviderTree for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing aggregate associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, aggregates: None {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing trait associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.976s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:37:42 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] There are 0 instances to clean {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75672) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.859s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] <== connect_volume: return (1862ms) {'type': 'block', 'scsi_wwn': '26637633865356564', 'path': '/dev/sdd'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637633865356564', 'path': '/dev/sdd'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1014565837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1014565837',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxVNzI61C+OsJEwoPnrmP+C9u0Q3vxKD7EbOWbJUoD3wO5iAP3H5v2ErA0fq8PwQEvcEJsCQLdoim+V3xyoHIeOXDIbKXCEfzED1p1bzn0arLa41lNMTF7Ls62V6j5bJQ==',key_name='tempest-keypair-224557939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c7e24ecd9d04dd4b8bccda3e63fa11d',ramdisk_id='',reservation_id='r-1br6g41s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-679548509',owner_user_name='tempest-ServerActionsV293TestJSON-679548509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:37:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8b5b87badbf493088f822838b837eb2',uuid=3df9c388-08c6-4153-9666-8e492acda60c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Converting VIF {"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=b14a6da4-b394-4ecc-bdbb-483cdbd2c581,network=Network(38c2361b-fa3a-44d1-9764-a4a7a9af6d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14a6da4-b3') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG nova.objects.instance [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lazy-loading 'pci_devices' on Instance uuid 3df9c388-08c6-4153-9666-8e492acda60c {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:37:43 user nova-compute[75672]:   <uuid>3df9c388-08c6-4153-9666-8e492acda60c</uuid>
Nov 30 12:37:43 user nova-compute[75672]:   <name>instance-00000013</name>
Nov 30 12:37:43 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:37:43 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:37:43 user nova-compute[75672]:   <metadata>
Nov 30 12:37:43 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:37:43 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:37:43 user nova-compute[75672]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1014565837</nova:name>
Nov 30 12:37:43 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:37:41</nova:creationTime>
Nov 30 12:37:43 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:37:43 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:37:43 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:37:43 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:37:43 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:37:43 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:37:43 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:37:43 user nova-compute[75672]:       <nova:owner>
Nov 30 12:37:43 user nova-compute[75672]:         <nova:user uuid="a8b5b87badbf493088f822838b837eb2">tempest-ServerActionsV293TestJSON-679548509-project-member</nova:user>
Nov 30 12:37:43 user nova-compute[75672]:         <nova:project uuid="3c7e24ecd9d04dd4b8bccda3e63fa11d">tempest-ServerActionsV293TestJSON-679548509</nova:project>
Nov 30 12:37:43 user nova-compute[75672]:       </nova:owner>
Nov 30 12:37:43 user nova-compute[75672]:       <nova:ports>
Nov 30 12:37:43 user nova-compute[75672]:         <nova:port uuid="b14a6da4-b394-4ecc-bdbb-483cdbd2c581">
Nov 30 12:37:43 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 12:37:43 user nova-compute[75672]:         </nova:port>
Nov 30 12:37:43 user nova-compute[75672]:       </nova:ports>
Nov 30 12:37:43 user nova-compute[75672]:     </nova:instance>
Nov 30 12:37:43 user nova-compute[75672]:   </metadata>
Nov 30 12:37:43 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:37:43 user nova-compute[75672]:     <system>
Nov 30 12:37:43 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:37:43 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:37:43 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:37:43 user nova-compute[75672]:       <entry name="serial">3df9c388-08c6-4153-9666-8e492acda60c</entry>
Nov 30 12:37:43 user nova-compute[75672]:       <entry name="uuid">3df9c388-08c6-4153-9666-8e492acda60c</entry>
Nov 30 12:37:43 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:37:43 user nova-compute[75672]:     </system>
Nov 30 12:37:43 user nova-compute[75672]:   </sysinfo>
Nov 30 12:37:43 user nova-compute[75672]:   <os>
Nov 30 12:37:43 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:37:43 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:37:43 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:37:43 user nova-compute[75672]:   </os>
Nov 30 12:37:43 user nova-compute[75672]:   <features>
Nov 30 12:37:43 user nova-compute[75672]:     <acpi/>
Nov 30 12:37:43 user nova-compute[75672]:     <apic/>
Nov 30 12:37:43 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:37:43 user nova-compute[75672]:   </features>
Nov 30 12:37:43 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:37:43 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:37:43 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:37:43 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:37:43 user nova-compute[75672]:   </clock>
Nov 30 12:37:43 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:37:43 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:37:43 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:37:43 user nova-compute[75672]:   </cpu>
Nov 30 12:37:43 user nova-compute[75672]:   <devices>
Nov 30 12:37:43 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:37:43 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:37:43 user nova-compute[75672]:       <source dev="/dev/sdd"/>
Nov 30 12:37:43 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:37:43 user nova-compute[75672]:       <serial>9764ed21-1fb1-4191-abba-933061358224</serial>
Nov 30 12:37:43 user nova-compute[75672]:     </disk>
Nov 30 12:37:43 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:37:43 user nova-compute[75672]:       <mac address="fa:16:3e:f4:6e:b8"/>
Nov 30 12:37:43 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:37:43 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:37:43 user nova-compute[75672]:       <target dev="tapb14a6da4-b3"/>
Nov 30 12:37:43 user nova-compute[75672]:     </interface>
Nov 30 12:37:43 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:37:43 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/3df9c388-08c6-4153-9666-8e492acda60c/console.log" append="off"/>
Nov 30 12:37:43 user nova-compute[75672]:     </serial>
Nov 30 12:37:43 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:37:43 user nova-compute[75672]:     <video>
Nov 30 12:37:43 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:37:43 user nova-compute[75672]:     </video>
Nov 30 12:37:43 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:37:43 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:37:43 user nova-compute[75672]:     </rng>
Nov 30 12:37:43 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:37:43 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:37:43 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:37:43 user nova-compute[75672]:     </memballoon>
Nov 30 12:37:43 user nova-compute[75672]:   </devices>
Nov 30 12:37:43 user nova-compute[75672]: </domain>
Nov 30 12:37:43 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1014565837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1014565837',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxVNzI61C+OsJEwoPnrmP+C9u0Q3vxKD7EbOWbJUoD3wO5iAP3H5v2ErA0fq8PwQEvcEJsCQLdoim+V3xyoHIeOXDIbKXCEfzED1p1bzn0arLa41lNMTF7Ls62V6j5bJQ==',key_name='tempest-keypair-224557939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c7e24ecd9d04dd4b8bccda3e63fa11d',ramdisk_id='',reservation_id='r-1br6g41s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-679548509',owner_user_name='tempest-ServerActionsV293TestJSON-679548509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:37:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8b5b87badbf493088f822838b837eb2',uuid=3df9c388-08c6-4153-9666-8e492acda60c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Converting VIF {"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=b14a6da4-b394-4ecc-bdbb-483cdbd2c581,network=Network(38c2361b-fa3a-44d1-9764-a4a7a9af6d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14a6da4-b3') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG os_vif [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=b14a6da4-b394-4ecc-bdbb-483cdbd2c581,network=Network(38c2361b-fa3a-44d1-9764-a4a7a9af6d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14a6da4-b3') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f52d2cdc-ec1e-5075-a3aa-c31758bad295', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb14a6da4-b3, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb14a6da4-b3, col_values=(('qos', UUID('cfa01df5-2c7a-4095-9bbe-4eade823dd6f')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb14a6da4-b3, col_values=(('external_ids', {'iface-id': 'b14a6da4-b394-4ecc-bdbb-483cdbd2c581', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:6e:b8', 'vm-uuid': '3df9c388-08c6-4153-9666-8e492acda60c'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:43 user nova-compute[75672]: INFO os_vif [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=b14a6da4-b394-4ecc-bdbb-483cdbd2c581,network=Network(38c2361b-fa3a-44d1-9764-a4a7a9af6d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14a6da4-b3')
Nov 30 12:37:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:37:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] No VIF found with MAC fa:16:3e:f4:6e:b8, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:37:44 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:37:44 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:37:44 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_power_states {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:37:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-1ee92dd4-2d3f-498b-ab33-eef20698d2ad req-b2752f2d-2537-4a9c-a2e8-a917688b34ab service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received event network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1ee92dd4-2d3f-498b-ab33-eef20698d2ad req-b2752f2d-2537-4a9c-a2e8-a917688b34ab service nova] Acquiring lock "3df9c388-08c6-4153-9666-8e492acda60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1ee92dd4-2d3f-498b-ab33-eef20698d2ad req-b2752f2d-2537-4a9c-a2e8-a917688b34ab service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1ee92dd4-2d3f-498b-ab33-eef20698d2ad req-b2752f2d-2537-4a9c-a2e8-a917688b34ab service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-1ee92dd4-2d3f-498b-ab33-eef20698d2ad req-b2752f2d-2537-4a9c-a2e8-a917688b34ab service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] No waiting events found dispatching network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:37:46 user nova-compute[75672]: WARNING nova.compute.manager [req-1ee92dd4-2d3f-498b-ab33-eef20698d2ad req-b2752f2d-2537-4a9c-a2e8-a917688b34ab service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received unexpected event network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 for instance with vm_state building and task_state spawning.
Nov 30 12:37:46 user nova-compute[75672]: WARNING nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 62555959-6271-47e1-920c-b6333de4cca4 {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid d5a6266a-af9e-4050-bba8-92eae9ac28bf {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 85f7c21c-b973-422f-a10c-8fb3635879f4 {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 4382544b-6fb7-4164-9b6b-302a6e24bc52 {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 3338ed96-33ff-45e6-b3da-05fbb242a3a9 {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid f53f77ca-8471-4c62-a779-f64a0a4e57aa {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 3df9c388-08c6-4153-9666-8e492acda60c {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 33acdb4c-16f6-4873-9af8-6297cbfda1c1 {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "62555959-6271-47e1-920c-b6333de4cca4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "62555959-6271-47e1-920c-b6333de4cca4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "85f7c21c-b973-422f-a10c-8fb3635879f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "3df9c388-08c6-4153-9666-8e492acda60c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.182s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "62555959-6271-47e1-920c-b6333de4cca4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.196s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.222s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.232s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.228s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.250s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.284s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCIWmolt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:37:46 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:37:46 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:37:46 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[400eac50-5ff5-4f55-a23a-5b2c8f9b5fb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:37:46 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afd8878-ec31-4cb3-88fe-04bf7a1dbc92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721] added
Nov 30 12:37:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6534e0-a718-4ff3-8246-eae2deb7eeb7]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5b7dc1-b64b-45ca-b30b-0a041e44660e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCIWmolt {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCIWmolt" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd6c827-2a62-4974-ba07-b51afacdde4b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KCIWmolt'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[19efa78c-1f6f-4ef4-920d-1c441ef64abb]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfd4d0c-f7b3-40c6-aa20-d049903221ef]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:46 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:46 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:37:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:46 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:46 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:37:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e277c7d-62b4-4d19-96ff-3e55a05293ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260]
Nov 30 12:37:46 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260] successful.
Nov 30 12:37:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[283c49a6-c871-42d9-af32-eee590afac0c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5df85c-0724-41cf-b11b-d6461d43c074]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:47 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:47 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:37:47 user nova-compute[75672]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:37:47 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:47 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:47 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:37:47 user nova-compute[75672]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:37:47 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.035s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ac316c-05e2-4da8-9894-cd7e742c93dc]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCIWmolt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-0d883bcd-c88e-4156-9f27-030de0393fdf req-02959b4d-8b90-4461-982c-a92028456865 service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received event network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0d883bcd-c88e-4156-9f27-030de0393fdf req-02959b4d-8b90-4461-982c-a92028456865 service nova] Acquiring lock "3df9c388-08c6-4153-9666-8e492acda60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0d883bcd-c88e-4156-9f27-030de0393fdf req-02959b4d-8b90-4461-982c-a92028456865 service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0d883bcd-c88e-4156-9f27-030de0393fdf req-02959b4d-8b90-4461-982c-a92028456865 service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-0d883bcd-c88e-4156-9f27-030de0393fdf req-02959b4d-8b90-4461-982c-a92028456865 service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] No waiting events found dispatching network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:37:47 user nova-compute[75672]: WARNING nova.compute.manager [req-0d883bcd-c88e-4156-9f27-030de0393fdf req-02959b4d-8b90-4461-982c-a92028456865 service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received unexpected event network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 for instance with vm_state building and task_state spawning.
Nov 30 12:37:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:37:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:37:47 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Instance spawned successfully.
Nov 30 12:37:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26464343665626335', 'path': '/dev/sde'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464343665626335', 'path': '/dev/sde'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG nova.objects.instance [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lazy-loading 'flavor' on Instance uuid 3338ed96-33ff-45e6-b3da-05fbb242a3a9 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:37:48 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:37:48 user nova-compute[75672]:   <source dev="/dev/sde"/>
Nov 30 12:37:48 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:37:48 user nova-compute[75672]:   <serial>c675a5ae-91ed-48ce-a295-2f20fe60b721</serial>
Nov 30 12:37:48 user nova-compute[75672]: </disk>
Nov 30 12:37:48 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:37:48 user nova-compute[75672]: INFO nova.compute.manager [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Took 6.78 seconds to spawn the instance on the hypervisor.
Nov 30 12:37:48 user nova-compute[75672]: DEBUG nova.compute.manager [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:37:48 user nova-compute[75672]: INFO nova.compute.manager [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Took 19.52 seconds to build instance.
Nov 30 12:37:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-875e53e5-d8c4-462b-b73e-948b6fdfcb23 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "3df9c388-08c6-4153-9666-8e492acda60c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.630s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "3df9c388-08c6-4153-9666-8e492acda60c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.530s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:48 user nova-compute[75672]: INFO nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 30 12:37:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "3df9c388-08c6-4153-9666-8e492acda60c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] No VIF found with MAC fa:16:3e:57:20:54, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-58c20caa-e5f0-45f6-af54-ea71b4e6dc9e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.643s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.961s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:50 user nova-compute[75672]: INFO nova.compute.manager [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Rebuilding instance
Nov 30 12:37:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:37:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:50 user nova-compute[75672]: DEBUG nova.compute.manager [req-526b9883-e7d3-457e-9bfb-01dd2ac36447 req-9e099f48-bbab-42f9-86b6-2fa86cf2461c service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received event network-vif-unplugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-526b9883-e7d3-457e-9bfb-01dd2ac36447 req-9e099f48-bbab-42f9-86b6-2fa86cf2461c service nova] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-526b9883-e7d3-457e-9bfb-01dd2ac36447 req-9e099f48-bbab-42f9-86b6-2fa86cf2461c service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-526b9883-e7d3-457e-9bfb-01dd2ac36447 req-9e099f48-bbab-42f9-86b6-2fa86cf2461c service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:50 user nova-compute[75672]: DEBUG nova.compute.manager [req-526b9883-e7d3-457e-9bfb-01dd2ac36447 req-9e099f48-bbab-42f9-86b6-2fa86cf2461c service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] No waiting events found dispatching network-vif-unplugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:37:50 user nova-compute[75672]: WARNING nova.compute.manager [req-526b9883-e7d3-457e-9bfb-01dd2ac36447 req-9e099f48-bbab-42f9-86b6-2fa86cf2461c service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received unexpected event network-vif-unplugged-e6b0f7c3-fddc-4725-991e-7155b341322e for instance with vm_state active and task_state rebuilding.
Nov 30 12:37:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:51 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Instance destroyed successfully.
Nov 30 12:37:51 user nova-compute[75672]: INFO nova.compute.manager [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Detaching volume c675a5ae-91ed-48ce-a295-2f20fe60b721
Nov 30 12:37:51 user nova-compute[75672]: INFO nova.virt.block_device [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Attempting to driver detach volume c675a5ae-91ed-48ce-a295-2f20fe60b721 from mountpoint /dev/vdb
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Attempting to detach device vdb from instance 3338ed96-33ff-45e6-b3da-05fbb242a3a9 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:37:51 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:37:51 user nova-compute[75672]:   <source dev="/dev/sde"/>
Nov 30 12:37:51 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:37:51 user nova-compute[75672]:   <serial>c675a5ae-91ed-48ce-a295-2f20fe60b721</serial>
Nov 30 12:37:51 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:37:51 user nova-compute[75672]: </disk>
Nov 30 12:37:51 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:37:51 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Successfully detached device vdb from instance 3338ed96-33ff-45e6-b3da-05fbb242a3a9 from the persistent domain config.
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCIWmolt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:37:51 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 12:37:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a04aa1e-36b3-4f0b-9779-04a9f40ec48c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:37:51 user nova-compute[75672]: No targets found.
Nov 30 12:37:51 user nova-compute[75672]: iSNS:
Nov 30 12:37:51 user nova-compute[75672]: No targets found.
Nov 30 12:37:51 user nova-compute[75672]: STATIC:
Nov 30 12:37:51 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:37:51 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:37:51 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:37:51 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224
Nov 30 12:37:51 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:37:51 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:37:51 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721
Nov 30 12:37:51 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:37:51 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:37:51 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7
Nov 30 12:37:51 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:37:51 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:37:51 user nova-compute[75672]: FIRMWARE:
Nov 30 12:37:51 user nova-compute[75672]: No targets found.
Nov 30 12:37:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:37:51 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:37:51 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5422153-9a80-4635-82a0-394447f1ba22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d288ff-3fec-4ef1-a864-d53a2cd7cadf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:51 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:51 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:37:51 user nova-compute[75672]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:37:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:51 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:51 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:37:51 user nova-compute[75672]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:37:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcf458e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721'): ({'sde'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Removing single pathed devices sde {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e883f764-8e2b-4087-b915-32e36bce7082]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa75109f-c51d-413a-9e5f-0f83b4f8aa70]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Flushing IO for device /dev/sde {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1cae02-2c72-422f-acaa-059a34a4f410]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:37:51 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Creating image(s)
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Ensure instance console log exists: /opt/stack/data/nova/instances/33acdb4c-16f6-4873-9af8-6297cbfda1c1/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Start _get_guest_xml network_info=[{"id": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "address": "fa:16:3e:83:62:dc", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ba46ba-f0", "ovs_interfaceid": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'f94e82f8-86e7-4ba0-9af4-bb26a2d9eb28', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUaTYJEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '33acdb4c-16f6-4873-9af8-6297cbfda1c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc273595-e59e-4674-a96a-d1fb5628fc74', 'serial': 'dc273595-e59e-4674-a96a-d1fb5628fc74'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:37:51 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:37:51 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:37:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUaTYJEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:37:52 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8431fa-f0f2-412e-bcfe-6f7091d04331]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] SCSI volumes sde have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8436e39-78ea-416b-a5af-a7354698d3e7]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa9da61-bd21-45bd-801e-d8fa3ceeffbb]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260]
Nov 30 12:37:52 user nova-compute[75672]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260] successful.
Nov 30 12:37:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1f868b-b1aa-4222-8d76-13a79aec1309]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] <== disconnect_volume: return (373ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.141s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:37:52 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:37:52 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4160b0d9-9ca2-4a0c-a3e0-798b09c153f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:37:52 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8e0dae-ab94-4a1a-a36a-5aaf6966989e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74] added
Nov 30 12:37:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[846c576d-7a9b-428d-a2a9-4862a6d46bed]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3488ad9-e6ea-42c3-be2e-1ca6cc4adf5e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DUaTYJEQ {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DUaTYJEQ" returned: 0 in 0.031s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c078a1c-c4b7-48cc-8da4-8d2e36a563c7]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DUaTYJEQ'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[62876eee-2fa7-4d28-a146-e9928cd3981e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cedaeec-3862-4a1f-9e05-85640e3425f5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:52 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:52 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:37:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:52 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:52 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:37:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a52b26-caf0-46d4-92c7-400e12fe4226]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74, portal: 172.16.0.220,3260]
Nov 30 12:37:52 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74, portal: 172.16.0.220,3260] successful.
Nov 30 12:37:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a813a7-72b6-4f5c-9a2a-c92a64d6145e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6491b7ff-7fae-40ea-bad3-382420f5781b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:52 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:52 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:37:52 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:37:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:52 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:52 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:37:52 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:37:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5821a6b3-9d5f-4972-86c9-0f56e37b4a3e]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:37:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUaTYJEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:37:53 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Instance destroyed successfully.
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1391619292',display_name='tempest-ServerActionsTestOtherA-server-826538143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1391619292',id=16,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT+FpkNSPv7BTuQ0cGiU6Rv4YtX1ZWV5lv1HhpDo1sUC2n4QhYREUMjOJX6ptwW8wmUBY31zFAipq19+jfVo+chxFhdwghv2LqDjZfmlGZs/5ZFvO1nsasH0J73l3NYfQ==',key_name='tempest-keypair-21714305',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-40qany06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:37:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=3338ed96-33ff-45e6-b3da-05fbb242a3a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:20:54,bridge_name='br-int',has_traffic_filtering=True,id=e6b0f7c3-fddc-4725-991e-7155b341322e,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b0f7c3-fd') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_vif [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:20:54,bridge_name='br-int',has_traffic_filtering=True,id=e6b0f7c3-fddc-4725-991e-7155b341322e,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b0f7c3-fd') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6b0f7c3-fd, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=accf239c-a2d8-4cb9-b0f8-64bb965bbf68) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-e5e0109e-4288-4f5f-8cac-e735529e265d req-bf6aed4b-910f-4f05-8cc1-1e31264ae1a3 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received event network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e5e0109e-4288-4f5f-8cac-e735529e265d req-bf6aed4b-910f-4f05-8cc1-1e31264ae1a3 service nova] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e5e0109e-4288-4f5f-8cac-e735529e265d req-bf6aed4b-910f-4f05-8cc1-1e31264ae1a3 service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e5e0109e-4288-4f5f-8cac-e735529e265d req-bf6aed4b-910f-4f05-8cc1-1e31264ae1a3 service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-e5e0109e-4288-4f5f-8cac-e735529e265d req-bf6aed4b-910f-4f05-8cc1-1e31264ae1a3 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] No waiting events found dispatching network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:37:53 user nova-compute[75672]: WARNING nova.compute.manager [req-e5e0109e-4288-4f5f-8cac-e735529e265d req-bf6aed4b-910f-4f05-8cc1-1e31264ae1a3 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received unexpected event network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e for instance with vm_state active and task_state rebuilding.
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:37:53 user nova-compute[75672]: INFO os_vif [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:20:54,bridge_name='br-int',has_traffic_filtering=True,id=e6b0f7c3-fddc-4725-991e-7155b341322e,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b0f7c3-fd')
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCIWmolt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:37:53 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '26138626161316536', 'path': '/dev/sde'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138626161316536', 'path': '/dev/sde'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.445s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1277170596',display_name='tempest-TestVolumeBootPattern-server-1277170596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1277170596',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-8jb7dkaj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:37:34Z,user_data=None,user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=33acdb4c-16f6-4873-9af8-6297cbfda1c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "address": "fa:16:3e:83:62:dc", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ba46ba-f0", "ovs_interfaceid": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "address": "fa:16:3e:83:62:dc", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ba46ba-f0", "ovs_interfaceid": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:62:dc,bridge_name='br-int',has_traffic_filtering=True,id=31ba46ba-f0ae-40d4-ac4b-7914275839bb,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ba46ba-f0') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.objects.instance [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lazy-loading 'pci_devices' on Instance uuid 33acdb4c-16f6-4873-9af8-6297cbfda1c1 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7eece3-56fc-4ea1-8153-51dc457153f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:37:53 user nova-compute[75672]: No targets found.
Nov 30 12:37:53 user nova-compute[75672]: iSNS:
Nov 30 12:37:53 user nova-compute[75672]: No targets found.
Nov 30 12:37:53 user nova-compute[75672]: STATIC:
Nov 30 12:37:53 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:37:53 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:37:53 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:37:53 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74
Nov 30 12:37:53 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:37:53 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:37:53 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224
Nov 30 12:37:53 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:37:53 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:37:53 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7
Nov 30 12:37:53 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:37:53 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:37:53 user nova-compute[75672]: FIRMWARE:
Nov 30 12:37:53 user nova-compute[75672]: No targets found.
Nov 30 12:37:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:37:53 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:37:53 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:37:53 user nova-compute[75672]:   <uuid>33acdb4c-16f6-4873-9af8-6297cbfda1c1</uuid>
Nov 30 12:37:53 user nova-compute[75672]:   <name>instance-00000014</name>
Nov 30 12:37:53 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:37:53 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:37:53 user nova-compute[75672]:   <metadata>
Nov 30 12:37:53 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:37:53 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:37:53 user nova-compute[75672]:       <nova:name>tempest-TestVolumeBootPattern-server-1277170596</nova:name>
Nov 30 12:37:53 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:37:51</nova:creationTime>
Nov 30 12:37:53 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:37:53 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:37:53 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:37:53 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:37:53 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:37:53 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:37:53 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:37:53 user nova-compute[75672]:       <nova:owner>
Nov 30 12:37:53 user nova-compute[75672]:         <nova:user uuid="924cf8ff73154f8fadb371175a0d8fc4">tempest-TestVolumeBootPattern-1743139468-project-member</nova:user>
Nov 30 12:37:53 user nova-compute[75672]:         <nova:project uuid="513644b3a140400dbdf6b07e8e727dd4">tempest-TestVolumeBootPattern-1743139468</nova:project>
Nov 30 12:37:53 user nova-compute[75672]:       </nova:owner>
Nov 30 12:37:53 user nova-compute[75672]:       <nova:ports>
Nov 30 12:37:53 user nova-compute[75672]:         <nova:port uuid="31ba46ba-f0ae-40d4-ac4b-7914275839bb">
Nov 30 12:37:53 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 12:37:53 user nova-compute[75672]:         </nova:port>
Nov 30 12:37:53 user nova-compute[75672]:       </nova:ports>
Nov 30 12:37:53 user nova-compute[75672]:     </nova:instance>
Nov 30 12:37:53 user nova-compute[75672]:   </metadata>
Nov 30 12:37:53 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:37:53 user nova-compute[75672]:     <system>
Nov 30 12:37:53 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:37:53 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:37:53 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:37:53 user nova-compute[75672]:       <entry name="serial">33acdb4c-16f6-4873-9af8-6297cbfda1c1</entry>
Nov 30 12:37:53 user nova-compute[75672]:       <entry name="uuid">33acdb4c-16f6-4873-9af8-6297cbfda1c1</entry>
Nov 30 12:37:53 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:37:53 user nova-compute[75672]:     </system>
Nov 30 12:37:53 user nova-compute[75672]:   </sysinfo>
Nov 30 12:37:53 user nova-compute[75672]:   <os>
Nov 30 12:37:53 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:37:53 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:37:53 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:37:53 user nova-compute[75672]:   </os>
Nov 30 12:37:53 user nova-compute[75672]:   <features>
Nov 30 12:37:53 user nova-compute[75672]:     <acpi/>
Nov 30 12:37:53 user nova-compute[75672]:     <apic/>
Nov 30 12:37:53 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:37:53 user nova-compute[75672]:   </features>
Nov 30 12:37:53 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:37:53 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:37:53 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:37:53 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:37:53 user nova-compute[75672]:   </clock>
Nov 30 12:37:53 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:37:53 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:37:53 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:37:53 user nova-compute[75672]:   </cpu>
Nov 30 12:37:53 user nova-compute[75672]:   <devices>
Nov 30 12:37:53 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:37:53 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:37:53 user nova-compute[75672]:       <source dev="/dev/sde"/>
Nov 30 12:37:53 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:37:53 user nova-compute[75672]:       <serial>dc273595-e59e-4674-a96a-d1fb5628fc74</serial>
Nov 30 12:37:53 user nova-compute[75672]:     </disk>
Nov 30 12:37:53 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:37:53 user nova-compute[75672]:       <mac address="fa:16:3e:83:62:dc"/>
Nov 30 12:37:53 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:37:53 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:37:53 user nova-compute[75672]:       <target dev="tap31ba46ba-f0"/>
Nov 30 12:37:53 user nova-compute[75672]:     </interface>
Nov 30 12:37:53 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:37:53 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/33acdb4c-16f6-4873-9af8-6297cbfda1c1/console.log" append="off"/>
Nov 30 12:37:53 user nova-compute[75672]:     </serial>
Nov 30 12:37:53 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:37:53 user nova-compute[75672]:     <video>
Nov 30 12:37:53 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:37:53 user nova-compute[75672]:     </video>
Nov 30 12:37:53 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:37:53 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:37:53 user nova-compute[75672]:     </rng>
Nov 30 12:37:53 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:37:53 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:37:53 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:37:53 user nova-compute[75672]:     </memballoon>
Nov 30 12:37:53 user nova-compute[75672]:   </devices>
Nov 30 12:37:53 user nova-compute[75672]: </domain>
Nov 30 12:37:53 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1277170596',display_name='tempest-TestVolumeBootPattern-server-1277170596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1277170596',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-8jb7dkaj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:37:34Z,user_data=None,user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=33acdb4c-16f6-4873-9af8-6297cbfda1c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "address": "fa:16:3e:83:62:dc", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ba46ba-f0", "ovs_interfaceid": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "address": "fa:16:3e:83:62:dc", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ba46ba-f0", "ovs_interfaceid": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:62:dc,bridge_name='br-int',has_traffic_filtering=True,id=31ba46ba-f0ae-40d4-ac4b-7914275839bb,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ba46ba-f0') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_vif [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:62:dc,bridge_name='br-int',has_traffic_filtering=True,id=31ba46ba-f0ae-40d4-ac4b-7914275839bb,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ba46ba-f0') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe066dc3-68c0-5aff-844d-77dc851fa62e', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fb98d6-3296-4f5e-837b-97fa14e71467]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31ba46ba-f0, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31ba46ba-f0, col_values=(('qos', UUID('838c58b6-d0ec-415d-b6b0-3d0031b97e3a')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31ba46ba-f0, col_values=(('external_ids', {'iface-id': '31ba46ba-f0ae-40d4-ac4b-7914275839bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:62:dc', 'vm-uuid': '33acdb4c-16f6-4873-9af8-6297cbfda1c1'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:53 user nova-compute[75672]: INFO os_vif [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:62:dc,bridge_name='br-int',has_traffic_filtering=True,id=31ba46ba-f0ae-40d4-ac4b-7914275839bb,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ba46ba-f0')
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fdaf11-18df-4405-8b9a-d7f464aafc67]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:53 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:53 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:37:53 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:37:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:37:53 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:37:53 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:37:53 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:37:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd42bd1b0>, {}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Disconnecting from: [] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.094s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] <== disconnect_volume: return (539ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:37:53 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Deleting instance files /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9_del
Nov 30 12:37:53 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Deletion of /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9_del complete
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] No VIF found with MAC fa:16:3e:83:62:dc, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:37:53 user nova-compute[75672]: INFO nova.virt.block_device [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Booting with volume c675a5ae-91ed-48ce-a295-2f20fe60b721 at /dev/vdb
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.utils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ee4fa2-caf3-496d-99c7-a70d7127570d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[88396b9d-0956-4e44-8a31-0c52b01b9416]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3ce3a0-d5c0-4d0e-bba4-e66bfc394d1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd22db2-03f3-49a3-b2b7-f7e0f0de1945]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:37:53 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:37:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35f194b-41e8-4691-846b-1172f4b6b01b]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG os_brick.utils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:37:53 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Updating existing volume attachment record: eaefe43a-7c5a-44ac-b77c-ec463c749f85 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:37:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-1d9f913a-1d7b-4779-89c0-4348729305ee req-3ef0b3bf-1190-4457-96c8-b64e3145c75f service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Received event network-vif-plugged-31ba46ba-f0ae-40d4-ac4b-7914275839bb {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1d9f913a-1d7b-4779-89c0-4348729305ee req-3ef0b3bf-1190-4457-96c8-b64e3145c75f service nova] Acquiring lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1d9f913a-1d7b-4779-89c0-4348729305ee req-3ef0b3bf-1190-4457-96c8-b64e3145c75f service nova] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1d9f913a-1d7b-4779-89c0-4348729305ee req-3ef0b3bf-1190-4457-96c8-b64e3145c75f service nova] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-1d9f913a-1d7b-4779-89c0-4348729305ee req-3ef0b3bf-1190-4457-96c8-b64e3145c75f service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] No waiting events found dispatching network-vif-plugged-31ba46ba-f0ae-40d4-ac4b-7914275839bb {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:37:55 user nova-compute[75672]: WARNING nova.compute.manager [req-1d9f913a-1d7b-4779-89c0-4348729305ee req-3ef0b3bf-1190-4457-96c8-b64e3145c75f service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Received unexpected event network-vif-plugged-31ba46ba-f0ae-40d4-ac4b-7914275839bb for instance with vm_state building and task_state spawning.
Nov 30 12:37:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:57 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:37:57 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:37:57 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Instance spawned successfully.
Nov 30 12:37:57 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:37:57 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:57 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:57 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:57 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:57 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:57 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:37:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-033ab805-5ba5-4fec-aae4-95106aedd707 req-ee32063e-910e-4b73-a908-8df1a996e99f service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Received event network-vif-plugged-31ba46ba-f0ae-40d4-ac4b-7914275839bb {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:37:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-033ab805-5ba5-4fec-aae4-95106aedd707 req-ee32063e-910e-4b73-a908-8df1a996e99f service nova] Acquiring lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-033ab805-5ba5-4fec-aae4-95106aedd707 req-ee32063e-910e-4b73-a908-8df1a996e99f service nova] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-033ab805-5ba5-4fec-aae4-95106aedd707 req-ee32063e-910e-4b73-a908-8df1a996e99f service nova] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-033ab805-5ba5-4fec-aae4-95106aedd707 req-ee32063e-910e-4b73-a908-8df1a996e99f service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] No waiting events found dispatching network-vif-plugged-31ba46ba-f0ae-40d4-ac4b-7914275839bb {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:37:57 user nova-compute[75672]: WARNING nova.compute.manager [req-033ab805-5ba5-4fec-aae4-95106aedd707 req-ee32063e-910e-4b73-a908-8df1a996e99f service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Received unexpected event network-vif-plugged-31ba46ba-f0ae-40d4-ac4b-7914275839bb for instance with vm_state building and task_state spawning.
Nov 30 12:37:57 user nova-compute[75672]: INFO nova.compute.manager [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 30 12:37:57 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:37:57 user nova-compute[75672]: INFO nova.compute.manager [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Took 23.97 seconds to build instance.
Nov 30 12:37:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3e0a6e5b-8b41-4f9b-9784-58b7d2501077 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.111s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.868s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:57 user nova-compute[75672]: INFO nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 30 12:37:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:37:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "85f7c21c-b973-422f-a10c-8fb3635879f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:37:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:37:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:37:59 user nova-compute[75672]: INFO nova.compute.manager [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Terminating instance
Nov 30 12:37:59 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-93153772-c0a5-4c0b-9268-3d0e6c43402e req-8b352443-4894-4147-825d-0bf517a5d726 service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Received event network-vif-unplugged-f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-93153772-c0a5-4c0b-9268-3d0e6c43402e req-8b352443-4894-4147-825d-0bf517a5d726 service nova] Acquiring lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-93153772-c0a5-4c0b-9268-3d0e6c43402e req-8b352443-4894-4147-825d-0bf517a5d726 service nova] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-93153772-c0a5-4c0b-9268-3d0e6c43402e req-8b352443-4894-4147-825d-0bf517a5d726 service nova] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-93153772-c0a5-4c0b-9268-3d0e6c43402e req-8b352443-4894-4147-825d-0bf517a5d726 service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] No waiting events found dispatching network-vif-unplugged-f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-93153772-c0a5-4c0b-9268-3d0e6c43402e req-8b352443-4894-4147-825d-0bf517a5d726 service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Received event network-vif-unplugged-f63d8e51-e821-4448-8d86-ca8c90e5b382 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:38:00 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Instance destroyed successfully.
Nov 30 12:38:00 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lazy-loading 'resources' on Instance uuid 85f7c21c-b973-422f-a10c-8fb3635879f4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:32:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2017965800',display_name='tempest-VolumesAdminNegativeTest-server-2017965800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2017965800',id=6,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJcH0gwFEstePdALiSy5UkA0+LOFQRY4qNejpbiYXyUscDIJ9YMWhj3yiIg+yn0y6hAhSZZOLs+RONnzFb8f2L1ZMq5BSRQlnwb3C9j7oRtDbh9hs5UoQlW2TklkcH1mQ==',key_name='tempest-keypair-216264897',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36a602a0e3614e5bafc9d70e26368f66',ramdisk_id='',reservation_id='r-n1kmxc0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1737879306',owner_user_name='tempest-VolumesAdminNegativeTest-1737879306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fe27c1bb48c454082be1109311db96f',uuid=85f7c21c-b973-422f-a10c-8fb3635879f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "address": "fa:16:3e:30:a9:02", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63d8e51-e8", "ovs_interfaceid": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Converting VIF {"id": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "address": "fa:16:3e:30:a9:02", "network": {"id": "6c45d0f0-6bba-476f-8c7b-83f86f13ff55", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-24044600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a602a0e3614e5bafc9d70e26368f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63d8e51-e8", "ovs_interfaceid": "f63d8e51-e821-4448-8d86-ca8c90e5b382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:a9:02,bridge_name='br-int',has_traffic_filtering=True,id=f63d8e51-e821-4448-8d86-ca8c90e5b382,network=Network(6c45d0f0-6bba-476f-8c7b-83f86f13ff55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63d8e51-e8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG os_vif [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:a9:02,bridge_name='br-int',has_traffic_filtering=True,id=f63d8e51-e821-4448-8d86-ca8c90e5b382,network=Network(6c45d0f0-6bba-476f-8c7b-83f86f13ff55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63d8e51-e8') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf63d8e51-e8, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3de297b0-269d-4624-8062-2287c4a4b899) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:00 user nova-compute[75672]: INFO os_vif [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:a9:02,bridge_name='br-int',has_traffic_filtering=True,id=f63d8e51-e821-4448-8d86-ca8c90e5b382,network=Network(6c45d0f0-6bba-476f-8c7b-83f86f13ff55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63d8e51-e8')
Nov 30 12:38:00 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Deleting instance files /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4_del
Nov 30 12:38:00 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Deletion of /opt/stack/data/nova/instances/85f7c21c-b973-422f-a10c-8fb3635879f4_del complete
Nov 30 12:38:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:00 user nova-compute[75672]: INFO nova.compute.manager [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 30 12:38:00 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:38:00 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:38:01 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:38:01 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Took 0.95 seconds to deallocate network for instance.
Nov 30 12:38:01 user nova-compute[75672]: DEBUG nova.compute.manager [req-0967424a-9107-4054-b4be-5920fa0dd550 req-039b9941-f26b-4f5e-80af-ece38ee799c6 service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Received event network-vif-deleted-f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:02 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Deleted allocations for instance 85f7c21c-b973-422f-a10c-8fb3635879f4
Nov 30 12:38:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-aceafaf3-6d12-4e57-82df-496ef883b587 req-5eaeefe0-0b16-48ac-ada5-63e7d84d78e3 service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Received event network-vif-plugged-f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-aceafaf3-6d12-4e57-82df-496ef883b587 req-5eaeefe0-0b16-48ac-ada5-63e7d84d78e3 service nova] Acquiring lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-aceafaf3-6d12-4e57-82df-496ef883b587 req-5eaeefe0-0b16-48ac-ada5-63e7d84d78e3 service nova] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-aceafaf3-6d12-4e57-82df-496ef883b587 req-5eaeefe0-0b16-48ac-ada5-63e7d84d78e3 service nova] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-aceafaf3-6d12-4e57-82df-496ef883b587 req-5eaeefe0-0b16-48ac-ada5-63e7d84d78e3 service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] No waiting events found dispatching network-vif-plugged-f63d8e51-e821-4448-8d86-ca8c90e5b382 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:38:02 user nova-compute[75672]: WARNING nova.compute.manager [req-aceafaf3-6d12-4e57-82df-496ef883b587 req-5eaeefe0-0b16-48ac-ada5-63e7d84d78e3 service nova] [instance: 85f7c21c-b973-422f-a10c-8fb3635879f4] Received unexpected event network-vif-plugged-f63d8e51-e821-4448-8d86-ca8c90e5b382 for instance with vm_state deleted and task_state None.
Nov 30 12:38:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d3362327-eb21-4e36-9d5c-2f0f0732a79b tempest-VolumesAdminNegativeTest-1737879306 tempest-VolumesAdminNegativeTest-1737879306-project-member] Lock "85f7c21c-b973-422f-a10c-8fb3635879f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.503s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:02 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1fba8af1-8074-4ce8-be23-912e9850fc41 is timed out.
Nov 30 12:38:02 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Successfully detached device vdb from instance 1fba8af1-8074-4ce8-be23-912e9850fc41 from the live domain config.
Nov 30 12:38:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKkbRgPw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:38:02 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:38:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a408c480-2880-412d-b01e-55927e613ec0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:38:02 user nova-compute[75672]: No targets found.
Nov 30 12:38:02 user nova-compute[75672]: iSNS:
Nov 30 12:38:02 user nova-compute[75672]: No targets found.
Nov 30 12:38:02 user nova-compute[75672]: STATIC:
Nov 30 12:38:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93
Nov 30 12:38:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:38:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:38:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74
Nov 30 12:38:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:38:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:38:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224
Nov 30 12:38:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:38:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:38:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7
Nov 30 12:38:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:38:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:38:02 user nova-compute[75672]: FIRMWARE:
Nov 30 12:38:02 user nova-compute[75672]: No targets found.
Nov 30 12:38:02 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:38:02 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:38:02 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ed6682-5b8b-41f3-9917-2613bfe3fa54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f9b970-7893-45b1-afe9-acb84048b236]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:38:02 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:38:02 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:38:02 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:38:02 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:38:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 (non-flash)
Nov 30 12:38:02 user nova-compute[75672]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:38:02 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:38:02 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:38:02 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd4297880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3344ae-6040-488a-a263-7f232a160799]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6d6956-3a8e-44a7-974d-a30f8cbb70b6]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d07c0f5-429c-4cdd-865b-7ebf1f6b342c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2a011c-7f21-4d95-995a-583e3388722a]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea66d3c-0921-456e-8e08-5ebcf1116164]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09a6f86-2d99-4ea1-b2b0-92b2533f4a09]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260]
Nov 30 12:38:03 user nova-compute[75672]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93, portal: 172.16.0.220,3260] successful.
Nov 30 12:38:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f5b089-e352-4270-b369-e79ce8349e93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.057s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[79991f12-672a-49ac-b5a8-b2967ee2ba9c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] <== disconnect_volume: return (386ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:38:03 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:38:04 user nova-compute[75672]: DEBUG nova.objects.instance [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'flavor' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:38:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a349410-473d-4f77-a6b0-05f3e0786251 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.972s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.465s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8d5cb48f-bf2d-41ab-9c3e-753bb46d665c tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8d5cb48f-bf2d-41ab-9c3e-753bb46d665c tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8d5cb48f-bf2d-41ab-9c3e-753bb46d665c tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8d5cb48f-bf2d-41ab-9c3e-753bb46d665c tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75672) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG nova.objects.instance [None req-8d5cb48f-bf2d-41ab-9c3e-753bb46d665c tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'flavor' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:38:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Creating image(s)
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "/opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "/opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "/opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.170s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-7335606d-ebcc-43d2-8b5e-8ac8e10e5532 req-ba2fb64f-3a8a-4643-8bf5-264291d17b9e service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-unplugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7335606d-ebcc-43d2-8b5e-8ac8e10e5532 req-ba2fb64f-3a8a-4643-8bf5-264291d17b9e service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7335606d-ebcc-43d2-8b5e-8ac8e10e5532 req-ba2fb64f-3a8a-4643-8bf5-264291d17b9e service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7335606d-ebcc-43d2-8b5e-8ac8e10e5532 req-ba2fb64f-3a8a-4643-8bf5-264291d17b9e service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-7335606d-ebcc-43d2-8b5e-8ac8e10e5532 req-ba2fb64f-3a8a-4643-8bf5-264291d17b9e service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-unplugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:38:05 user nova-compute[75672]: WARNING nova.compute.manager [req-7335606d-ebcc-43d2-8b5e-8ac8e10e5532 req-ba2fb64f-3a8a-4643-8bf5-264291d17b9e service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-unplugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state active and task_state powering-off.
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.187s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk 1073741824" returned: 0 in 0.053s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Instance destroyed successfully.
Nov 30 12:38:05 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8d5cb48f-bf2d-41ab-9c3e-753bb46d665c tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.202s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8d5cb48f-bf2d-41ab-9c3e-753bb46d665c tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.965s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Cannot resize image /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Ensure instance console log exists: /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Start _get_guest_xml network_info=[{"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'eaefe43a-7c5a-44ac-b77c-ec463c749f85', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCIWmolt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3338ed96-33ff-45e6-b3da-05fbb242a3a9', 'attached_at': '', 'detached_at': '', 'volume_id': 'c675a5ae-91ed-48ce-a295-2f20fe60b721', 'serial': 'c675a5ae-91ed-48ce-a295-2f20fe60b721'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:38:06 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 12:38:06 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.objects.instance [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3338ed96-33ff-45e6-b3da-05fbb242a3a9 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCIWmolt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:38:06 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:38:06 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:38:06 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e46737a-9447-4af4-b51d-b258dd140e96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:38:06 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[08be534a-1e4c-40aa-a65c-7c3305e1a9ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721] added
Nov 30 12:38:06 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa980fb5-3301-4b39-9006-e1aa9a84cfe0]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[155dc6d9-9fec-4155-a0a0-2f18a62c421b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCIWmolt {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCIWmolt" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2647cb-61b9-467c-9cb9-48d36bed9605]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KCIWmolt'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8334ae5-d07e-411a-b586-1dffbc4546e2]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df63ee9-cbd8-49eb-8274-8f3c6896d53f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:38:06 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:38:06 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:38:06 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:38:06 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:38:06 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:38:06 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e91ce9a-73c8-4083-b524-bd4e8e3be3d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260]
Nov 30 12:38:06 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260] successful.
Nov 30 12:38:06 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92c4b76-3538-420c-9946-b6fd0ea35d82]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e704e211-62e1-4bde-968d-a6b8b07826f9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:38:06 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:38:06 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:38:06 user nova-compute[75672]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:38:06 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:38:06 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:38:06 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:38:06 user nova-compute[75672]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:38:06 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a574df3-158e-4450-8c9d-39c0234442ce]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:38:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCIWmolt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26464343665626335', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464343665626335', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-607a9c5a-ee77-4896-8eed-e4cf96601cbc req-683511e5-e46a-4b55-a15e-0806d04dc875 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-607a9c5a-ee77-4896-8eed-e4cf96601cbc req-683511e5-e46a-4b55-a15e-0806d04dc875 service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-607a9c5a-ee77-4896-8eed-e4cf96601cbc req-683511e5-e46a-4b55-a15e-0806d04dc875 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-607a9c5a-ee77-4896-8eed-e4cf96601cbc req-683511e5-e46a-4b55-a15e-0806d04dc875 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-607a9c5a-ee77-4896-8eed-e4cf96601cbc req-683511e5-e46a-4b55-a15e-0806d04dc875 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:38:07 user nova-compute[75672]: WARNING nova.compute.manager [req-607a9c5a-ee77-4896-8eed-e4cf96601cbc req-683511e5-e46a-4b55-a15e-0806d04dc875 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state stopped and task_state None.
Nov 30 12:38:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T12:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1391619292',display_name='tempest-ServerActionsTestOtherA-server-826538143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1391619292',id=16,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT+FpkNSPv7BTuQ0cGiU6Rv4YtX1ZWV5lv1HhpDo1sUC2n4QhYREUMjOJX6ptwW8wmUBY31zFAipq19+jfVo+chxFhdwghv2LqDjZfmlGZs/5ZFvO1nsasH0J73l3NYfQ==',key_name='tempest-keypair-21714305',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-40qany06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=3338ed96-33ff-45e6-b3da-05fbb242a3a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:20:54,bridge_name='br-int',has_traffic_filtering=True,id=e6b0f7c3-fddc-4725-991e-7155b341322e,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b0f7c3-fd') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:38:07 user nova-compute[75672]:   <uuid>3338ed96-33ff-45e6-b3da-05fbb242a3a9</uuid>
Nov 30 12:38:07 user nova-compute[75672]:   <name>instance-00000010</name>
Nov 30 12:38:07 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:38:07 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:38:07 user nova-compute[75672]:   <metadata>
Nov 30 12:38:07 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:38:07 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:38:07 user nova-compute[75672]:       <nova:name>tempest-ServerActionsTestOtherA-server-826538143</nova:name>
Nov 30 12:38:07 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:38:06</nova:creationTime>
Nov 30 12:38:07 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:38:07 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:38:07 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:38:07 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:38:07 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:38:07 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:38:07 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:38:07 user nova-compute[75672]:       <nova:owner>
Nov 30 12:38:07 user nova-compute[75672]:         <nova:user uuid="15791a052aef4d7a9bc79c97075cbdc9">tempest-ServerActionsTestOtherA-2076465849-project-member</nova:user>
Nov 30 12:38:07 user nova-compute[75672]:         <nova:project uuid="51606113e3d1460894fdc500924cb37a">tempest-ServerActionsTestOtherA-2076465849</nova:project>
Nov 30 12:38:07 user nova-compute[75672]:       </nova:owner>
Nov 30 12:38:07 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:38:07 user nova-compute[75672]:       <nova:ports>
Nov 30 12:38:07 user nova-compute[75672]:         <nova:port uuid="e6b0f7c3-fddc-4725-991e-7155b341322e">
Nov 30 12:38:07 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 12:38:07 user nova-compute[75672]:         </nova:port>
Nov 30 12:38:07 user nova-compute[75672]:       </nova:ports>
Nov 30 12:38:07 user nova-compute[75672]:     </nova:instance>
Nov 30 12:38:07 user nova-compute[75672]:   </metadata>
Nov 30 12:38:07 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:38:07 user nova-compute[75672]:     <system>
Nov 30 12:38:07 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:38:07 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:38:07 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:38:07 user nova-compute[75672]:       <entry name="serial">3338ed96-33ff-45e6-b3da-05fbb242a3a9</entry>
Nov 30 12:38:07 user nova-compute[75672]:       <entry name="uuid">3338ed96-33ff-45e6-b3da-05fbb242a3a9</entry>
Nov 30 12:38:07 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:38:07 user nova-compute[75672]:     </system>
Nov 30 12:38:07 user nova-compute[75672]:   </sysinfo>
Nov 30 12:38:07 user nova-compute[75672]:   <os>
Nov 30 12:38:07 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:38:07 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:38:07 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:38:07 user nova-compute[75672]:   </os>
Nov 30 12:38:07 user nova-compute[75672]:   <features>
Nov 30 12:38:07 user nova-compute[75672]:     <acpi/>
Nov 30 12:38:07 user nova-compute[75672]:     <apic/>
Nov 30 12:38:07 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:38:07 user nova-compute[75672]:   </features>
Nov 30 12:38:07 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:38:07 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:38:07 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:38:07 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:38:07 user nova-compute[75672]:   </clock>
Nov 30 12:38:07 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:38:07 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:38:07 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:38:07 user nova-compute[75672]:   </cpu>
Nov 30 12:38:07 user nova-compute[75672]:   <devices>
Nov 30 12:38:07 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:38:07 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:38:07 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk"/>
Nov 30 12:38:07 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:38:07 user nova-compute[75672]:     </disk>
Nov 30 12:38:07 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:38:07 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:38:07 user nova-compute[75672]:       <source dev="/dev/sdb"/>
Nov 30 12:38:07 user nova-compute[75672]:       <target dev="vdb" bus="virtio"/>
Nov 30 12:38:07 user nova-compute[75672]:       <serial>c675a5ae-91ed-48ce-a295-2f20fe60b721</serial>
Nov 30 12:38:07 user nova-compute[75672]:     </disk>
Nov 30 12:38:07 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:38:07 user nova-compute[75672]:       <mac address="fa:16:3e:57:20:54"/>
Nov 30 12:38:07 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:38:07 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:38:07 user nova-compute[75672]:       <target dev="tape6b0f7c3-fd"/>
Nov 30 12:38:07 user nova-compute[75672]:     </interface>
Nov 30 12:38:07 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:38:07 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/console.log" append="off"/>
Nov 30 12:38:07 user nova-compute[75672]:     </serial>
Nov 30 12:38:07 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:38:07 user nova-compute[75672]:     <video>
Nov 30 12:38:07 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:38:07 user nova-compute[75672]:     </video>
Nov 30 12:38:07 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:38:07 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:38:07 user nova-compute[75672]:     </rng>
Nov 30 12:38:07 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:38:07 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:38:07 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:38:07 user nova-compute[75672]:     </memballoon>
Nov 30 12:38:07 user nova-compute[75672]:   </devices>
Nov 30 12:38:07 user nova-compute[75672]: </domain>
Nov 30 12:38:07 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T12:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1391619292',display_name='tempest-ServerActionsTestOtherA-server-826538143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1391619292',id=16,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT+FpkNSPv7BTuQ0cGiU6Rv4YtX1ZWV5lv1HhpDo1sUC2n4QhYREUMjOJX6ptwW8wmUBY31zFAipq19+jfVo+chxFhdwghv2LqDjZfmlGZs/5ZFvO1nsasH0J73l3NYfQ==',key_name='tempest-keypair-21714305',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-40qany06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=3338ed96-33ff-45e6-b3da-05fbb242a3a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:20:54,bridge_name='br-int',has_traffic_filtering=True,id=e6b0f7c3-fddc-4725-991e-7155b341322e,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b0f7c3-fd') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG os_vif [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:20:54,bridge_name='br-int',has_traffic_filtering=True,id=e6b0f7c3-fddc-4725-991e-7155b341322e,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b0f7c3-fd') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db2148c4-57c6-5216-819b-6da365435171', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6b0f7c3-fd, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6b0f7c3-fd, col_values=(('qos', UUID('a1b40e62-0788-4f8e-be85-ea302e78e0b0')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6b0f7c3-fd, col_values=(('external_ids', {'iface-id': 'e6b0f7c3-fddc-4725-991e-7155b341322e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:20:54', 'vm-uuid': '3338ed96-33ff-45e6-b3da-05fbb242a3a9'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:07 user nova-compute[75672]: INFO os_vif [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:20:54,bridge_name='br-int',has_traffic_filtering=True,id=e6b0f7c3-fddc-4725-991e-7155b341322e,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b0f7c3-fd')
Nov 30 12:38:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:38:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] No VIF found with MAC fa:16:3e:57:20:54, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:38:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-9b0b88ad-2ba7-417d-8163-159bd089be58 req-451eafef-8e25-4bf2-ae94-3d0e7b8fd457 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received event network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b0b88ad-2ba7-417d-8163-159bd089be58 req-451eafef-8e25-4bf2-ae94-3d0e7b8fd457 service nova] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b0b88ad-2ba7-417d-8163-159bd089be58 req-451eafef-8e25-4bf2-ae94-3d0e7b8fd457 service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b0b88ad-2ba7-417d-8163-159bd089be58 req-451eafef-8e25-4bf2-ae94-3d0e7b8fd457 service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-9b0b88ad-2ba7-417d-8163-159bd089be58 req-451eafef-8e25-4bf2-ae94-3d0e7b8fd457 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] No waiting events found dispatching network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:38:09 user nova-compute[75672]: WARNING nova.compute.manager [req-9b0b88ad-2ba7-417d-8163-159bd089be58 req-451eafef-8e25-4bf2-ae94-3d0e7b8fd457 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received unexpected event network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e for instance with vm_state active and task_state rebuild_spawning.
Nov 30 12:38:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-9b0b88ad-2ba7-417d-8163-159bd089be58 req-451eafef-8e25-4bf2-ae94-3d0e7b8fd457 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received event network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b0b88ad-2ba7-417d-8163-159bd089be58 req-451eafef-8e25-4bf2-ae94-3d0e7b8fd457 service nova] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b0b88ad-2ba7-417d-8163-159bd089be58 req-451eafef-8e25-4bf2-ae94-3d0e7b8fd457 service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b0b88ad-2ba7-417d-8163-159bd089be58 req-451eafef-8e25-4bf2-ae94-3d0e7b8fd457 service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-9b0b88ad-2ba7-417d-8163-159bd089be58 req-451eafef-8e25-4bf2-ae94-3d0e7b8fd457 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] No waiting events found dispatching network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:38:09 user nova-compute[75672]: WARNING nova.compute.manager [req-9b0b88ad-2ba7-417d-8163-159bd089be58 req-451eafef-8e25-4bf2-ae94-3d0e7b8fd457 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received unexpected event network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e for instance with vm_state active and task_state rebuild_spawning.
Nov 30 12:38:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:11 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:38:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:38:11 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Instance spawned successfully.
Nov 30 12:38:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:38:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:11 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:38:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:11 user nova-compute[75672]: DEBUG nova.objects.instance [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75672) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 30 12:38:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1187ef64-f972-4ca8-9513-37644d33e870 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:17 user nova-compute[75672]: INFO nova.compute.manager [None req-43de68c3-bbb2-4729-8b5b-cf2a37abd454 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Unrescuing
Nov 30 12:38:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-43de68c3-bbb2-4729-8b5b-cf2a37abd454 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:38:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-43de68c3-bbb2-4729-8b5b-cf2a37abd454 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquired lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:38:17 user nova-compute[75672]: DEBUG nova.network.neutron [None req-43de68c3-bbb2-4729-8b5b-cf2a37abd454 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:38:18 user nova-compute[75672]: DEBUG nova.network.neutron [None req-43de68c3-bbb2-4729-8b5b-cf2a37abd454 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Updating instance_info_cache with network_info: [{"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:38:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-43de68c3-bbb2-4729-8b5b-cf2a37abd454 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Releasing lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:38:18 user nova-compute[75672]: DEBUG nova.objects.instance [None req-43de68c3-bbb2-4729-8b5b-cf2a37abd454 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'flavor' on Instance uuid 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:38:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:18 user nova-compute[75672]: DEBUG nova.compute.manager [req-c5600bd8-b8d6-4645-9b06-2cf19042a9b2 req-a9020daa-070d-4c2e-818e-719bae447911 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-vif-unplugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c5600bd8-b8d6-4645-9b06-2cf19042a9b2 req-a9020daa-070d-4c2e-818e-719bae447911 service nova] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c5600bd8-b8d6-4645-9b06-2cf19042a9b2 req-a9020daa-070d-4c2e-818e-719bae447911 service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c5600bd8-b8d6-4645-9b06-2cf19042a9b2 req-a9020daa-070d-4c2e-818e-719bae447911 service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:18 user nova-compute[75672]: DEBUG nova.compute.manager [req-c5600bd8-b8d6-4645-9b06-2cf19042a9b2 req-a9020daa-070d-4c2e-818e-719bae447911 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] No waiting events found dispatching network-vif-unplugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:38:18 user nova-compute[75672]: WARNING nova.compute.manager [req-c5600bd8-b8d6-4645-9b06-2cf19042a9b2 req-a9020daa-070d-4c2e-818e-719bae447911 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received unexpected event network-vif-unplugged-fbe1de56-aab3-47e7-914b-e51e070c8679 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:38:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:19 user nova-compute[75672]: DEBUG nova.compute.manager [req-3c2dd7f0-db0d-4fbd-9ca4-ae3d62257aba req-ad91b5b8-1c56-435a-a3db-b27375195d39 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received event network-changed-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:19 user nova-compute[75672]: DEBUG nova.compute.manager [req-3c2dd7f0-db0d-4fbd-9ca4-ae3d62257aba req-ad91b5b8-1c56-435a-a3db-b27375195d39 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Refreshing instance network info cache due to event network-changed-d229eaa1-29dc-4b3f-b468-d5a8f24d7514. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:38:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c2dd7f0-db0d-4fbd-9ca4-ae3d62257aba req-ad91b5b8-1c56-435a-a3db-b27375195d39 service nova] Acquiring lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:38:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c2dd7f0-db0d-4fbd-9ca4-ae3d62257aba req-ad91b5b8-1c56-435a-a3db-b27375195d39 service nova] Acquired lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:38:19 user nova-compute[75672]: DEBUG nova.network.neutron [req-3c2dd7f0-db0d-4fbd-9ca4-ae3d62257aba req-ad91b5b8-1c56-435a-a3db-b27375195d39 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Refreshing network info cache for port d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:38:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:19 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Instance destroyed successfully.
Nov 30 12:38:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:19 user nova-compute[75672]: DEBUG nova.network.neutron [req-3c2dd7f0-db0d-4fbd-9ca4-ae3d62257aba req-ad91b5b8-1c56-435a-a3db-b27375195d39 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updated VIF entry in instance network info cache for port d229eaa1-29dc-4b3f-b468-d5a8f24d7514. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:38:19 user nova-compute[75672]: DEBUG nova.network.neutron [req-3c2dd7f0-db0d-4fbd-9ca4-ae3d62257aba req-ad91b5b8-1c56-435a-a3db-b27375195d39 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updating instance_info_cache with network_info: [{"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:38:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3c2dd7f0-db0d-4fbd-9ca4-ae3d62257aba req-ad91b5b8-1c56-435a-a3db-b27375195d39 service nova] Releasing lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:38:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:20 user nova-compute[75672]: INFO nova.compute.manager [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Detaching volume 58d8f807-5f0b-4fdf-9896-b190ebe120a7
Nov 30 12:38:20 user nova-compute[75672]: INFO nova.virt.block_device [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Attempting to driver detach volume 58d8f807-5f0b-4fdf-9896-b190ebe120a7 from mountpoint /dev/vdb
Nov 30 12:38:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Attempting to detach device vdb from instance 4382544b-6fb7-4164-9b6b-302a6e24bc52 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:38:20 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:38:20 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 12:38:20 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:38:20 user nova-compute[75672]:   <serial>58d8f807-5f0b-4fdf-9896-b190ebe120a7</serial>
Nov 30 12:38:20 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 12:38:20 user nova-compute[75672]: </disk>
Nov 30 12:38:20 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:38:20 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Successfully detached device vdb from instance 4382544b-6fb7-4164-9b6b-302a6e24bc52 from the persistent domain config.
Nov 30 12:38:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4382544b-6fb7-4164-9b6b-302a6e24bc52 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:38:20 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:38:20 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 12:38:20 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:38:20 user nova-compute[75672]:   <serial>58d8f807-5f0b-4fdf-9896-b190ebe120a7</serial>
Nov 30 12:38:20 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 12:38:20 user nova-compute[75672]: </disk>
Nov 30 12:38:20 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-a6a8e725-e162-4f5a-b562-2b5e20d5900e req-c63b7674-b87b-4fe9-9bb9-9d3a041aaacf service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a6a8e725-e162-4f5a-b562-2b5e20d5900e req-c63b7674-b87b-4fe9-9bb9-9d3a041aaacf service nova] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a6a8e725-e162-4f5a-b562-2b5e20d5900e req-c63b7674-b87b-4fe9-9bb9-9d3a041aaacf service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a6a8e725-e162-4f5a-b562-2b5e20d5900e req-c63b7674-b87b-4fe9-9bb9-9d3a041aaacf service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-a6a8e725-e162-4f5a-b562-2b5e20d5900e req-c63b7674-b87b-4fe9-9bb9-9d3a041aaacf service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] No waiting events found dispatching network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:38:20 user nova-compute[75672]: WARNING nova.compute.manager [req-a6a8e725-e162-4f5a-b562-2b5e20d5900e req-c63b7674-b87b-4fe9-9bb9-9d3a041aaacf service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received unexpected event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:38:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-a6a8e725-e162-4f5a-b562-2b5e20d5900e req-c63b7674-b87b-4fe9-9bb9-9d3a041aaacf service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a6a8e725-e162-4f5a-b562-2b5e20d5900e req-c63b7674-b87b-4fe9-9bb9-9d3a041aaacf service nova] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a6a8e725-e162-4f5a-b562-2b5e20d5900e req-c63b7674-b87b-4fe9-9bb9-9d3a041aaacf service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a6a8e725-e162-4f5a-b562-2b5e20d5900e req-c63b7674-b87b-4fe9-9bb9-9d3a041aaacf service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-a6a8e725-e162-4f5a-b562-2b5e20d5900e req-c63b7674-b87b-4fe9-9bb9-9d3a041aaacf service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] No waiting events found dispatching network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:38:20 user nova-compute[75672]: WARNING nova.compute.manager [req-a6a8e725-e162-4f5a-b562-2b5e20d5900e req-c63b7674-b87b-4fe9-9bb9-9d3a041aaacf service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received unexpected event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:38:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-cd54b479-511f-448b-912f-fbba6afc38b2 req-02fb3797-a236-4501-823a-3707b014a892 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received event network-changed-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-cd54b479-511f-448b-912f-fbba6afc38b2 req-02fb3797-a236-4501-823a-3707b014a892 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Refreshing instance network info cache due to event network-changed-d229eaa1-29dc-4b3f-b468-d5a8f24d7514. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:38:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cd54b479-511f-448b-912f-fbba6afc38b2 req-02fb3797-a236-4501-823a-3707b014a892 service nova] Acquiring lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:38:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cd54b479-511f-448b-912f-fbba6afc38b2 req-02fb3797-a236-4501-823a-3707b014a892 service nova] Acquired lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:38:21 user nova-compute[75672]: DEBUG nova.network.neutron [req-cd54b479-511f-448b-912f-fbba6afc38b2 req-02fb3797-a236-4501-823a-3707b014a892 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Refreshing network info cache for port d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:38:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4382544b-6fb7-4164-9b6b-302a6e24bc52 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:38:21 user nova-compute[75672]: DEBUG nova.network.neutron [req-cd54b479-511f-448b-912f-fbba6afc38b2 req-02fb3797-a236-4501-823a-3707b014a892 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updated VIF entry in instance network info cache for port d229eaa1-29dc-4b3f-b468-d5a8f24d7514. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:38:21 user nova-compute[75672]: DEBUG nova.network.neutron [req-cd54b479-511f-448b-912f-fbba6afc38b2 req-02fb3797-a236-4501-823a-3707b014a892 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updating instance_info_cache with network_info: [{"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:38:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cd54b479-511f-448b-912f-fbba6afc38b2 req-02fb3797-a236-4501-823a-3707b014a892 service nova] Releasing lock "refresh_cache-4382544b-6fb7-4164-9b6b-302a6e24bc52" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:38:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:22 user nova-compute[75672]: DEBUG nova.compute.manager [req-08dccfd4-1fb0-444c-850e-05bcd477ab7e req-06e747eb-da90-4ea9-8466-dcfc0262854b service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-08dccfd4-1fb0-444c-850e-05bcd477ab7e req-06e747eb-da90-4ea9-8466-dcfc0262854b service nova] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-08dccfd4-1fb0-444c-850e-05bcd477ab7e req-06e747eb-da90-4ea9-8466-dcfc0262854b service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-08dccfd4-1fb0-444c-850e-05bcd477ab7e req-06e747eb-da90-4ea9-8466-dcfc0262854b service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:22 user nova-compute[75672]: DEBUG nova.compute.manager [req-08dccfd4-1fb0-444c-850e-05bcd477ab7e req-06e747eb-da90-4ea9-8466-dcfc0262854b service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] No waiting events found dispatching network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:38:22 user nova-compute[75672]: WARNING nova.compute.manager [req-08dccfd4-1fb0-444c-850e-05bcd477ab7e req-06e747eb-da90-4ea9-8466-dcfc0262854b service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received unexpected event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:38:23 user nova-compute[75672]: DEBUG nova.compute.manager [None req-43de68c3-bbb2-4729-8b5b-cf2a37abd454 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:38:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:29 user nova-compute[75672]: DEBUG nova.compute.manager [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:38:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:29 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:38:29 user nova-compute[75672]: INFO nova.compute.claims [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Claim successful on node user
Nov 30 12:38:30 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG nova.compute.manager [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG nova.compute.manager [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG nova.network.neutron [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:38:30 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:38:30 user nova-compute[75672]: DEBUG nova.compute.manager [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG nova.policy [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3166f2b3dee4aa4aa738f1f15ca7d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f07019e3584771af197e865b6877cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG nova.compute.manager [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:38:30 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Creating image(s)
Nov 30 12:38:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "/opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "/opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "/opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk 1073741824" returned: 0 in 0.059s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG nova.network.neutron [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Successfully created port: a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Cannot resize image /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Ensure instance console log exists: /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.network.neutron [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Successfully updated port: a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "refresh_cache-492a3775-dc6e-4c94-9ce0-26bc2da43e24" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquired lock "refresh_cache-492a3775-dc6e-4c94-9ce0-26bc2da43e24" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.network.neutron [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-01aefb0e-c73d-4afc-84b4-c1680587671e req-b3c88b11-b0bf-4841-afb5-3364f305f110 service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Received event network-changed-a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-01aefb0e-c73d-4afc-84b4-c1680587671e req-b3c88b11-b0bf-4841-afb5-3364f305f110 service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Refreshing instance network info cache due to event network-changed-a5f78084-b8e7-44f5-a614-ae1e4b0e189d. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-01aefb0e-c73d-4afc-84b4-c1680587671e req-b3c88b11-b0bf-4841-afb5-3364f305f110 service nova] Acquiring lock "refresh_cache-492a3775-dc6e-4c94-9ce0-26bc2da43e24" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.network.neutron [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.network.neutron [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Updating instance_info_cache with network_info: [{"id": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "address": "fa:16:3e:3e:9e:81", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f78084-b8", "ovs_interfaceid": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Releasing lock "refresh_cache-492a3775-dc6e-4c94-9ce0-26bc2da43e24" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.compute.manager [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Instance network_info: |[{"id": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "address": "fa:16:3e:3e:9e:81", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f78084-b8", "ovs_interfaceid": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-01aefb0e-c73d-4afc-84b4-c1680587671e req-b3c88b11-b0bf-4841-afb5-3364f305f110 service nova] Acquired lock "refresh_cache-492a3775-dc6e-4c94-9ce0-26bc2da43e24" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.network.neutron [req-01aefb0e-c73d-4afc-84b4-c1680587671e req-b3c88b11-b0bf-4841-afb5-3364f305f110 service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Refreshing network info cache for port a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Start _get_guest_xml network_info=[{"id": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "address": "fa:16:3e:3e:9e:81", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f78084-b8", "ovs_interfaceid": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:38:32 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:38:32 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:38:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-41713594',display_name='tempest-AttachVolumeNegativeTest-server-41713594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-41713594',id=21,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0IzSNd2h5veSlcv1q/ZSjjAvkYmslaxMFSA7Ozoo3F+rPjwRkMTZqVxwVZVENMsdvlj1UmQkrmrwoXPgsyWNiOF+nPjEOypb9ro8gC1flvco/27XDYmtDsDqSi6MH2ng==',key_name='tempest-keypair-1276550109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f07019e3584771af197e865b6877cc',ramdisk_id='',reservation_id='r-u4rpk1zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1224349538',owner_user_name='tempest-AttachVolumeNegativeTest-1224349538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:38:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3166f2b3dee4aa4aa738f1f15ca7d19',uuid=492a3775-dc6e-4c94-9ce0-26bc2da43e24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "address": "fa:16:3e:3e:9e:81", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f78084-b8", "ovs_interfaceid": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converting VIF {"id": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "address": "fa:16:3e:3e:9e:81", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f78084-b8", "ovs_interfaceid": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9e:81,bridge_name='br-int',has_traffic_filtering=True,id=a5f78084-b8e7-44f5-a614-ae1e4b0e189d,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f78084-b8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.objects.instance [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'pci_devices' on Instance uuid 492a3775-dc6e-4c94-9ce0-26bc2da43e24 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:38:32 user nova-compute[75672]:   <uuid>492a3775-dc6e-4c94-9ce0-26bc2da43e24</uuid>
Nov 30 12:38:32 user nova-compute[75672]:   <name>instance-00000015</name>
Nov 30 12:38:32 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:38:32 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:38:32 user nova-compute[75672]:   <metadata>
Nov 30 12:38:32 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:38:32 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:38:32 user nova-compute[75672]:       <nova:name>tempest-AttachVolumeNegativeTest-server-41713594</nova:name>
Nov 30 12:38:32 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:38:32</nova:creationTime>
Nov 30 12:38:32 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:38:32 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:38:32 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:38:32 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:38:32 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:38:32 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:38:32 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:38:32 user nova-compute[75672]:       <nova:owner>
Nov 30 12:38:32 user nova-compute[75672]:         <nova:user uuid="e3166f2b3dee4aa4aa738f1f15ca7d19">tempest-AttachVolumeNegativeTest-1224349538-project-member</nova:user>
Nov 30 12:38:32 user nova-compute[75672]:         <nova:project uuid="04f07019e3584771af197e865b6877cc">tempest-AttachVolumeNegativeTest-1224349538</nova:project>
Nov 30 12:38:32 user nova-compute[75672]:       </nova:owner>
Nov 30 12:38:32 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:38:32 user nova-compute[75672]:       <nova:ports>
Nov 30 12:38:32 user nova-compute[75672]:         <nova:port uuid="a5f78084-b8e7-44f5-a614-ae1e4b0e189d">
Nov 30 12:38:32 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 12:38:32 user nova-compute[75672]:         </nova:port>
Nov 30 12:38:32 user nova-compute[75672]:       </nova:ports>
Nov 30 12:38:32 user nova-compute[75672]:     </nova:instance>
Nov 30 12:38:32 user nova-compute[75672]:   </metadata>
Nov 30 12:38:32 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:38:32 user nova-compute[75672]:     <system>
Nov 30 12:38:32 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:38:32 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:38:32 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:38:32 user nova-compute[75672]:       <entry name="serial">492a3775-dc6e-4c94-9ce0-26bc2da43e24</entry>
Nov 30 12:38:32 user nova-compute[75672]:       <entry name="uuid">492a3775-dc6e-4c94-9ce0-26bc2da43e24</entry>
Nov 30 12:38:32 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:38:32 user nova-compute[75672]:     </system>
Nov 30 12:38:32 user nova-compute[75672]:   </sysinfo>
Nov 30 12:38:32 user nova-compute[75672]:   <os>
Nov 30 12:38:32 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:38:32 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:38:32 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:38:32 user nova-compute[75672]:   </os>
Nov 30 12:38:32 user nova-compute[75672]:   <features>
Nov 30 12:38:32 user nova-compute[75672]:     <acpi/>
Nov 30 12:38:32 user nova-compute[75672]:     <apic/>
Nov 30 12:38:32 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:38:32 user nova-compute[75672]:   </features>
Nov 30 12:38:32 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:38:32 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:38:32 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:38:32 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:38:32 user nova-compute[75672]:   </clock>
Nov 30 12:38:32 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:38:32 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:38:32 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:38:32 user nova-compute[75672]:   </cpu>
Nov 30 12:38:32 user nova-compute[75672]:   <devices>
Nov 30 12:38:32 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:38:32 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:38:32 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk"/>
Nov 30 12:38:32 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:38:32 user nova-compute[75672]:     </disk>
Nov 30 12:38:32 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:38:32 user nova-compute[75672]:       <mac address="fa:16:3e:3e:9e:81"/>
Nov 30 12:38:32 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:38:32 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:38:32 user nova-compute[75672]:       <target dev="tapa5f78084-b8"/>
Nov 30 12:38:32 user nova-compute[75672]:     </interface>
Nov 30 12:38:32 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:38:32 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/console.log" append="off"/>
Nov 30 12:38:32 user nova-compute[75672]:     </serial>
Nov 30 12:38:32 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:38:32 user nova-compute[75672]:     <video>
Nov 30 12:38:32 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:38:32 user nova-compute[75672]:     </video>
Nov 30 12:38:32 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:38:32 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:38:32 user nova-compute[75672]:     </rng>
Nov 30 12:38:32 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:38:32 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:38:32 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:38:32 user nova-compute[75672]:     </memballoon>
Nov 30 12:38:32 user nova-compute[75672]:   </devices>
Nov 30 12:38:32 user nova-compute[75672]: </domain>
Nov 30 12:38:32 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:38:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-41713594',display_name='tempest-AttachVolumeNegativeTest-server-41713594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-41713594',id=21,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0IzSNd2h5veSlcv1q/ZSjjAvkYmslaxMFSA7Ozoo3F+rPjwRkMTZqVxwVZVENMsdvlj1UmQkrmrwoXPgsyWNiOF+nPjEOypb9ro8gC1flvco/27XDYmtDsDqSi6MH2ng==',key_name='tempest-keypair-1276550109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f07019e3584771af197e865b6877cc',ramdisk_id='',reservation_id='r-u4rpk1zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1224349538',owner_user_name='tempest-AttachVolumeNegativeTest-1224349538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:38:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3166f2b3dee4aa4aa738f1f15ca7d19',uuid=492a3775-dc6e-4c94-9ce0-26bc2da43e24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "address": "fa:16:3e:3e:9e:81", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f78084-b8", "ovs_interfaceid": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converting VIF {"id": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "address": "fa:16:3e:3e:9e:81", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f78084-b8", "ovs_interfaceid": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9e:81,bridge_name='br-int',has_traffic_filtering=True,id=a5f78084-b8e7-44f5-a614-ae1e4b0e189d,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f78084-b8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG os_vif [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9e:81,bridge_name='br-int',has_traffic_filtering=True,id=a5f78084-b8e7-44f5-a614-ae1e4b0e189d,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f78084-b8') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5defd5ed-5e12-540a-852d-3f30230d8222', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5f78084-b8, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5f78084-b8, col_values=(('qos', UUID('696ef067-a50e-4a6d-be32-eda357811b80')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5f78084-b8, col_values=(('external_ids', {'iface-id': 'a5f78084-b8e7-44f5-a614-ae1e4b0e189d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:9e:81', 'vm-uuid': '492a3775-dc6e-4c94-9ce0-26bc2da43e24'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:38:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:32 user nova-compute[75672]: INFO os_vif [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9e:81,bridge_name='br-int',has_traffic_filtering=True,id=a5f78084-b8e7-44f5-a614-ae1e4b0e189d,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f78084-b8')
Nov 30 12:38:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:38:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No VIF found with MAC fa:16:3e:3e:9e:81, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:38:33 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:38:33 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:38:33 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Didn't find any instances for network info cache update. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 12:38:33 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:38:33 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:38:33 user nova-compute[75672]: DEBUG nova.network.neutron [req-01aefb0e-c73d-4afc-84b4-c1680587671e req-b3c88b11-b0bf-4841-afb5-3364f305f110 service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Updated VIF entry in instance network info cache for port a5f78084-b8e7-44f5-a614-ae1e4b0e189d. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:38:33 user nova-compute[75672]: DEBUG nova.network.neutron [req-01aefb0e-c73d-4afc-84b4-c1680587671e req-b3c88b11-b0bf-4841-afb5-3364f305f110 service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Updating instance_info_cache with network_info: [{"id": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "address": "fa:16:3e:3e:9e:81", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f78084-b8", "ovs_interfaceid": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:38:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-01aefb0e-c73d-4afc-84b4-c1680587671e req-b3c88b11-b0bf-4841-afb5-3364f305f110 service nova] Releasing lock "refresh_cache-492a3775-dc6e-4c94-9ce0-26bc2da43e24" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:38:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:35 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:38:35 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:38:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:35 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:38:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:38:36 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Instance spawned successfully.
Nov 30 12:38:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:36 user nova-compute[75672]: INFO nova.compute.manager [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 30 12:38:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:36 user nova-compute[75672]: INFO nova.compute.manager [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Took 7.05 seconds to build instance.
Nov 30 12:38:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-462eed46-e63c-4f24-8d73-1c57b315932e tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.155s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:38:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:38:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-2b17ebc8-3226-49b1-ae8f-c4c5d7f283bc req-01553739-2f80-4da9-94a3-357fd5fbad5e service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Received event network-vif-plugged-a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2b17ebc8-3226-49b1-ae8f-c4c5d7f283bc req-01553739-2f80-4da9-94a3-357fd5fbad5e service nova] Acquiring lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2b17ebc8-3226-49b1-ae8f-c4c5d7f283bc req-01553739-2f80-4da9-94a3-357fd5fbad5e service nova] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2b17ebc8-3226-49b1-ae8f-c4c5d7f283bc req-01553739-2f80-4da9-94a3-357fd5fbad5e service nova] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-2b17ebc8-3226-49b1-ae8f-c4c5d7f283bc req-01553739-2f80-4da9-94a3-357fd5fbad5e service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] No waiting events found dispatching network-vif-plugged-a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:38:40 user nova-compute[75672]: WARNING nova.compute.manager [req-2b17ebc8-3226-49b1-ae8f-c4c5d7f283bc req-01553739-2f80-4da9-94a3-357fd5fbad5e service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Received unexpected event network-vif-plugged-a5f78084-b8e7-44f5-a614-ae1e4b0e189d for instance with vm_state active and task_state None.
Nov 30 12:38:40 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:38:40 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7247MB free_disk=25.33449935913086GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 1fba8af1-8074-4ce8-be23-912e9850fc41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 4382544b-6fb7-4164-9b6b-302a6e24bc52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 3338ed96-33ff-45e6-b3da-05fbb242a3a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f53f77ca-8471-4c62-a779-f64a0a4e57aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 3df9c388-08c6-4153-9666-8e492acda60c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 33acdb4c-16f6-4873-9af8-6297cbfda1c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 492a3775-dc6e-4c94-9ce0-26bc2da43e24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:38:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:41 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4382544b-6fb7-4164-9b6b-302a6e24bc52 is timed out.
Nov 30 12:38:41 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Successfully detached device vdb from instance 4382544b-6fb7-4164-9b6b-302a6e24bc52 from the live domain config.
Nov 30 12:38:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHRsdpVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:38:41 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7036f91d-8d15-48a6-b7eb-970a4be9b6b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:38:41 user nova-compute[75672]: No targets found.
Nov 30 12:38:41 user nova-compute[75672]: iSNS:
Nov 30 12:38:41 user nova-compute[75672]: No targets found.
Nov 30 12:38:41 user nova-compute[75672]: STATIC:
Nov 30 12:38:41 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74
Nov 30 12:38:41 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:38:41 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:38:41 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224
Nov 30 12:38:41 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:38:41 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:38:41 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721
Nov 30 12:38:41 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:38:41 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:38:41 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7
Nov 30 12:38:41 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:38:41 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:38:41 user nova-compute[75672]: FIRMWARE:
Nov 30 12:38:41 user nova-compute[75672]: No targets found.
Nov 30 12:38:41 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:38:41 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:38:41 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3c78b5-22c7-4d34-b0df-20a9047ade10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9463a716-e2a1-49e6-ad5c-2e8046d91abe]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:38:41 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:38:41 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:38:41 user nova-compute[75672]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:38:41 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 (non-flash)
Nov 30 12:38:41 user nova-compute[75672]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:38:41 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:38:41 user nova-compute[75672]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:38:41 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcf7e49cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7'): ({'sdc'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Removing single pathed devices sdc {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[16df0b3a-d769-4703-803b-f913cf0e4427]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc78473-26cf-4dd2-8949-b036a7d99f2b]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Flushing IO for device /dev/sdc {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2caf428-b35e-491e-983f-a2fc5b9acdcd]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c66c1fb-3e45-4604-b4d9-d0ea02351aa3]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.857s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b340c571-2125-482a-9c1a-52e88527b241]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.348s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dec7e41-a53f-4ed8-9f4b-e9a6b2ed6fc4]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260]
Nov 30 12:38:41 user nova-compute[75672]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7, portal: 172.16.0.220,3260] successful.
Nov 30 12:38:41 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d8f807-5f0b-4fdf-9896-b190ebe120a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e85d33-844a-4022-b83e-b6c2127c88ee]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.681s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] <== disconnect_volume: return (683ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:38:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:38:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:38:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:38:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:38:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:38:42 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:38:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-e1c8f307-5adf-46a0-ae97-2ce46e189292 req-383edf17-f3af-462f-9391-1a2d0843414e service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Received event network-vif-plugged-a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e1c8f307-5adf-46a0-ae97-2ce46e189292 req-383edf17-f3af-462f-9391-1a2d0843414e service nova] Acquiring lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e1c8f307-5adf-46a0-ae97-2ce46e189292 req-383edf17-f3af-462f-9391-1a2d0843414e service nova] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e1c8f307-5adf-46a0-ae97-2ce46e189292 req-383edf17-f3af-462f-9391-1a2d0843414e service nova] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-e1c8f307-5adf-46a0-ae97-2ce46e189292 req-383edf17-f3af-462f-9391-1a2d0843414e service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] No waiting events found dispatching network-vif-plugged-a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:38:42 user nova-compute[75672]: WARNING nova.compute.manager [req-e1c8f307-5adf-46a0-ae97-2ce46e189292 req-383edf17-f3af-462f-9391-1a2d0843414e service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Received unexpected event network-vif-plugged-a5f78084-b8e7-44f5-a614-ae1e4b0e189d for instance with vm_state active and task_state None.
Nov 30 12:38:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:43 user nova-compute[75672]: DEBUG nova.objects.instance [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'flavor' on Instance uuid 4382544b-6fb7-4164-9b6b-302a6e24bc52 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:38:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5c2301a1-9f9a-4542-ac56-baf64b0c3dd5 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.706s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG nova.compute.manager [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:38:44 user nova-compute[75672]: INFO nova.compute.claims [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Claim successful on node user
Nov 30 12:38:44 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG nova.compute.manager [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG nova.compute.manager [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG nova.network.neutron [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:38:44 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:38:44 user nova-compute[75672]: DEBUG nova.compute.manager [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG nova.policy [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00ef4da74def408a818911598648cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af7cfb45ca64a1ab37299ecbc1a1ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG nova.compute.manager [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:38:44 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Creating image(s)
Nov 30 12:38:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "/opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "/opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "/opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk 1073741824" returned: 0 in 0.059s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG nova.network.neutron [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Successfully created port: 449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.189s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Cannot resize image /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Ensure instance console log exists: /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Successfully updated port: 449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "refresh_cache-76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquired lock "refresh_cache-76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-defee967-ee1c-4306-919e-f8e3bc5b0a90 req-11de0124-0f9f-4df1-9259-7d76fc6fd0fb service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received event network-changed-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-defee967-ee1c-4306-919e-f8e3bc5b0a90 req-11de0124-0f9f-4df1-9259-7d76fc6fd0fb service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Refreshing instance network info cache due to event network-changed-449f9465-ff37-41ba-a779-b6791644bfbe. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-defee967-ee1c-4306-919e-f8e3bc5b0a90 req-11de0124-0f9f-4df1-9259-7d76fc6fd0fb service nova] Acquiring lock "refresh_cache-76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Updating instance_info_cache with network_info: [{"id": "449f9465-ff37-41ba-a779-b6791644bfbe", "address": "fa:16:3e:16:c6:38", "network": {"id": "3fb890d7-13c7-46cd-a675-2e37f8faebcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1255737074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af7cfb45ca64a1ab37299ecbc1a1ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449f9465-ff", "ovs_interfaceid": "449f9465-ff37-41ba-a779-b6791644bfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Releasing lock "refresh_cache-76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Instance network_info: |[{"id": "449f9465-ff37-41ba-a779-b6791644bfbe", "address": "fa:16:3e:16:c6:38", "network": {"id": "3fb890d7-13c7-46cd-a675-2e37f8faebcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1255737074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af7cfb45ca64a1ab37299ecbc1a1ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449f9465-ff", "ovs_interfaceid": "449f9465-ff37-41ba-a779-b6791644bfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-defee967-ee1c-4306-919e-f8e3bc5b0a90 req-11de0124-0f9f-4df1-9259-7d76fc6fd0fb service nova] Acquired lock "refresh_cache-76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.network.neutron [req-defee967-ee1c-4306-919e-f8e3bc5b0a90 req-11de0124-0f9f-4df1-9259-7d76fc6fd0fb service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Refreshing network info cache for port 449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Start _get_guest_xml network_info=[{"id": "449f9465-ff37-41ba-a779-b6791644bfbe", "address": "fa:16:3e:16:c6:38", "network": {"id": "3fb890d7-13c7-46cd-a675-2e37f8faebcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1255737074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af7cfb45ca64a1ab37299ecbc1a1ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449f9465-ff", "ovs_interfaceid": "449f9465-ff37-41ba-a779-b6791644bfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:38:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:38:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-572316796',display_name='tempest-TestServerVolumeAttachmentScenario-server-572316796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-572316796',id=22,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJojoxWrerIjfTb1C4budJ26TRiWZ4SUHy6lNhLYMip4xqi8rx4obsD3MSIJSzVPp8xLKXft8oiF5fnVJTVNMIPS1TKwBZCGZ/jFKyqAG9eu++eI3LdvIDwneMRJ527DQw==',key_name='tempest-keypair-1759477291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6af7cfb45ca64a1ab37299ecbc1a1ce6',ramdisk_id='',reservation_id='r-7s7ec1q8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1990148836',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1990148836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:38:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00ef4da74def408a818911598648cf4f',uuid=76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "449f9465-ff37-41ba-a779-b6791644bfbe", "address": "fa:16:3e:16:c6:38", "network": {"id": "3fb890d7-13c7-46cd-a675-2e37f8faebcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1255737074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af7cfb45ca64a1ab37299ecbc1a1ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449f9465-ff", "ovs_interfaceid": "449f9465-ff37-41ba-a779-b6791644bfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Converting VIF {"id": "449f9465-ff37-41ba-a779-b6791644bfbe", "address": "fa:16:3e:16:c6:38", "network": {"id": "3fb890d7-13c7-46cd-a675-2e37f8faebcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1255737074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af7cfb45ca64a1ab37299ecbc1a1ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449f9465-ff", "ovs_interfaceid": "449f9465-ff37-41ba-a779-b6791644bfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:c6:38,bridge_name='br-int',has_traffic_filtering=True,id=449f9465-ff37-41ba-a779-b6791644bfbe,network=Network(3fb890d7-13c7-46cd-a675-2e37f8faebcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449f9465-ff') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.objects.instance [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lazy-loading 'pci_devices' on Instance uuid 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:38:46 user nova-compute[75672]:   <uuid>76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2</uuid>
Nov 30 12:38:46 user nova-compute[75672]:   <name>instance-00000016</name>
Nov 30 12:38:46 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:38:46 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:38:46 user nova-compute[75672]:   <metadata>
Nov 30 12:38:46 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:38:46 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:38:46 user nova-compute[75672]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-572316796</nova:name>
Nov 30 12:38:46 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:38:46</nova:creationTime>
Nov 30 12:38:46 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:38:46 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:38:46 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:38:46 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:38:46 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:38:46 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:38:46 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:38:46 user nova-compute[75672]:       <nova:owner>
Nov 30 12:38:46 user nova-compute[75672]:         <nova:user uuid="00ef4da74def408a818911598648cf4f">tempest-TestServerVolumeAttachmentScenario-1990148836-project-member</nova:user>
Nov 30 12:38:46 user nova-compute[75672]:         <nova:project uuid="6af7cfb45ca64a1ab37299ecbc1a1ce6">tempest-TestServerVolumeAttachmentScenario-1990148836</nova:project>
Nov 30 12:38:46 user nova-compute[75672]:       </nova:owner>
Nov 30 12:38:46 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:38:46 user nova-compute[75672]:       <nova:ports>
Nov 30 12:38:46 user nova-compute[75672]:         <nova:port uuid="449f9465-ff37-41ba-a779-b6791644bfbe">
Nov 30 12:38:46 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 12:38:46 user nova-compute[75672]:         </nova:port>
Nov 30 12:38:46 user nova-compute[75672]:       </nova:ports>
Nov 30 12:38:46 user nova-compute[75672]:     </nova:instance>
Nov 30 12:38:46 user nova-compute[75672]:   </metadata>
Nov 30 12:38:46 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:38:46 user nova-compute[75672]:     <system>
Nov 30 12:38:46 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:38:46 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:38:46 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:38:46 user nova-compute[75672]:       <entry name="serial">76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2</entry>
Nov 30 12:38:46 user nova-compute[75672]:       <entry name="uuid">76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2</entry>
Nov 30 12:38:46 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:38:46 user nova-compute[75672]:     </system>
Nov 30 12:38:46 user nova-compute[75672]:   </sysinfo>
Nov 30 12:38:46 user nova-compute[75672]:   <os>
Nov 30 12:38:46 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:38:46 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:38:46 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:38:46 user nova-compute[75672]:   </os>
Nov 30 12:38:46 user nova-compute[75672]:   <features>
Nov 30 12:38:46 user nova-compute[75672]:     <acpi/>
Nov 30 12:38:46 user nova-compute[75672]:     <apic/>
Nov 30 12:38:46 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:38:46 user nova-compute[75672]:   </features>
Nov 30 12:38:46 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:38:46 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:38:46 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:38:46 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:38:46 user nova-compute[75672]:   </clock>
Nov 30 12:38:46 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:38:46 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:38:46 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:38:46 user nova-compute[75672]:   </cpu>
Nov 30 12:38:46 user nova-compute[75672]:   <devices>
Nov 30 12:38:46 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:38:46 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:38:46 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk"/>
Nov 30 12:38:46 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:38:46 user nova-compute[75672]:     </disk>
Nov 30 12:38:46 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:38:46 user nova-compute[75672]:       <mac address="fa:16:3e:16:c6:38"/>
Nov 30 12:38:46 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:38:46 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:38:46 user nova-compute[75672]:       <target dev="tap449f9465-ff"/>
Nov 30 12:38:46 user nova-compute[75672]:     </interface>
Nov 30 12:38:46 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:38:46 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/console.log" append="off"/>
Nov 30 12:38:46 user nova-compute[75672]:     </serial>
Nov 30 12:38:46 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:38:46 user nova-compute[75672]:     <video>
Nov 30 12:38:46 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:38:46 user nova-compute[75672]:     </video>
Nov 30 12:38:46 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:38:46 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:38:46 user nova-compute[75672]:     </rng>
Nov 30 12:38:46 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:38:46 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:38:46 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:38:46 user nova-compute[75672]:     </memballoon>
Nov 30 12:38:46 user nova-compute[75672]:   </devices>
Nov 30 12:38:46 user nova-compute[75672]: </domain>
Nov 30 12:38:46 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-572316796',display_name='tempest-TestServerVolumeAttachmentScenario-server-572316796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-572316796',id=22,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJojoxWrerIjfTb1C4budJ26TRiWZ4SUHy6lNhLYMip4xqi8rx4obsD3MSIJSzVPp8xLKXft8oiF5fnVJTVNMIPS1TKwBZCGZ/jFKyqAG9eu++eI3LdvIDwneMRJ527DQw==',key_name='tempest-keypair-1759477291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6af7cfb45ca64a1ab37299ecbc1a1ce6',ramdisk_id='',reservation_id='r-7s7ec1q8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1990148836',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1990148836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:38:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00ef4da74def408a818911598648cf4f',uuid=76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "449f9465-ff37-41ba-a779-b6791644bfbe", "address": "fa:16:3e:16:c6:38", "network": {"id": "3fb890d7-13c7-46cd-a675-2e37f8faebcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1255737074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af7cfb45ca64a1ab37299ecbc1a1ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449f9465-ff", "ovs_interfaceid": "449f9465-ff37-41ba-a779-b6791644bfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Converting VIF {"id": "449f9465-ff37-41ba-a779-b6791644bfbe", "address": "fa:16:3e:16:c6:38", "network": {"id": "3fb890d7-13c7-46cd-a675-2e37f8faebcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1255737074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af7cfb45ca64a1ab37299ecbc1a1ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449f9465-ff", "ovs_interfaceid": "449f9465-ff37-41ba-a779-b6791644bfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:c6:38,bridge_name='br-int',has_traffic_filtering=True,id=449f9465-ff37-41ba-a779-b6791644bfbe,network=Network(3fb890d7-13c7-46cd-a675-2e37f8faebcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449f9465-ff') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG os_vif [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:c6:38,bridge_name='br-int',has_traffic_filtering=True,id=449f9465-ff37-41ba-a779-b6791644bfbe,network=Network(3fb890d7-13c7-46cd-a675-2e37f8faebcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449f9465-ff') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f91b69f-b554-5932-9693-7329ecfcc091', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap449f9465-ff, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap449f9465-ff, col_values=(('qos', UUID('837e4048-0bb9-4928-a66b-051815fe3d8f')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap449f9465-ff, col_values=(('external_ids', {'iface-id': '449f9465-ff37-41ba-a779-b6791644bfbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:c6:38', 'vm-uuid': '76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:46 user nova-compute[75672]: INFO os_vif [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:c6:38,bridge_name='br-int',has_traffic_filtering=True,id=449f9465-ff37-41ba-a779-b6791644bfbe,network=Network(3fb890d7-13c7-46cd-a675-2e37f8faebcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449f9465-ff')
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] No VIF found with MAC fa:16:3e:16:c6:38, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.network.neutron [req-defee967-ee1c-4306-919e-f8e3bc5b0a90 req-11de0124-0f9f-4df1-9259-7d76fc6fd0fb service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Updated VIF entry in instance network info cache for port 449f9465-ff37-41ba-a779-b6791644bfbe. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG nova.network.neutron [req-defee967-ee1c-4306-919e-f8e3bc5b0a90 req-11de0124-0f9f-4df1-9259-7d76fc6fd0fb service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Updating instance_info_cache with network_info: [{"id": "449f9465-ff37-41ba-a779-b6791644bfbe", "address": "fa:16:3e:16:c6:38", "network": {"id": "3fb890d7-13c7-46cd-a675-2e37f8faebcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1255737074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af7cfb45ca64a1ab37299ecbc1a1ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449f9465-ff", "ovs_interfaceid": "449f9465-ff37-41ba-a779-b6791644bfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:38:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-defee967-ee1c-4306-919e-f8e3bc5b0a90 req-11de0124-0f9f-4df1-9259-7d76fc6fd0fb service nova] Releasing lock "refresh_cache-76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:38:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:48 user nova-compute[75672]: DEBUG nova.compute.manager [req-4e09bd2c-ddd4-4d0f-8add-b4d918e886ee req-40796b62-277e-4920-b475-0dcc99935ed4 service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received event network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4e09bd2c-ddd4-4d0f-8add-b4d918e886ee req-40796b62-277e-4920-b475-0dcc99935ed4 service nova] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4e09bd2c-ddd4-4d0f-8add-b4d918e886ee req-40796b62-277e-4920-b475-0dcc99935ed4 service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4e09bd2c-ddd4-4d0f-8add-b4d918e886ee req-40796b62-277e-4920-b475-0dcc99935ed4 service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:48 user nova-compute[75672]: DEBUG nova.compute.manager [req-4e09bd2c-ddd4-4d0f-8add-b4d918e886ee req-40796b62-277e-4920-b475-0dcc99935ed4 service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] No waiting events found dispatching network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:38:48 user nova-compute[75672]: WARNING nova.compute.manager [req-4e09bd2c-ddd4-4d0f-8add-b4d918e886ee req-40796b62-277e-4920-b475-0dcc99935ed4 service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received unexpected event network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe for instance with vm_state building and task_state spawning.
Nov 30 12:38:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:49 user nova-compute[75672]: DEBUG nova.compute.manager [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:38:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:38:49 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Instance spawned successfully.
Nov 30 12:38:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:38:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:38:50 user nova-compute[75672]: INFO nova.compute.manager [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 30 12:38:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:38:50 user nova-compute[75672]: INFO nova.compute.manager [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Took 5.99 seconds to build instance.
Nov 30 12:38:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-540be2c4-2099-4e6f-b782-c6e20947db1f tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.105s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:50 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd66abea-d6ba-4b7b-ac84-5b1f8bdab56c req-d6b4a1dd-9996-4163-ac7f-7f24d6dc873e service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received event network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:38:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd66abea-d6ba-4b7b-ac84-5b1f8bdab56c req-d6b4a1dd-9996-4163-ac7f-7f24d6dc873e service nova] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:38:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd66abea-d6ba-4b7b-ac84-5b1f8bdab56c req-d6b4a1dd-9996-4163-ac7f-7f24d6dc873e service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:38:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd66abea-d6ba-4b7b-ac84-5b1f8bdab56c req-d6b4a1dd-9996-4163-ac7f-7f24d6dc873e service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:38:50 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd66abea-d6ba-4b7b-ac84-5b1f8bdab56c req-d6b4a1dd-9996-4163-ac7f-7f24d6dc873e service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] No waiting events found dispatching network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:38:50 user nova-compute[75672]: WARNING nova.compute.manager [req-bd66abea-d6ba-4b7b-ac84-5b1f8bdab56c req-d6b4a1dd-9996-4163-ac7f-7f24d6dc873e service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received unexpected event network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe for instance with vm_state active and task_state None.
Nov 30 12:38:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:38:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-73b374af-a22d-4fbd-a6d6-7dc298df2439 req-8de02bc6-37bd-4806-b023-425a93eb5073 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received event network-changed-20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-73b374af-a22d-4fbd-a6d6-7dc298df2439 req-8de02bc6-37bd-4806-b023-425a93eb5073 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Refreshing instance network info cache due to event network-changed-20e0a542-befb-47a2-bc78-f9d4bc75ef67. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:39:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b374af-a22d-4fbd-a6d6-7dc298df2439 req-8de02bc6-37bd-4806-b023-425a93eb5073 service nova] Acquiring lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:39:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b374af-a22d-4fbd-a6d6-7dc298df2439 req-8de02bc6-37bd-4806-b023-425a93eb5073 service nova] Acquired lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:39:05 user nova-compute[75672]: DEBUG nova.network.neutron [req-73b374af-a22d-4fbd-a6d6-7dc298df2439 req-8de02bc6-37bd-4806-b023-425a93eb5073 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Refreshing network info cache for port 20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:39:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Acquiring lock "874354b8-bf12-44d6-86f8-0db17ce28faa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:39:06 user nova-compute[75672]: INFO nova.compute.claims [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Claim successful on node user
Nov 30 12:39:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "interface-f53f77ca-8471-4c62-a779-f64a0a4e57aa-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "interface-f53f77ca-8471-4c62-a779-f64a0a4e57aa-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG nova.objects.instance [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lazy-loading 'flavor' on Instance uuid f53f77ca-8471-4c62-a779-f64a0a4e57aa {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG nova.network.neutron [req-73b374af-a22d-4fbd-a6d6-7dc298df2439 req-8de02bc6-37bd-4806-b023-425a93eb5073 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Updated VIF entry in instance network info cache for port 20e0a542-befb-47a2-bc78-f9d4bc75ef67. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG nova.network.neutron [req-73b374af-a22d-4fbd-a6d6-7dc298df2439 req-8de02bc6-37bd-4806-b023-425a93eb5073 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Updating instance_info_cache with network_info: [{"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b374af-a22d-4fbd-a6d6-7dc298df2439 req-8de02bc6-37bd-4806-b023-425a93eb5073 service nova] Releasing lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG nova.objects.instance [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lazy-loading 'pci_requests' on Instance uuid f53f77ca-8471-4c62-a779-f64a0a4e57aa {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG nova.objects.base [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Object Instance<f53f77ca-8471-4c62-a779-f64a0a4e57aa> lazy-loaded attributes: flavor,pci_requests {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG nova.network.neutron [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG nova.policy [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9544ed3bcf2407fac6a6a41e68e2a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c117afa27d447fd9c8c0eb0d59c5d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:39:06 user nova-compute[75672]: DEBUG nova.network.neutron [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:39:07 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:39:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG nova.policy [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfe9accbc4f04a72adaafd73ca7a8a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65141868c783493d812c3be66128289b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:39:07 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Creating image(s)
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Acquiring lock "/opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "/opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "/opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Successfully created port: 3213551f-b697-44bf-818e-a4fd4cb37e72 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.191s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.187s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Successfully created port: 9f557f6f-c9be-4f0d-be2b-90642b14413a {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk 1073741824" returned: 0 in 0.052s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.182s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Successfully updated port: 3213551f-b697-44bf-818e-a4fd4cb37e72 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquired lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-78e55a37-8606-4706-9d9b-dc5507d033dc req-480f3db9-e1a5-419e-9830-7e991e24a090 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received event network-changed-3213551f-b697-44bf-818e-a4fd4cb37e72 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-78e55a37-8606-4706-9d9b-dc5507d033dc req-480f3db9-e1a5-419e-9830-7e991e24a090 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Refreshing instance network info cache due to event network-changed-3213551f-b697-44bf-818e-a4fd4cb37e72. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-78e55a37-8606-4706-9d9b-dc5507d033dc req-480f3db9-e1a5-419e-9830-7e991e24a090 service nova] Acquiring lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Cannot resize image /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Ensure instance console log exists: /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Successfully updated port: 9f557f6f-c9be-4f0d-be2b-90642b14413a {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Acquiring lock "refresh_cache-874354b8-bf12-44d6-86f8-0db17ce28faa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Acquired lock "refresh_cache-874354b8-bf12-44d6-86f8-0db17ce28faa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-17c5e8fb-8d30-4f1c-ba48-5733fc0f8589 req-a5e9062a-c1b5-4978-ad29-a08213f35e81 service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Received event network-changed-9f557f6f-c9be-4f0d-be2b-90642b14413a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-17c5e8fb-8d30-4f1c-ba48-5733fc0f8589 req-a5e9062a-c1b5-4978-ad29-a08213f35e81 service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Refreshing instance network info cache due to event network-changed-9f557f6f-c9be-4f0d-be2b-90642b14413a. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-17c5e8fb-8d30-4f1c-ba48-5733fc0f8589 req-a5e9062a-c1b5-4978-ad29-a08213f35e81 service nova] Acquiring lock "refresh_cache-874354b8-bf12-44d6-86f8-0db17ce28faa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Updating instance_info_cache with network_info: [{"id": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "address": "fa:16:3e:d6:d0:9c", "network": {"id": "986a6ea8-182e-46a9-bb22-acec28e6fc61", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1467640286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65141868c783493d812c3be66128289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f557f6f-c9", "ovs_interfaceid": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Releasing lock "refresh_cache-874354b8-bf12-44d6-86f8-0db17ce28faa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Instance network_info: |[{"id": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "address": "fa:16:3e:d6:d0:9c", "network": {"id": "986a6ea8-182e-46a9-bb22-acec28e6fc61", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1467640286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65141868c783493d812c3be66128289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f557f6f-c9", "ovs_interfaceid": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-17c5e8fb-8d30-4f1c-ba48-5733fc0f8589 req-a5e9062a-c1b5-4978-ad29-a08213f35e81 service nova] Acquired lock "refresh_cache-874354b8-bf12-44d6-86f8-0db17ce28faa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.neutron [req-17c5e8fb-8d30-4f1c-ba48-5733fc0f8589 req-a5e9062a-c1b5-4978-ad29-a08213f35e81 service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Refreshing network info cache for port 9f557f6f-c9be-4f0d-be2b-90642b14413a {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Start _get_guest_xml network_info=[{"id": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "address": "fa:16:3e:d6:d0:9c", "network": {"id": "986a6ea8-182e-46a9-bb22-acec28e6fc61", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1467640286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65141868c783493d812c3be66128289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f557f6f-c9", "ovs_interfaceid": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:39:08 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:39:08 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:39:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1788780232',display_name='tempest-DeleteServersTestJSON-server-1788780232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1788780232',id=23,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65141868c783493d812c3be66128289b',ramdisk_id='',reservation_id='r-uq1qe90w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1168113283',owner_user_name='tempest-DeleteServersTestJSON-1168113283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:39:07Z,user_data=None,user_id='bfe9accbc4f04a72adaafd73ca7a8a56',uuid=874354b8-bf12-44d6-86f8-0db17ce28faa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "address": "fa:16:3e:d6:d0:9c", "network": {"id": "986a6ea8-182e-46a9-bb22-acec28e6fc61", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1467640286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65141868c783493d812c3be66128289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f557f6f-c9", "ovs_interfaceid": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Converting VIF {"id": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "address": "fa:16:3e:d6:d0:9c", "network": {"id": "986a6ea8-182e-46a9-bb22-acec28e6fc61", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1467640286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65141868c783493d812c3be66128289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f557f6f-c9", "ovs_interfaceid": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9f557f6f-c9be-4f0d-be2b-90642b14413a,network=Network(986a6ea8-182e-46a9-bb22-acec28e6fc61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f557f6f-c9') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.objects.instance [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lazy-loading 'pci_devices' on Instance uuid 874354b8-bf12-44d6-86f8-0db17ce28faa {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:39:08 user nova-compute[75672]:   <uuid>874354b8-bf12-44d6-86f8-0db17ce28faa</uuid>
Nov 30 12:39:08 user nova-compute[75672]:   <name>instance-00000017</name>
Nov 30 12:39:08 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:39:08 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:39:08 user nova-compute[75672]:   <metadata>
Nov 30 12:39:08 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:39:08 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:39:08 user nova-compute[75672]:       <nova:name>tempest-DeleteServersTestJSON-server-1788780232</nova:name>
Nov 30 12:39:08 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:39:08</nova:creationTime>
Nov 30 12:39:08 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:39:08 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:39:08 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:39:08 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:39:08 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:39:08 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:39:08 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:39:08 user nova-compute[75672]:       <nova:owner>
Nov 30 12:39:08 user nova-compute[75672]:         <nova:user uuid="bfe9accbc4f04a72adaafd73ca7a8a56">tempest-DeleteServersTestJSON-1168113283-project-member</nova:user>
Nov 30 12:39:08 user nova-compute[75672]:         <nova:project uuid="65141868c783493d812c3be66128289b">tempest-DeleteServersTestJSON-1168113283</nova:project>
Nov 30 12:39:08 user nova-compute[75672]:       </nova:owner>
Nov 30 12:39:08 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:39:08 user nova-compute[75672]:       <nova:ports>
Nov 30 12:39:08 user nova-compute[75672]:         <nova:port uuid="9f557f6f-c9be-4f0d-be2b-90642b14413a">
Nov 30 12:39:08 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 12:39:08 user nova-compute[75672]:         </nova:port>
Nov 30 12:39:08 user nova-compute[75672]:       </nova:ports>
Nov 30 12:39:08 user nova-compute[75672]:     </nova:instance>
Nov 30 12:39:08 user nova-compute[75672]:   </metadata>
Nov 30 12:39:08 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:39:08 user nova-compute[75672]:     <system>
Nov 30 12:39:08 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:39:08 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:39:08 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:39:08 user nova-compute[75672]:       <entry name="serial">874354b8-bf12-44d6-86f8-0db17ce28faa</entry>
Nov 30 12:39:08 user nova-compute[75672]:       <entry name="uuid">874354b8-bf12-44d6-86f8-0db17ce28faa</entry>
Nov 30 12:39:08 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:39:08 user nova-compute[75672]:     </system>
Nov 30 12:39:08 user nova-compute[75672]:   </sysinfo>
Nov 30 12:39:08 user nova-compute[75672]:   <os>
Nov 30 12:39:08 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:39:08 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:39:08 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:39:08 user nova-compute[75672]:   </os>
Nov 30 12:39:08 user nova-compute[75672]:   <features>
Nov 30 12:39:08 user nova-compute[75672]:     <acpi/>
Nov 30 12:39:08 user nova-compute[75672]:     <apic/>
Nov 30 12:39:08 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:39:08 user nova-compute[75672]:   </features>
Nov 30 12:39:08 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:39:08 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:39:08 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:39:08 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:39:08 user nova-compute[75672]:   </clock>
Nov 30 12:39:08 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:39:08 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:39:08 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:39:08 user nova-compute[75672]:   </cpu>
Nov 30 12:39:08 user nova-compute[75672]:   <devices>
Nov 30 12:39:08 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:39:08 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:39:08 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk"/>
Nov 30 12:39:08 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:39:08 user nova-compute[75672]:     </disk>
Nov 30 12:39:08 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:39:08 user nova-compute[75672]:       <mac address="fa:16:3e:d6:d0:9c"/>
Nov 30 12:39:08 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:39:08 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:39:08 user nova-compute[75672]:       <target dev="tap9f557f6f-c9"/>
Nov 30 12:39:08 user nova-compute[75672]:     </interface>
Nov 30 12:39:08 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:39:08 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/console.log" append="off"/>
Nov 30 12:39:08 user nova-compute[75672]:     </serial>
Nov 30 12:39:08 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:39:08 user nova-compute[75672]:     <video>
Nov 30 12:39:08 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:39:08 user nova-compute[75672]:     </video>
Nov 30 12:39:08 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:39:08 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:39:08 user nova-compute[75672]:     </rng>
Nov 30 12:39:08 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:39:08 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:39:08 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:39:08 user nova-compute[75672]:     </memballoon>
Nov 30 12:39:08 user nova-compute[75672]:   </devices>
Nov 30 12:39:08 user nova-compute[75672]: </domain>
Nov 30 12:39:08 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:39:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1788780232',display_name='tempest-DeleteServersTestJSON-server-1788780232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1788780232',id=23,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65141868c783493d812c3be66128289b',ramdisk_id='',reservation_id='r-uq1qe90w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1168113283',owner_user_name='tempest-DeleteServersTestJSON-1168113283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:39:07Z,user_data=None,user_id='bfe9accbc4f04a72adaafd73ca7a8a56',uuid=874354b8-bf12-44d6-86f8-0db17ce28faa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "address": "fa:16:3e:d6:d0:9c", "network": {"id": "986a6ea8-182e-46a9-bb22-acec28e6fc61", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1467640286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65141868c783493d812c3be66128289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f557f6f-c9", "ovs_interfaceid": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Converting VIF {"id": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "address": "fa:16:3e:d6:d0:9c", "network": {"id": "986a6ea8-182e-46a9-bb22-acec28e6fc61", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1467640286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65141868c783493d812c3be66128289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f557f6f-c9", "ovs_interfaceid": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9f557f6f-c9be-4f0d-be2b-90642b14413a,network=Network(986a6ea8-182e-46a9-bb22-acec28e6fc61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f557f6f-c9') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG os_vif [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9f557f6f-c9be-4f0d-be2b-90642b14413a,network=Network(986a6ea8-182e-46a9-bb22-acec28e6fc61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f557f6f-c9') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '286e0318-ef00-50b9-86e7-05a5141836a1', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f557f6f-c9, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f557f6f-c9, col_values=(('qos', UUID('70ffe18b-e6d7-47c7-a378-fccc53453649')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f557f6f-c9, col_values=(('external_ids', {'iface-id': '9f557f6f-c9be-4f0d-be2b-90642b14413a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:d0:9c', 'vm-uuid': '874354b8-bf12-44d6-86f8-0db17ce28faa'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:08 user nova-compute[75672]: INFO os_vif [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9f557f6f-c9be-4f0d-be2b-90642b14413a,network=Network(986a6ea8-182e-46a9-bb22-acec28e6fc61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f557f6f-c9')
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] No VIF found with MAC fa:16:3e:d6:d0:9c, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.neutron [req-17c5e8fb-8d30-4f1c-ba48-5733fc0f8589 req-a5e9062a-c1b5-4978-ad29-a08213f35e81 service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Updated VIF entry in instance network info cache for port 9f557f6f-c9be-4f0d-be2b-90642b14413a. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.neutron [req-17c5e8fb-8d30-4f1c-ba48-5733fc0f8589 req-a5e9062a-c1b5-4978-ad29-a08213f35e81 service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Updating instance_info_cache with network_info: [{"id": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "address": "fa:16:3e:d6:d0:9c", "network": {"id": "986a6ea8-182e-46a9-bb22-acec28e6fc61", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1467640286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65141868c783493d812c3be66128289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f557f6f-c9", "ovs_interfaceid": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Updating instance_info_cache with network_info: [{"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3213551f-b697-44bf-818e-a4fd4cb37e72", "address": "fa:16:3e:09:e6:5b", "network": {"id": "409a923c-d899-4c3e-850c-1867d39ecd79", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1562327751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3213551f-b6", "ovs_interfaceid": "3213551f-b697-44bf-818e-a4fd4cb37e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-17c5e8fb-8d30-4f1c-ba48-5733fc0f8589 req-a5e9062a-c1b5-4978-ad29-a08213f35e81 service nova] Releasing lock "refresh_cache-874354b8-bf12-44d6-86f8-0db17ce28faa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Releasing lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-78e55a37-8606-4706-9d9b-dc5507d033dc req-480f3db9-e1a5-419e-9830-7e991e24a090 service nova] Acquired lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.neutron [req-78e55a37-8606-4706-9d9b-dc5507d033dc req-480f3db9-e1a5-419e-9830-7e991e24a090 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Refreshing network info cache for port 3213551f-b697-44bf-818e-a4fd4cb37e72 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-128968609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-128968609',id=17,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl6klT0bzM05mjTlIY/+hxTDH4pH81fsasTPeFhXIw9kr7DGRshU4ifFY299yAb2HtCh0ILgMcRORtuH+9N2Hw5W6pQ+sfpRUATNL8WBx7USNA23ssXCHaD8O36MbtQ5g==',key_name='tempest-keypair-2079457822',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:37:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c117afa27d447fd9c8c0eb0d59c5d28',ramdisk_id='',reservation_id='r-j719jspw',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737137422',owner_user_name='tempest-TaggedAttachmentsTest-1737137422-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9544ed3bcf2407fac6a6a41e68e2a9c',uuid=f53f77ca-8471-4c62-a779-f64a0a4e57aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3213551f-b697-44bf-818e-a4fd4cb37e72", "address": "fa:16:3e:09:e6:5b", "network": {"id": "409a923c-d899-4c3e-850c-1867d39ecd79", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1562327751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3213551f-b6", "ovs_interfaceid": "3213551f-b697-44bf-818e-a4fd4cb37e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Converting VIF {"id": "3213551f-b697-44bf-818e-a4fd4cb37e72", "address": "fa:16:3e:09:e6:5b", "network": {"id": "409a923c-d899-4c3e-850c-1867d39ecd79", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1562327751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3213551f-b6", "ovs_interfaceid": "3213551f-b697-44bf-818e-a4fd4cb37e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:e6:5b,bridge_name='br-int',has_traffic_filtering=True,id=3213551f-b697-44bf-818e-a4fd4cb37e72,network=Network(409a923c-d899-4c3e-850c-1867d39ecd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3213551f-b6') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG os_vif [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:e6:5b,bridge_name='br-int',has_traffic_filtering=True,id=3213551f-b697-44bf-818e-a4fd4cb37e72,network=Network(409a923c-d899-4c3e-850c-1867d39ecd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3213551f-b6') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcda9cb7-df93-5d38-ba75-dfe77d4ccf8a', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3213551f-b6, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3213551f-b6, col_values=(('qos', UUID('aeedde85-16ce-4fd4-a1b2-b6897982125a')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3213551f-b6, col_values=(('external_ids', {'iface-id': '3213551f-b697-44bf-818e-a4fd4cb37e72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:e6:5b', 'vm-uuid': 'f53f77ca-8471-4c62-a779-f64a0a4e57aa'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:09 user nova-compute[75672]: INFO os_vif [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:e6:5b,bridge_name='br-int',has_traffic_filtering=True,id=3213551f-b697-44bf-818e-a4fd4cb37e72,network=Network(409a923c-d899-4c3e-850c-1867d39ecd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3213551f-b6')
Nov 30 12:39:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-128968609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-128968609',id=17,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl6klT0bzM05mjTlIY/+hxTDH4pH81fsasTPeFhXIw9kr7DGRshU4ifFY299yAb2HtCh0ILgMcRORtuH+9N2Hw5W6pQ+sfpRUATNL8WBx7USNA23ssXCHaD8O36MbtQ5g==',key_name='tempest-keypair-2079457822',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:37:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c117afa27d447fd9c8c0eb0d59c5d28',ramdisk_id='',reservation_id='r-j719jspw',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737137422',owner_user_name='tempest-TaggedAttachmentsTest-1737137422-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9544ed3bcf2407fac6a6a41e68e2a9c',uuid=f53f77ca-8471-4c62-a779-f64a0a4e57aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3213551f-b697-44bf-818e-a4fd4cb37e72", "address": "fa:16:3e:09:e6:5b", "network": {"id": "409a923c-d899-4c3e-850c-1867d39ecd79", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1562327751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3213551f-b6", "ovs_interfaceid": "3213551f-b697-44bf-818e-a4fd4cb37e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Converting VIF {"id": "3213551f-b697-44bf-818e-a4fd4cb37e72", "address": "fa:16:3e:09:e6:5b", "network": {"id": "409a923c-d899-4c3e-850c-1867d39ecd79", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1562327751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3213551f-b6", "ovs_interfaceid": "3213551f-b697-44bf-818e-a4fd4cb37e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:e6:5b,bridge_name='br-int',has_traffic_filtering=True,id=3213551f-b697-44bf-818e-a4fd4cb37e72,network=Network(409a923c-d899-4c3e-850c-1867d39ecd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3213551f-b6') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] attach device xml: <interface type="ethernet">
Nov 30 12:39:09 user nova-compute[75672]:   <mac address="fa:16:3e:09:e6:5b"/>
Nov 30 12:39:09 user nova-compute[75672]:   <model type="virtio"/>
Nov 30 12:39:09 user nova-compute[75672]:   <mtu size="1442"/>
Nov 30 12:39:09 user nova-compute[75672]:   <target dev="tap3213551f-b6"/>
Nov 30 12:39:09 user nova-compute[75672]: </interface>
Nov 30 12:39:09 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-78e55a37-8606-4706-9d9b-dc5507d033dc req-480f3db9-e1a5-419e-9830-7e991e24a090 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Updated VIF entry in instance network info cache for port 3213551f-b697-44bf-818e-a4fd4cb37e72. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-78e55a37-8606-4706-9d9b-dc5507d033dc req-480f3db9-e1a5-419e-9830-7e991e24a090 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Updating instance_info_cache with network_info: [{"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3213551f-b697-44bf-818e-a4fd4cb37e72", "address": "fa:16:3e:09:e6:5b", "network": {"id": "409a923c-d899-4c3e-850c-1867d39ecd79", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1562327751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3213551f-b6", "ovs_interfaceid": "3213551f-b697-44bf-818e-a4fd4cb37e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-78e55a37-8606-4706-9d9b-dc5507d033dc req-480f3db9-e1a5-419e-9830-7e991e24a090 service nova] Releasing lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] No BDM found with device name hda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] No VIF found with MAC fa:16:3e:ed:94:83, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:39:09 user nova-compute[75672]:   <nova:package version="0.0.0"/>
Nov 30 12:39:09 user nova-compute[75672]:   <nova:name>tempest-device-tagging-server-128968609</nova:name>
Nov 30 12:39:09 user nova-compute[75672]:   <nova:creationTime>2023-11-30 12:39:09</nova:creationTime>
Nov 30 12:39:09 user nova-compute[75672]:   <nova:flavor name="m1.tiny">
Nov 30 12:39:09 user nova-compute[75672]:     <nova:memory>512</nova:memory>
Nov 30 12:39:09 user nova-compute[75672]:     <nova:disk>1</nova:disk>
Nov 30 12:39:09 user nova-compute[75672]:     <nova:swap>0</nova:swap>
Nov 30 12:39:09 user nova-compute[75672]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:39:09 user nova-compute[75672]:     <nova:vcpus>1</nova:vcpus>
Nov 30 12:39:09 user nova-compute[75672]:   </nova:flavor>
Nov 30 12:39:09 user nova-compute[75672]:   <nova:owner>
Nov 30 12:39:09 user nova-compute[75672]:     <nova:user uuid="b9544ed3bcf2407fac6a6a41e68e2a9c">tempest-TaggedAttachmentsTest-1737137422-project-member</nova:user>
Nov 30 12:39:09 user nova-compute[75672]:     <nova:project uuid="3c117afa27d447fd9c8c0eb0d59c5d28">tempest-TaggedAttachmentsTest-1737137422</nova:project>
Nov 30 12:39:09 user nova-compute[75672]:   </nova:owner>
Nov 30 12:39:09 user nova-compute[75672]:   <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:39:09 user nova-compute[75672]:   <nova:ports>
Nov 30 12:39:09 user nova-compute[75672]:     <nova:port uuid="20e0a542-befb-47a2-bc78-f9d4bc75ef67">
Nov 30 12:39:09 user nova-compute[75672]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 12:39:09 user nova-compute[75672]:     </nova:port>
Nov 30 12:39:09 user nova-compute[75672]:     <nova:port uuid="3213551f-b697-44bf-818e-a4fd4cb37e72">
Nov 30 12:39:09 user nova-compute[75672]:       <nova:ip type="fixed" address="10.10.10.222" ipVersion="4"/>
Nov 30 12:39:09 user nova-compute[75672]:     </nova:port>
Nov 30 12:39:09 user nova-compute[75672]:   </nova:ports>
Nov 30 12:39:09 user nova-compute[75672]: </nova:instance>
Nov 30 12:39:09 user nova-compute[75672]:  {{(pid=75672) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-80896824-49f7-4a5c-b10d-cefe383d24e2 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "interface-f53f77ca-8471-4c62-a779-f64a0a4e57aa-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.121s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG nova.objects.instance [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lazy-loading 'flavor' on Instance uuid f53f77ca-8471-4c62-a779-f64a0a4e57aa {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:10 user nova-compute[75672]: INFO nova.compute.manager [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Attaching volume fec3a08d-17ae-41ac-b952-de9d5bfd3616 to /dev/vdb
Nov 30 12:39:10 user nova-compute[75672]: DEBUG os_brick.utils [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d93020a-ba67-4fe2-a2a7-3fbee4e2057e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8158bfb-bebf-423f-a1b8-b3f1d0d45b4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2c6f5a-6f59-4f4e-9d3c-5e04a2341612]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead34152-4c91-4e8c-acde-119d4d998dbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:39:10 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6f2823-89d4-4a27-9af7-e1a7dccefa25]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG os_brick.utils [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Updating existing volume attachment record: 605b986e-f55a-45f6-a8aa-9a35d06beb6b {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG nova.compute.manager [req-59d59a5c-724e-4826-8f23-f9ddad08fb1d req-3d9341f4-ada1-4085-a01a-f39d53768825 service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Received event network-vif-plugged-9f557f6f-c9be-4f0d-be2b-90642b14413a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-59d59a5c-724e-4826-8f23-f9ddad08fb1d req-3d9341f4-ada1-4085-a01a-f39d53768825 service nova] Acquiring lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-59d59a5c-724e-4826-8f23-f9ddad08fb1d req-3d9341f4-ada1-4085-a01a-f39d53768825 service nova] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-59d59a5c-724e-4826-8f23-f9ddad08fb1d req-3d9341f4-ada1-4085-a01a-f39d53768825 service nova] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:10 user nova-compute[75672]: DEBUG nova.compute.manager [req-59d59a5c-724e-4826-8f23-f9ddad08fb1d req-3d9341f4-ada1-4085-a01a-f39d53768825 service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] No waiting events found dispatching network-vif-plugged-9f557f6f-c9be-4f0d-be2b-90642b14413a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:10 user nova-compute[75672]: WARNING nova.compute.manager [req-59d59a5c-724e-4826-8f23-f9ddad08fb1d req-3d9341f4-ada1-4085-a01a-f39d53768825 service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Received unexpected event network-vif-plugged-9f557f6f-c9be-4f0d-be2b-90642b14413a for instance with vm_state building and task_state spawning.
Nov 30 12:39:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-5a31dd59-b6ff-4c55-93cc-1688f9d47283 req-259a6c44-18ab-4e7c-8f8a-be3eb9dbf8df service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received event network-vif-plugged-3213551f-b697-44bf-818e-a4fd4cb37e72 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5a31dd59-b6ff-4c55-93cc-1688f9d47283 req-259a6c44-18ab-4e7c-8f8a-be3eb9dbf8df service nova] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5a31dd59-b6ff-4c55-93cc-1688f9d47283 req-259a6c44-18ab-4e7c-8f8a-be3eb9dbf8df service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5a31dd59-b6ff-4c55-93cc-1688f9d47283 req-259a6c44-18ab-4e7c-8f8a-be3eb9dbf8df service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-5a31dd59-b6ff-4c55-93cc-1688f9d47283 req-259a6c44-18ab-4e7c-8f8a-be3eb9dbf8df service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] No waiting events found dispatching network-vif-plugged-3213551f-b697-44bf-818e-a4fd4cb37e72 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:11 user nova-compute[75672]: WARNING nova.compute.manager [req-5a31dd59-b6ff-4c55-93cc-1688f9d47283 req-259a6c44-18ab-4e7c-8f8a-be3eb9dbf8df service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received unexpected event network-vif-plugged-3213551f-b697-44bf-818e-a4fd4cb37e72 for instance with vm_state active and task_state None.
Nov 30 12:39:12 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:39:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:39:12 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Instance spawned successfully.
Nov 30 12:39:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:39:12 user nova-compute[75672]: DEBUG nova.compute.manager [req-c7096c42-ce58-49dc-b974-ebdb13b5f28c req-a0f77bb3-1fc7-4acd-85e8-7ea7080aad70 service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Received event network-vif-plugged-9f557f6f-c9be-4f0d-be2b-90642b14413a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c7096c42-ce58-49dc-b974-ebdb13b5f28c req-a0f77bb3-1fc7-4acd-85e8-7ea7080aad70 service nova] Acquiring lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c7096c42-ce58-49dc-b974-ebdb13b5f28c req-a0f77bb3-1fc7-4acd-85e8-7ea7080aad70 service nova] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c7096c42-ce58-49dc-b974-ebdb13b5f28c req-a0f77bb3-1fc7-4acd-85e8-7ea7080aad70 service nova] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:12 user nova-compute[75672]: DEBUG nova.compute.manager [req-c7096c42-ce58-49dc-b974-ebdb13b5f28c req-a0f77bb3-1fc7-4acd-85e8-7ea7080aad70 service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] No waiting events found dispatching network-vif-plugged-9f557f6f-c9be-4f0d-be2b-90642b14413a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:12 user nova-compute[75672]: WARNING nova.compute.manager [req-c7096c42-ce58-49dc-b974-ebdb13b5f28c req-a0f77bb3-1fc7-4acd-85e8-7ea7080aad70 service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Received unexpected event network-vif-plugged-9f557f6f-c9be-4f0d-be2b-90642b14413a for instance with vm_state building and task_state spawning.
Nov 30 12:39:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:39:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:39:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:39:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:39:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:39:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:39:12 user nova-compute[75672]: INFO nova.compute.manager [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 30 12:39:12 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:39:12 user nova-compute[75672]: INFO nova.compute.manager [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Took 6.51 seconds to build instance.
Nov 30 12:39:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95b82782-02f9-4726-8d1a-a656517bfec0 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.614s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-fb68e0e1-426d-40b8-99fd-1cbb609f1be6 req-8a12e0a9-1193-4890-ac9c-792e5c41fb59 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received event network-vif-plugged-3213551f-b697-44bf-818e-a4fd4cb37e72 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fb68e0e1-426d-40b8-99fd-1cbb609f1be6 req-8a12e0a9-1193-4890-ac9c-792e5c41fb59 service nova] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fb68e0e1-426d-40b8-99fd-1cbb609f1be6 req-8a12e0a9-1193-4890-ac9c-792e5c41fb59 service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fb68e0e1-426d-40b8-99fd-1cbb609f1be6 req-8a12e0a9-1193-4890-ac9c-792e5c41fb59 service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-fb68e0e1-426d-40b8-99fd-1cbb609f1be6 req-8a12e0a9-1193-4890-ac9c-792e5c41fb59 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] No waiting events found dispatching network-vif-plugged-3213551f-b697-44bf-818e-a4fd4cb37e72 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:13 user nova-compute[75672]: WARNING nova.compute.manager [req-fb68e0e1-426d-40b8-99fd-1cbb609f1be6 req-8a12e0a9-1193-4890-ac9c-792e5c41fb59 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received unexpected event network-vif-plugged-3213551f-b697-44bf-818e-a4fd4cb37e72 for instance with vm_state active and task_state None.
Nov 30 12:39:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:15 user nova-compute[75672]: INFO nova.compute.manager [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Terminating instance
Nov 30 12:39:15 user nova-compute[75672]: DEBUG nova.compute.manager [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG nova.compute.manager [req-d87b934a-fcab-4076-9efd-c247187abc3b req-f409ffe6-261a-4824-83ae-52eb842ff444 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-changed-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG nova.compute.manager [req-d87b934a-fcab-4076-9efd-c247187abc3b req-f409ffe6-261a-4824-83ae-52eb842ff444 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Refreshing instance network info cache due to event network-changed-955b65e8-9d92-4ba6-a330-7ca8fd6433ca. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d87b934a-fcab-4076-9efd-c247187abc3b req-f409ffe6-261a-4824-83ae-52eb842ff444 service nova] Acquiring lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d87b934a-fcab-4076-9efd-c247187abc3b req-f409ffe6-261a-4824-83ae-52eb842ff444 service nova] Acquired lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG nova.network.neutron [req-d87b934a-fcab-4076-9efd-c247187abc3b req-f409ffe6-261a-4824-83ae-52eb842ff444 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Refreshing network info cache for port 955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:39:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG nova.network.neutron [req-d87b934a-fcab-4076-9efd-c247187abc3b req-f409ffe6-261a-4824-83ae-52eb842ff444 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updated VIF entry in instance network info cache for port 955b65e8-9d92-4ba6-a330-7ca8fd6433ca. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG nova.network.neutron [req-d87b934a-fcab-4076-9efd-c247187abc3b req-f409ffe6-261a-4824-83ae-52eb842ff444 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updating instance_info_cache with network_info: [{"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d87b934a-fcab-4076-9efd-c247187abc3b req-f409ffe6-261a-4824-83ae-52eb842ff444 service nova] Releasing lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:39:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Instance destroyed successfully.
Nov 30 12:39:16 user nova-compute[75672]: DEBUG nova.objects.instance [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'resources' on Instance uuid 4382544b-6fb7-4164-9b6b-302a6e24bc52 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-711672773',display_name='tempest-TestMinimumBasicScenario-server-711672773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-711672773',id=14,image_ref='c866fbbf-29c3-4e1b-8464-0648755b20e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOniC84tdYnYlJswjjRC4kKmNmB0tBzcdJaPVjXX2wcc4T+DibHFv1jYbqqzIDwZXYmRjVVueGyQD3b6liZnaDVWOLMtKxt+1Icj/6dsoFWFdwDT8Mgl2jBx4KBOz3cFsQ==',key_name='tempest-TestMinimumBasicScenario-2113508187',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:34:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc2e7dfcbff457c9e394b1e5d0d23e6',ramdisk_id='',reservation_id='r-ekl1jzdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c866fbbf-29c3-4e1b-8464-0648755b20e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-950497565',owner_user_name='tempest-TestMinimumBasicScenario-950497565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:36:34Z,user_data=None,user_id='c663fb001aa64ec6a8e5861449ec2bbb',uuid=4382544b-6fb7-4164-9b6b-302a6e24bc52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converting VIF {"id": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "address": "fa:16:3e:5b:7d:cb", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd229eaa1-29", "ovs_interfaceid": "d229eaa1-29dc-4b3f-b468-d5a8f24d7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:7d:cb,bridge_name='br-int',has_traffic_filtering=True,id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd229eaa1-29') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG os_vif [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:7d:cb,bridge_name='br-int',has_traffic_filtering=True,id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd229eaa1-29') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd229eaa1-29, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2b259b9-e507-48c8-bf0f-b5e2eb191921) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:16 user nova-compute[75672]: INFO os_vif [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:7d:cb,bridge_name='br-int',has_traffic_filtering=True,id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd229eaa1-29')
Nov 30 12:39:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Deleting instance files /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52_del
Nov 30 12:39:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Deletion of /opt/stack/data/nova/instances/4382544b-6fb7-4164-9b6b-302a6e24bc52_del complete
Nov 30 12:39:16 user nova-compute[75672]: INFO nova.compute.manager [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 30 12:39:16 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:39:16 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Took 0.50 seconds to deallocate network for instance.
Nov 30 12:39:16 user nova-compute[75672]: DEBUG nova.compute.manager [req-7d13069a-f76d-4aed-9a9f-9d239f0d1fc2 req-0b1b86db-1bb3-476b-81bf-08f4e90cb344 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received event network-vif-deleted-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:16 user nova-compute[75672]: INFO nova.compute.manager [req-7d13069a-f76d-4aed-9a9f-9d239f0d1fc2 req-0b1b86db-1bb3-476b-81bf-08f4e90cb344 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Neutron deleted interface d229eaa1-29dc-4b3f-b468-d5a8f24d7514; detaching it from the instance and deleting it from the info cache
Nov 30 12:39:16 user nova-compute[75672]: DEBUG nova.network.neutron [req-7d13069a-f76d-4aed-9a9f-9d239f0d1fc2 req-0b1b86db-1bb3-476b-81bf-08f4e90cb344 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG nova.compute.manager [req-7d13069a-f76d-4aed-9a9f-9d239f0d1fc2 req-0b1b86db-1bb3-476b-81bf-08f4e90cb344 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Detach interface failed, port_id=d229eaa1-29dc-4b3f-b468-d5a8f24d7514, reason: Instance 4382544b-6fb7-4164-9b6b-302a6e24bc52 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:17 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:39:17 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:39:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:17 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Deleted allocations for instance 4382544b-6fb7-4164-9b6b-302a6e24bc52
Nov 30 12:39:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-786d081d-07be-4d13-a324-ecad43dd8683 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.142s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:17 user nova-compute[75672]: DEBUG nova.compute.manager [req-06f8b852-fe0f-48e3-b930-a3dfb25c6bd6 req-27d57070-801c-48b6-b578-7d2d82a51534 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received event network-vif-unplugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06f8b852-fe0f-48e3-b930-a3dfb25c6bd6 req-27d57070-801c-48b6-b578-7d2d82a51534 service nova] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06f8b852-fe0f-48e3-b930-a3dfb25c6bd6 req-27d57070-801c-48b6-b578-7d2d82a51534 service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06f8b852-fe0f-48e3-b930-a3dfb25c6bd6 req-27d57070-801c-48b6-b578-7d2d82a51534 service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:17 user nova-compute[75672]: DEBUG nova.compute.manager [req-06f8b852-fe0f-48e3-b930-a3dfb25c6bd6 req-27d57070-801c-48b6-b578-7d2d82a51534 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] No waiting events found dispatching network-vif-unplugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:17 user nova-compute[75672]: WARNING nova.compute.manager [req-06f8b852-fe0f-48e3-b930-a3dfb25c6bd6 req-27d57070-801c-48b6-b578-7d2d82a51534 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received unexpected event network-vif-unplugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 for instance with vm_state deleted and task_state None.
Nov 30 12:39:17 user nova-compute[75672]: DEBUG nova.compute.manager [req-06f8b852-fe0f-48e3-b930-a3dfb25c6bd6 req-27d57070-801c-48b6-b578-7d2d82a51534 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received event network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06f8b852-fe0f-48e3-b930-a3dfb25c6bd6 req-27d57070-801c-48b6-b578-7d2d82a51534 service nova] Acquiring lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06f8b852-fe0f-48e3-b930-a3dfb25c6bd6 req-27d57070-801c-48b6-b578-7d2d82a51534 service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-06f8b852-fe0f-48e3-b930-a3dfb25c6bd6 req-27d57070-801c-48b6-b578-7d2d82a51534 service nova] Lock "4382544b-6fb7-4164-9b6b-302a6e24bc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:17 user nova-compute[75672]: DEBUG nova.compute.manager [req-06f8b852-fe0f-48e3-b930-a3dfb25c6bd6 req-27d57070-801c-48b6-b578-7d2d82a51534 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] No waiting events found dispatching network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:17 user nova-compute[75672]: WARNING nova.compute.manager [req-06f8b852-fe0f-48e3-b930-a3dfb25c6bd6 req-27d57070-801c-48b6-b578-7d2d82a51534 service nova] [instance: 4382544b-6fb7-4164-9b6b-302a6e24bc52] Received unexpected event network-vif-plugged-d229eaa1-29dc-4b3f-b468-d5a8f24d7514 for instance with vm_state deleted and task_state None.
Nov 30 12:39:19 user nova-compute[75672]: DEBUG nova.compute.manager [req-c1dae19d-2183-4761-bad5-8f4fb19fca39 req-f3a47942-6658-48e5-aaff-501a7be3312a service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received event network-changed-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:19 user nova-compute[75672]: DEBUG nova.compute.manager [req-c1dae19d-2183-4761-bad5-8f4fb19fca39 req-f3a47942-6658-48e5-aaff-501a7be3312a service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Refreshing instance network info cache due to event network-changed-b14a6da4-b394-4ecc-bdbb-483cdbd2c581. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:39:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c1dae19d-2183-4761-bad5-8f4fb19fca39 req-f3a47942-6658-48e5-aaff-501a7be3312a service nova] Acquiring lock "refresh_cache-3df9c388-08c6-4153-9666-8e492acda60c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:39:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c1dae19d-2183-4761-bad5-8f4fb19fca39 req-f3a47942-6658-48e5-aaff-501a7be3312a service nova] Acquired lock "refresh_cache-3df9c388-08c6-4153-9666-8e492acda60c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:39:19 user nova-compute[75672]: DEBUG nova.network.neutron [req-c1dae19d-2183-4761-bad5-8f4fb19fca39 req-f3a47942-6658-48e5-aaff-501a7be3312a service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Refreshing network info cache for port b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG nova.network.neutron [req-c1dae19d-2183-4761-bad5-8f4fb19fca39 req-f3a47942-6658-48e5-aaff-501a7be3312a service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Updated VIF entry in instance network info cache for port b14a6da4-b394-4ecc-bdbb-483cdbd2c581. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG nova.network.neutron [req-c1dae19d-2183-4761-bad5-8f4fb19fca39 req-f3a47942-6658-48e5-aaff-501a7be3312a service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Updating instance_info_cache with network_info: [{"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c1dae19d-2183-4761-bad5-8f4fb19fca39 req-f3a47942-6658-48e5-aaff-501a7be3312a service nova] Releasing lock "refresh_cache-3df9c388-08c6-4153-9666-8e492acda60c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lPUZmgCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:39:20 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:39:20 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:39:20 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df222c0-7821-4e8f-9474-0dae029b7d9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:39:20 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[285a3c3f-2a9a-40b0-adae-62d52732422e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616] added
Nov 30 12:39:20 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0f3ec3-c26c-4eb8-842a-b202acf385dd]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[555e467b-437e-4181-835f-89c96292ba26]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lPUZmgCW {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lPUZmgCW" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af42d56-15a2-48d3-bd28-12003da1fc04]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lPUZmgCW'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e473629-e564-4881-b9b6-edc80740d387]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9908c0-7e4b-4c36-92aa-43a9de2a3482]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:39:20 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:39:20 user nova-compute[75672]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:20 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:39:20 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:39:20 user nova-compute[75672]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:20 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf9a687-a84d-4c96-9910-94a5c4714c8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616, portal: 172.16.0.220,3260]
Nov 30 12:39:20 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616, portal: 172.16.0.220,3260] successful.
Nov 30 12:39:20 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8238b708-c113-4089-8ce7-4d7b8c1670ea]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:20 user nova-compute[75672]: INFO nova.compute.manager [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Rebuilding instance
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6ac6ea-f4ee-4511-a642-f5fbbcb8f9fd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:39:20 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:39:20 user nova-compute[75672]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:20 user nova-compute[75672]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)
Nov 30 12:39:20 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:39:20 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:39:20 user nova-compute[75672]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:20 user nova-compute[75672]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)
Nov 30 12:39:20 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fe4478-f4cb-4725-8249-a814c9fbeb65]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lPUZmgCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG nova.compute.manager [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-eeb493d5-e389-46cb-a42b-5e7eaea2fab4 req-fcb7b767-e1c3-4231-8598-58c627cccef0 service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received event network-vif-unplugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-eeb493d5-e389-46cb-a42b-5e7eaea2fab4 req-fcb7b767-e1c3-4231-8598-58c627cccef0 service nova] Acquiring lock "3df9c388-08c6-4153-9666-8e492acda60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-eeb493d5-e389-46cb-a42b-5e7eaea2fab4 req-fcb7b767-e1c3-4231-8598-58c627cccef0 service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-eeb493d5-e389-46cb-a42b-5e7eaea2fab4 req-fcb7b767-e1c3-4231-8598-58c627cccef0 service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-eeb493d5-e389-46cb-a42b-5e7eaea2fab4 req-fcb7b767-e1c3-4231-8598-58c627cccef0 service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] No waiting events found dispatching network-vif-unplugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:21 user nova-compute[75672]: WARNING nova.compute.manager [req-eeb493d5-e389-46cb-a42b-5e7eaea2fab4 req-fcb7b767-e1c3-4231-8598-58c627cccef0 service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received unexpected event network-vif-unplugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 for instance with vm_state active and task_state rebuilding.
Nov 30 12:39:21 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Instance destroyed successfully.
Nov 30 12:39:21 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Instance destroyed successfully.
Nov 30 12:39:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-67116884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1014565837',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxVNzI61C+OsJEwoPnrmP+C9u0Q3vxKD7EbOWbJUoD3wO5iAP3H5v2ErA0fq8PwQEvcEJsCQLdoim+V3xyoHIeOXDIbKXCEfzED1p1bzn0arLa41lNMTF7Ls62V6j5bJQ==',key_name='tempest-keypair-224557939',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:37:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c7e24ecd9d04dd4b8bccda3e63fa11d',ramdisk_id='',reservation_id='r-1br6g41s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-679548509',owner_user_name='tempest-ServerActionsV293TestJSON-679548509-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8b5b87badbf493088f822838b837eb2',uuid=3df9c388-08c6-4153-9666-8e492acda60c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Converting VIF {"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=b14a6da4-b394-4ecc-bdbb-483cdbd2c581,network=Network(38c2361b-fa3a-44d1-9764-a4a7a9af6d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14a6da4-b3') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_vif [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=b14a6da4-b394-4ecc-bdbb-483cdbd2c581,network=Network(38c2361b-fa3a-44d1-9764-a4a7a9af6d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14a6da4-b3') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb14a6da4-b3, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfa01df5-2c7a-4095-9bbe-4eade823dd6f) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:21 user nova-compute[75672]: INFO os_vif [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=b14a6da4-b394-4ecc-bdbb-483cdbd2c581,network=Network(38c2361b-fa3a-44d1-9764-a4a7a9af6d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14a6da4-b3')
Nov 30 12:39:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lmCEdvRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:39:21 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23530663035653866', 'path': '/dev/sdc'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530663035653866', 'path': '/dev/sdc'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.069s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG nova.objects.instance [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lazy-loading 'flavor' on Instance uuid f53f77ca-8471-4c62-a779-f64a0a4e57aa {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e7c559-2cb1-4b7d-98f5-577f5db20b7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:39:21 user nova-compute[75672]: No targets found.
Nov 30 12:39:21 user nova-compute[75672]: iSNS:
Nov 30 12:39:21 user nova-compute[75672]: No targets found.
Nov 30 12:39:21 user nova-compute[75672]: STATIC:
Nov 30 12:39:21 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74
Nov 30 12:39:21 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:39:21 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:39:21 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616
Nov 30 12:39:21 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:39:21 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:39:21 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224
Nov 30 12:39:21 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:39:21 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:39:21 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721
Nov 30 12:39:21 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:39:21 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:39:21 user nova-compute[75672]: FIRMWARE:
Nov 30 12:39:21 user nova-compute[75672]: No targets found.
Nov 30 12:39:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:39:21 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:39:21 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc765984-6670-42dd-adac-d82ba2dc6041]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:39:21 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:39:21 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 12:39:21 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:39:21 user nova-compute[75672]:   <serial>fec3a08d-17ae-41ac-b952-de9d5bfd3616</serial>
Nov 30 12:39:21 user nova-compute[75672]: </disk>
Nov 30 12:39:21 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1c1b91-265a-42e7-9e7a-5c2a6e1062a2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:39:21 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:39:21 user nova-compute[75672]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:21 user nova-compute[75672]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)
Nov 30 12:39:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:39:21 user nova-compute[75672]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:39:21 user nova-compute[75672]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:21 user nova-compute[75672]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)
Nov 30 12:39:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd42be0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224'): ({'sdd'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Removing single pathed devices sdd {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7872bc1e-3c33-4747-a519-acd7db45a220]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bd8e6a-0021-4f33-96b3-6ae64d6a79ec]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Flushing IO for device /dev/sdd {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de5eafc-488d-4d0a-ad35-efc79bdc44d3]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.062s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9c0076-f82a-4db5-9cac-4cd5ab09f134]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] SCSI volumes sdd have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[08433297-1be3-42a9-84e9-f244b6f017a8]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdabae6b-bc47-4304-93b5-ac42366f586d]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260]
Nov 30 12:39:22 user nova-compute[75672]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260] successful.
Nov 30 12:39:22 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe4154c-aacb-40a3-8aaa-8f68f0f64841]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] <== disconnect_volume: return (409ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:39:22 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Deleting instance files /opt/stack/data/nova/instances/3df9c388-08c6-4153-9666-8e492acda60c_del
Nov 30 12:39:22 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Deletion of /opt/stack/data/nova/instances/3df9c388-08c6-4153-9666-8e492acda60c_del complete
Nov 30 12:39:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] No BDM found with device name hda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] No VIF found with MAC fa:16:3e:ed:94:83, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:39:22 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 3df9c388-08c6-4153-9666-8e492acda60c could not be found.
Nov 30 12:39:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lmCEdvRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:39:22 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bfb56e25-2598-4186-b0db-563caa27a1bd tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.294s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d546c8a-e897-45ad-b529-35a1b2df3e9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:39:22 user nova-compute[75672]: No targets found.
Nov 30 12:39:22 user nova-compute[75672]: iSNS:
Nov 30 12:39:22 user nova-compute[75672]: No targets found.
Nov 30 12:39:22 user nova-compute[75672]: STATIC:
Nov 30 12:39:22 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74
Nov 30 12:39:22 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:39:22 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:39:22 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616
Nov 30 12:39:22 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:39:22 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:39:22 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721
Nov 30 12:39:22 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:39:22 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:39:22 user nova-compute[75672]: FIRMWARE:
Nov 30 12:39:22 user nova-compute[75672]: No targets found.
Nov 30 12:39:22 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:39:22 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:39:22 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d24d2c-80a8-4166-87af-75340db59613]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3bb0eb-76ad-4e36-bd16-5b736c8efd68]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:39:22 user nova-compute[75672]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:22 user nova-compute[75672]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)
Nov 30 12:39:22 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:39:22 user nova-compute[75672]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:22 user nova-compute[75672]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)
Nov 30 12:39:22 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd4327ac0>, {}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Disconnecting from: [] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] <== disconnect_volume: return (72ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:39:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:39:23 user nova-compute[75672]: DEBUG nova.compute.manager [req-065541f4-8870-40f6-ade1-5683dd7b58ba req-d3c7705d-f480-448c-9b83-c8ae414e5e23 service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received event network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-065541f4-8870-40f6-ade1-5683dd7b58ba req-d3c7705d-f480-448c-9b83-c8ae414e5e23 service nova] Acquiring lock "3df9c388-08c6-4153-9666-8e492acda60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-065541f4-8870-40f6-ade1-5683dd7b58ba req-d3c7705d-f480-448c-9b83-c8ae414e5e23 service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-065541f4-8870-40f6-ade1-5683dd7b58ba req-d3c7705d-f480-448c-9b83-c8ae414e5e23 service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:23 user nova-compute[75672]: DEBUG nova.compute.manager [req-065541f4-8870-40f6-ade1-5683dd7b58ba req-d3c7705d-f480-448c-9b83-c8ae414e5e23 service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] No waiting events found dispatching network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:23 user nova-compute[75672]: WARNING nova.compute.manager [req-065541f4-8870-40f6-ade1-5683dd7b58ba req-d3c7705d-f480-448c-9b83-c8ae414e5e23 service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received unexpected event network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 for instance with vm_state active and task_state rebuilding.
Nov 30 12:39:23 user nova-compute[75672]: DEBUG nova.compute.manager [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Preparing to wait for external event volume-reimaged-9764ed21-1fb1-4191-abba-933061358224 {{(pid=75672) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 30 12:39:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "3df9c388-08c6-4153-9666-8e492acda60c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:23 user nova-compute[75672]: INFO nova.compute.manager [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Detaching volume fec3a08d-17ae-41ac-b952-de9d5bfd3616
Nov 30 12:39:23 user nova-compute[75672]: INFO nova.virt.block_device [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Attempting to driver detach volume fec3a08d-17ae-41ac-b952-de9d5bfd3616 from mountpoint /dev/vdb
Nov 30 12:39:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Attempting to detach device vdb from instance f53f77ca-8471-4c62-a779-f64a0a4e57aa from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:39:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:39:23 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:39:23 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 12:39:23 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:39:23 user nova-compute[75672]:   <serial>fec3a08d-17ae-41ac-b952-de9d5bfd3616</serial>
Nov 30 12:39:23 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 12:39:23 user nova-compute[75672]: </disk>
Nov 30 12:39:23 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:39:23 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Successfully detached device vdb from instance f53f77ca-8471-4c62-a779-f64a0a4e57aa from the persistent domain config.
Nov 30 12:39:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f53f77ca-8471-4c62-a779-f64a0a4e57aa from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:39:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:39:23 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:39:23 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 12:39:23 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:39:23 user nova-compute[75672]:   <serial>fec3a08d-17ae-41ac-b952-de9d5bfd3616</serial>
Nov 30 12:39:23 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 12:39:23 user nova-compute[75672]: </disk>
Nov 30 12:39:23 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:24 user nova-compute[75672]: INFO nova.compute.manager [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Terminating instance
Nov 30 12:39:24 user nova-compute[75672]: DEBUG nova.compute.manager [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f53f77ca-8471-4c62-a779-f64a0a4e57aa {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-a43f1efb-a8f7-42e3-886c-a9c8ea7a382a req-c0e11981-0f91-4225-959b-19ff887cd29c service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Received event network-vif-unplugged-31ba46ba-f0ae-40d4-ac4b-7914275839bb {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a43f1efb-a8f7-42e3-886c-a9c8ea7a382a req-c0e11981-0f91-4225-959b-19ff887cd29c service nova] Acquiring lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a43f1efb-a8f7-42e3-886c-a9c8ea7a382a req-c0e11981-0f91-4225-959b-19ff887cd29c service nova] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a43f1efb-a8f7-42e3-886c-a9c8ea7a382a req-c0e11981-0f91-4225-959b-19ff887cd29c service nova] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-a43f1efb-a8f7-42e3-886c-a9c8ea7a382a req-c0e11981-0f91-4225-959b-19ff887cd29c service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] No waiting events found dispatching network-vif-unplugged-31ba46ba-f0ae-40d4-ac4b-7914275839bb {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-a43f1efb-a8f7-42e3-886c-a9c8ea7a382a req-c0e11981-0f91-4225-959b-19ff887cd29c service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Received event network-vif-unplugged-31ba46ba-f0ae-40d4-ac4b-7914275839bb for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:39:24 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Instance destroyed successfully.
Nov 30 12:39:24 user nova-compute[75672]: DEBUG nova.objects.instance [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lazy-loading 'resources' on Instance uuid 33acdb4c-16f6-4873-9af8-6297cbfda1c1 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1277170596',display_name='tempest-TestVolumeBootPattern-server-1277170596',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1277170596',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:37:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-8jb7dkaj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:37:58Z,user_data=None,user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=33acdb4c-16f6-4873-9af8-6297cbfda1c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "address": "fa:16:3e:83:62:dc", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ba46ba-f0", "ovs_interfaceid": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "address": "fa:16:3e:83:62:dc", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ba46ba-f0", "ovs_interfaceid": "31ba46ba-f0ae-40d4-ac4b-7914275839bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:62:dc,bridge_name='br-int',has_traffic_filtering=True,id=31ba46ba-f0ae-40d4-ac4b-7914275839bb,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ba46ba-f0') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG os_vif [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:62:dc,bridge_name='br-int',has_traffic_filtering=True,id=31ba46ba-f0ae-40d4-ac4b-7914275839bb,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ba46ba-f0') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31ba46ba-f0, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=838c58b6-d0ec-415d-b6b0-3d0031b97e3a) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:24 user nova-compute[75672]: INFO os_vif [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:62:dc,bridge_name='br-int',has_traffic_filtering=True,id=31ba46ba-f0ae-40d4-ac4b-7914275839bb,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ba46ba-f0')
Nov 30 12:39:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUaTYJEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:39:24 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:39:24 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc85765e-23d7-4963-829a-e8c8ac5a0612]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:39:24 user nova-compute[75672]: No targets found.
Nov 30 12:39:24 user nova-compute[75672]: iSNS:
Nov 30 12:39:24 user nova-compute[75672]: No targets found.
Nov 30 12:39:24 user nova-compute[75672]: STATIC:
Nov 30 12:39:24 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74
Nov 30 12:39:24 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:39:24 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:39:24 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616
Nov 30 12:39:24 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:39:24 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:39:24 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721
Nov 30 12:39:24 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:39:24 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:39:24 user nova-compute[75672]: FIRMWARE:
Nov 30 12:39:24 user nova-compute[75672]: No targets found.
Nov 30 12:39:24 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:39:24 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:39:24 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f799dc6-4b38-45a0-b374-fe52108b6a4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d593c249-f244-4465-9293-3ea8660b0bf3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:39:24 user nova-compute[75672]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:24 user nova-compute[75672]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)
Nov 30 12:39:24 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 (non-flash)
Nov 30 12:39:24 user nova-compute[75672]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:24 user nova-compute[75672]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)
Nov 30 12:39:24 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcf4121bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74'): ({'sde'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Removing single pathed devices sde {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[89409091-6389-4879-87e8-82e7537b112a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d39d441-c007-4891-9455-a2055cab3564]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flushing IO for device /dev/sde {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89f3042-7cd7-4c99-b4ee-3340746ef68e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c4a56b-2eb0-4d40-928e-b2ab526368c4]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] SCSI volumes sde have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9f37de3a',) {{(pid=86963) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdae89f8-6e93-4d70-9785-847607b76a81]: (4, None) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb5e2ac-5262-450b-991e-74a36b885cfe]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[17786fbf-169b-4dd3-b3c2-805b53408713]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74, portal: 172.16.0.220,3260]
Nov 30 12:39:25 user nova-compute[75672]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74, portal: 172.16.0.220,3260] successful.
Nov 30 12:39:25 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc273595-e59e-4674-a96a-d1fb5628fc74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[66213bc5-9a39-48fc-8302-cc51e40e6ac9]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== disconnect_volume: return (314ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:39:25 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Deleting instance files /opt/stack/data/nova/instances/33acdb4c-16f6-4873-9af8-6297cbfda1c1_del
Nov 30 12:39:25 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Deletion of /opt/stack/data/nova/instances/33acdb4c-16f6-4873-9af8-6297cbfda1c1_del complete
Nov 30 12:39:25 user nova-compute[75672]: INFO nova.compute.manager [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 30 12:39:25 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:39:25 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:39:25 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Took 0.61 seconds to deallocate network for instance.
Nov 30 12:39:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-216c4f7e-4297-497c-aaa9-b7d2f6d7cd97 req-9985fc82-4819-474c-8dbb-445a10f4ba18 service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Received event network-vif-plugged-31ba46ba-f0ae-40d4-ac4b-7914275839bb {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-216c4f7e-4297-497c-aaa9-b7d2f6d7cd97 req-9985fc82-4819-474c-8dbb-445a10f4ba18 service nova] Acquiring lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-216c4f7e-4297-497c-aaa9-b7d2f6d7cd97 req-9985fc82-4819-474c-8dbb-445a10f4ba18 service nova] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-216c4f7e-4297-497c-aaa9-b7d2f6d7cd97 req-9985fc82-4819-474c-8dbb-445a10f4ba18 service nova] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-216c4f7e-4297-497c-aaa9-b7d2f6d7cd97 req-9985fc82-4819-474c-8dbb-445a10f4ba18 service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] No waiting events found dispatching network-vif-plugged-31ba46ba-f0ae-40d4-ac4b-7914275839bb {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:26 user nova-compute[75672]: WARNING nova.compute.manager [req-216c4f7e-4297-497c-aaa9-b7d2f6d7cd97 req-9985fc82-4819-474c-8dbb-445a10f4ba18 service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Received unexpected event network-vif-plugged-31ba46ba-f0ae-40d4-ac4b-7914275839bb for instance with vm_state active and task_state deleting.
Nov 30 12:39:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-216c4f7e-4297-497c-aaa9-b7d2f6d7cd97 req-9985fc82-4819-474c-8dbb-445a10f4ba18 service nova] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Received event network-vif-deleted-31ba46ba-f0ae-40d4-ac4b-7914275839bb {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:26 user nova-compute[75672]: INFO nova.compute.manager [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Took 0.82 seconds to detach 1 volumes for instance.
Nov 30 12:39:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 33acdb4c-16f6-4873-9af8-6297cbfda1c1] Deleting volume: dc273595-e59e-4674-a96a-d1fb5628fc74 {{(pid=75672) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 12:39:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:27 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:39:27 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:39:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:27 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Deleted allocations for instance 33acdb4c-16f6-4873-9af8-6297cbfda1c1
Nov 30 12:39:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-57422863-7be4-407e-acd1-c339cbea52c6 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "33acdb4c-16f6-4873-9af8-6297cbfda1c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.217s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:31 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:39:31 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:39:31 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 12:39:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:39:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:39:31 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:39:31 user nova-compute[75672]: DEBUG nova.objects.instance [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lazy-loading 'info_cache' on Instance uuid 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:32 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Updating instance_info_cache with network_info: [{"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:39:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:39:32 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:39:32 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:39:32 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:39:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:35 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:39:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:35 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:39:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:39:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:40 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:39:40 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:39:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7374MB free_disk=25.24429702758789GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 1fba8af1-8074-4ce8-be23-912e9850fc41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 3338ed96-33ff-45e6-b3da-05fbb242a3a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f53f77ca-8471-4c62-a779-f64a0a4e57aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 3df9c388-08c6-4153-9666-8e492acda60c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 492a3775-dc6e-4c94-9ce0-26bc2da43e24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 874354b8-bf12-44d6-86f8-0db17ce28faa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:39:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:41 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:39:41 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:39:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:39:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.760s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:41 user nova-compute[75672]: DEBUG nova.compute.manager [req-18fabc27-ccfc-40e7-a2e6-bea710041d08 req-fde68029-3b0b-4ffb-8d00-5b7e1c4f43bb service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received event volume-reimaged-9764ed21-1fb1-4191-abba-933061358224 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-18fabc27-ccfc-40e7-a2e6-bea710041d08 req-fde68029-3b0b-4ffb-8d00-5b7e1c4f43bb service nova] Acquiring lock "3df9c388-08c6-4153-9666-8e492acda60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-18fabc27-ccfc-40e7-a2e6-bea710041d08 req-fde68029-3b0b-4ffb-8d00-5b7e1c4f43bb service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-18fabc27-ccfc-40e7-a2e6-bea710041d08 req-fde68029-3b0b-4ffb-8d00-5b7e1c4f43bb service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:41 user nova-compute[75672]: DEBUG nova.compute.manager [req-18fabc27-ccfc-40e7-a2e6-bea710041d08 req-fde68029-3b0b-4ffb-8d00-5b7e1c4f43bb service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Processing event volume-reimaged-9764ed21-1fb1-4191-abba-933061358224 {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 30 12:39:41 user nova-compute[75672]: DEBUG nova.compute.manager [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:39:41 user nova-compute[75672]: INFO nova.virt.block_device [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Booting with volume 9764ed21-1fb1-4191-abba-933061358224 at /dev/vda
Nov 30 12:39:42 user nova-compute[75672]: DEBUG os_brick.utils [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3fd679-10d5-45d2-a962-6e50fe449d6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37fb0d6-ef8f-447f-a884-529440001abb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd51dfe-0a40-48a1-8e1f-4763e5de982a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a794ce1-9ade-41dd-b8b8-ef48ef63a353]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:39:42 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3d3f87-152c-4827-adc4-e187b093ed8c]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG os_brick.utils [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Updating existing volume attachment record: 538bc553-4e9e-4c7d-82f6-635afc4a9477 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:39:42 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:39:44 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f53f77ca-8471-4c62-a779-f64a0a4e57aa is timed out.
Nov 30 12:39:44 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Successfully detached device vdb from instance f53f77ca-8471-4c62-a779-f64a0a4e57aa from the live domain config.
Nov 30 12:39:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lPUZmgCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:39:44 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7136d1e-bf2d-4e37-9085-f4b18750d8fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:39:44 user nova-compute[75672]: No targets found.
Nov 30 12:39:44 user nova-compute[75672]: iSNS:
Nov 30 12:39:44 user nova-compute[75672]: No targets found.
Nov 30 12:39:44 user nova-compute[75672]: STATIC:
Nov 30 12:39:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616
Nov 30 12:39:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:39:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:39:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721
Nov 30 12:39:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:39:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:39:44 user nova-compute[75672]: FIRMWARE:
Nov 30 12:39:44 user nova-compute[75672]: No targets found.
Nov 30 12:39:44 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:39:44 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:39:44 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dc97a2-7740-40fc-b596-8898abb7dcdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a525822-0306-4a8d-bd53-9c92dfaebdeb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:44 user nova-compute[75672]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)
Nov 30 12:39:44 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:44 user nova-compute[75672]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 (non-flash)
Nov 30 12:39:44 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd41e7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616'): ({'sdc'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Removing single pathed devices sdc {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada504e9-d2ed-4d11-83ab-4cc47f2b744c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9463dfb6-20e0-4ecb-9598-033d33ad8b3f]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Flushing IO for device /dev/sdc {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a01b738-a17a-40d6-9f09-7a6f5e6aaad1]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d1734f-3d70-43f6-9517-0f2c4b7f6983]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[843b80b5-53ca-4740-8f46-1d509c26a998]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d02bea8-91f1-4435-9a9f-b9eebf4ca5d2]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616, portal: 172.16.0.220,3260]
Nov 30 12:39:44 user nova-compute[75672]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616, portal: 172.16.0.220,3260] successful.
Nov 30 12:39:44 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3a08d-17ae-41ac-b952-de9d5bfd3616 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b19e52-dd57-4255-8539-959b5de95c81]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] <== disconnect_volume: return (286ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:39:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:45 user nova-compute[75672]: DEBUG nova.objects.instance [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lazy-loading 'flavor' on Instance uuid f53f77ca-8471-4c62-a779-f64a0a4e57aa {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bc69429f-0afb-421f-9d46-ff30153e48b6 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.822s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "interface-f53f77ca-8471-4c62-a779-f64a0a4e57aa-3213551f-b697-44bf-818e-a4fd4cb37e72" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "interface-f53f77ca-8471-4c62-a779-f64a0a4e57aa-3213551f-b697-44bf-818e-a4fd4cb37e72" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.objects.instance [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lazy-loading 'flavor' on Instance uuid f53f77ca-8471-4c62-a779-f64a0a4e57aa {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-128968609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-128968609',id=17,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl6klT0bzM05mjTlIY/+hxTDH4pH81fsasTPeFhXIw9kr7DGRshU4ifFY299yAb2HtCh0ILgMcRORtuH+9N2Hw5W6pQ+sfpRUATNL8WBx7USNA23ssXCHaD8O36MbtQ5g==',key_name='tempest-keypair-2079457822',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:37:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c117afa27d447fd9c8c0eb0d59c5d28',ramdisk_id='',reservation_id='r-j719jspw',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737137422',owner_user_name='tempest-TaggedAttachmentsTest-1737137422-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9544ed3bcf2407fac6a6a41e68e2a9c',uuid=f53f77ca-8471-4c62-a779-f64a0a4e57aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3213551f-b697-44bf-818e-a4fd4cb37e72", "address": "fa:16:3e:09:e6:5b", "network": {"id": "409a923c-d899-4c3e-850c-1867d39ecd79", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1562327751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3213551f-b6", "ovs_interfaceid": "3213551f-b697-44bf-818e-a4fd4cb37e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Converting VIF {"id": "3213551f-b697-44bf-818e-a4fd4cb37e72", "address": "fa:16:3e:09:e6:5b", "network": {"id": "409a923c-d899-4c3e-850c-1867d39ecd79", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1562327751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3213551f-b6", "ovs_interfaceid": "3213551f-b697-44bf-818e-a4fd4cb37e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:e6:5b,bridge_name='br-int',has_traffic_filtering=True,id=3213551f-b697-44bf-818e-a4fd4cb37e72,network=Network(409a923c-d899-4c3e-850c-1867d39ecd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3213551f-b6') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:09:e6:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3213551f-b6"/></interface> {{(pid=75672) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:09:e6:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3213551f-b6"/></interface> {{(pid=75672) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Attempting to detach device tap3213551f-b6 from instance f53f77ca-8471-4c62-a779-f64a0a4e57aa from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] detach device xml: <interface type="ethernet">
Nov 30 12:39:46 user nova-compute[75672]:   <mac address="fa:16:3e:09:e6:5b"/>
Nov 30 12:39:46 user nova-compute[75672]:   <model type="virtio"/>
Nov 30 12:39:46 user nova-compute[75672]:   <mtu size="1442"/>
Nov 30 12:39:46 user nova-compute[75672]:   <target dev="tap3213551f-b6"/>
Nov 30 12:39:46 user nova-compute[75672]: </interface>
Nov 30 12:39:46 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:09:e6:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3213551f-b6"/></interface> {{(pid=75672) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:09:e6:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3213551f-b6"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 30 12:39:46 user nova-compute[75672]:   <name>instance-00000011</name>
Nov 30 12:39:46 user nova-compute[75672]:   <uuid>f53f77ca-8471-4c62-a779-f64a0a4e57aa</uuid>
Nov 30 12:39:46 user nova-compute[75672]:   <metadata>
Nov 30 12:39:46 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:39:46 user nova-compute[75672]:   <nova:package version="0.0.0"/>
Nov 30 12:39:46 user nova-compute[75672]:   <nova:name>tempest-device-tagging-server-128968609</nova:name>
Nov 30 12:39:46 user nova-compute[75672]:   <nova:creationTime>2023-11-30 12:39:09</nova:creationTime>
Nov 30 12:39:46 user nova-compute[75672]:   <nova:flavor name="m1.tiny">
Nov 30 12:39:46 user nova-compute[75672]:     <nova:memory>512</nova:memory>
Nov 30 12:39:46 user nova-compute[75672]:     <nova:disk>1</nova:disk>
Nov 30 12:39:46 user nova-compute[75672]:     <nova:swap>0</nova:swap>
Nov 30 12:39:46 user nova-compute[75672]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:39:46 user nova-compute[75672]:     <nova:vcpus>1</nova:vcpus>
Nov 30 12:39:46 user nova-compute[75672]:   </nova:flavor>
Nov 30 12:39:46 user nova-compute[75672]:   <nova:owner>
Nov 30 12:39:46 user nova-compute[75672]:     <nova:user uuid="b9544ed3bcf2407fac6a6a41e68e2a9c">tempest-TaggedAttachmentsTest-1737137422-project-member</nova:user>
Nov 30 12:39:46 user nova-compute[75672]:     <nova:project uuid="3c117afa27d447fd9c8c0eb0d59c5d28">tempest-TaggedAttachmentsTest-1737137422</nova:project>
Nov 30 12:39:46 user nova-compute[75672]:   </nova:owner>
Nov 30 12:39:46 user nova-compute[75672]:   <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:39:46 user nova-compute[75672]:   <nova:ports>
Nov 30 12:39:46 user nova-compute[75672]:     <nova:port uuid="20e0a542-befb-47a2-bc78-f9d4bc75ef67">
Nov 30 12:39:46 user nova-compute[75672]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 12:39:46 user nova-compute[75672]:     </nova:port>
Nov 30 12:39:46 user nova-compute[75672]:     <nova:port uuid="3213551f-b697-44bf-818e-a4fd4cb37e72">
Nov 30 12:39:46 user nova-compute[75672]:       <nova:ip type="fixed" address="10.10.10.222" ipVersion="4"/>
Nov 30 12:39:46 user nova-compute[75672]:     </nova:port>
Nov 30 12:39:46 user nova-compute[75672]:   </nova:ports>
Nov 30 12:39:46 user nova-compute[75672]: </nova:instance>
Nov 30 12:39:46 user nova-compute[75672]:   </metadata>
Nov 30 12:39:46 user nova-compute[75672]:   <memory unit='KiB'>524288</memory>
Nov 30 12:39:46 user nova-compute[75672]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 12:39:46 user nova-compute[75672]:   <vcpu placement='static'>1</vcpu>
Nov 30 12:39:46 user nova-compute[75672]:   <resource>
Nov 30 12:39:46 user nova-compute[75672]:     <partition>/machine</partition>
Nov 30 12:39:46 user nova-compute[75672]:   </resource>
Nov 30 12:39:46 user nova-compute[75672]:   <sysinfo type='smbios'>
Nov 30 12:39:46 user nova-compute[75672]:     <system>
Nov 30 12:39:46 user nova-compute[75672]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 12:39:46 user nova-compute[75672]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 12:39:46 user nova-compute[75672]:       <entry name='version'>0.0.0</entry>
Nov 30 12:39:46 user nova-compute[75672]:       <entry name='serial'>f53f77ca-8471-4c62-a779-f64a0a4e57aa</entry>
Nov 30 12:39:46 user nova-compute[75672]:       <entry name='uuid'>f53f77ca-8471-4c62-a779-f64a0a4e57aa</entry>
Nov 30 12:39:46 user nova-compute[75672]:       <entry name='family'>Virtual Machine</entry>
Nov 30 12:39:46 user nova-compute[75672]:     </system>
Nov 30 12:39:46 user nova-compute[75672]:   </sysinfo>
Nov 30 12:39:46 user nova-compute[75672]:   <os>
Nov 30 12:39:46 user nova-compute[75672]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 12:39:46 user nova-compute[75672]:     <boot dev='hd'/>
Nov 30 12:39:46 user nova-compute[75672]:     <smbios mode='sysinfo'/>
Nov 30 12:39:46 user nova-compute[75672]:   </os>
Nov 30 12:39:46 user nova-compute[75672]:   <features>
Nov 30 12:39:46 user nova-compute[75672]:     <acpi/>
Nov 30 12:39:46 user nova-compute[75672]:     <apic/>
Nov 30 12:39:46 user nova-compute[75672]:     <vmcoreinfo state='on'/>
Nov 30 12:39:46 user nova-compute[75672]:   </features>
Nov 30 12:39:46 user nova-compute[75672]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 12:39:46 user nova-compute[75672]:     <model fallback='forbid'>Nehalem</model>
Nov 30 12:39:46 user nova-compute[75672]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 12:39:46 user nova-compute[75672]:     <feature policy='require' name='vme'/>
Nov 30 12:39:46 user nova-compute[75672]:     <feature policy='require' name='x2apic'/>
Nov 30 12:39:46 user nova-compute[75672]:     <feature policy='require' name='hypervisor'/>
Nov 30 12:39:46 user nova-compute[75672]:   </cpu>
Nov 30 12:39:46 user nova-compute[75672]:   <clock offset='utc'>
Nov 30 12:39:46 user nova-compute[75672]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 12:39:46 user nova-compute[75672]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 12:39:46 user nova-compute[75672]:     <timer name='hpet' present='no'/>
Nov 30 12:39:46 user nova-compute[75672]:   </clock>
Nov 30 12:39:46 user nova-compute[75672]:   <on_poweroff>destroy</on_poweroff>
Nov 30 12:39:46 user nova-compute[75672]:   <on_reboot>restart</on_reboot>
Nov 30 12:39:46 user nova-compute[75672]:   <on_crash>destroy</on_crash>
Nov 30 12:39:46 user nova-compute[75672]:   <devices>
Nov 30 12:39:46 user nova-compute[75672]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 12:39:46 user nova-compute[75672]:     <disk type='file' device='disk'>
Nov 30 12:39:46 user nova-compute[75672]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 12:39:46 user nova-compute[75672]:       <source file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk' index='2'/>
Nov 30 12:39:46 user nova-compute[75672]:       <backingStore type='file' index='3'>
Nov 30 12:39:46 user nova-compute[75672]:         <format type='raw'/>
Nov 30 12:39:46 user nova-compute[75672]:         <source file='/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211'/>
Nov 30 12:39:46 user nova-compute[75672]:         <backingStore/>
Nov 30 12:39:46 user nova-compute[75672]:       </backingStore>
Nov 30 12:39:46 user nova-compute[75672]:       <target dev='vda' bus='virtio'/>
Nov 30 12:39:46 user nova-compute[75672]:       <alias name='virtio-disk0'/>
Nov 30 12:39:46 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 12:39:46 user nova-compute[75672]:     </disk>
Nov 30 12:39:46 user nova-compute[75672]:     <disk type='file' device='cdrom'>
Nov 30 12:39:46 user nova-compute[75672]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 12:39:46 user nova-compute[75672]:       <source file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk.config' index='1'/>
Nov 30 12:39:46 user nova-compute[75672]:       <backingStore/>
Nov 30 12:39:46 user nova-compute[75672]:       <target dev='hda' bus='ide'/>
Nov 30 12:39:46 user nova-compute[75672]:       <readonly/>
Nov 30 12:39:46 user nova-compute[75672]:       <alias name='ide0-0-0'/>
Nov 30 12:39:46 user nova-compute[75672]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 12:39:46 user nova-compute[75672]:     </disk>
Nov 30 12:39:46 user nova-compute[75672]:     <controller type='usb' index='0' model='none'>
Nov 30 12:39:46 user nova-compute[75672]:       <alias name='usb'/>
Nov 30 12:39:46 user nova-compute[75672]:     </controller>
Nov 30 12:39:46 user nova-compute[75672]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 12:39:46 user nova-compute[75672]:       <alias name='pci.0'/>
Nov 30 12:39:46 user nova-compute[75672]:     </controller>
Nov 30 12:39:46 user nova-compute[75672]:     <controller type='ide' index='0'>
Nov 30 12:39:46 user nova-compute[75672]:       <alias name='ide'/>
Nov 30 12:39:46 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 12:39:46 user nova-compute[75672]:     </controller>
Nov 30 12:39:46 user nova-compute[75672]:     <interface type='ethernet'>
Nov 30 12:39:46 user nova-compute[75672]:       <mac address='fa:16:3e:ed:94:83'/>
Nov 30 12:39:46 user nova-compute[75672]:       <target dev='tap20e0a542-be'/>
Nov 30 12:39:46 user nova-compute[75672]:       <model type='virtio'/>
Nov 30 12:39:46 user nova-compute[75672]:       <mtu size='1442'/>
Nov 30 12:39:46 user nova-compute[75672]:       <alias name='net0'/>
Nov 30 12:39:46 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 12:39:46 user nova-compute[75672]:     </interface>
Nov 30 12:39:46 user nova-compute[75672]:     <interface type='ethernet'>
Nov 30 12:39:46 user nova-compute[75672]:       <mac address='fa:16:3e:09:e6:5b'/>
Nov 30 12:39:46 user nova-compute[75672]:       <target dev='tap3213551f-b6'/>
Nov 30 12:39:46 user nova-compute[75672]:       <model type='virtio'/>
Nov 30 12:39:46 user nova-compute[75672]:       <mtu size='1442'/>
Nov 30 12:39:46 user nova-compute[75672]:       <alias name='net1'/>
Nov 30 12:39:46 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 30 12:39:46 user nova-compute[75672]:     </interface>
Nov 30 12:39:46 user nova-compute[75672]:     <serial type='pty'>
Nov 30 12:39:46 user nova-compute[75672]:       <source path='/dev/pts/7'/>
Nov 30 12:39:46 user nova-compute[75672]:       <log file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/console.log' append='off'/>
Nov 30 12:39:46 user nova-compute[75672]:       <target type='isa-serial' port='0'>
Nov 30 12:39:46 user nova-compute[75672]:         <model name='isa-serial'/>
Nov 30 12:39:46 user nova-compute[75672]:       </target>
Nov 30 12:39:46 user nova-compute[75672]:       <alias name='serial0'/>
Nov 30 12:39:46 user nova-compute[75672]:     </serial>
Nov 30 12:39:46 user nova-compute[75672]:     <console type='pty' tty='/dev/pts/7'>
Nov 30 12:39:46 user nova-compute[75672]:       <source path='/dev/pts/7'/>
Nov 30 12:39:46 user nova-compute[75672]:       <log file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/console.log' append='off'/>
Nov 30 12:39:46 user nova-compute[75672]:       <target type='serial' port='0'/>
Nov 30 12:39:46 user nova-compute[75672]:       <alias name='serial0'/>
Nov 30 12:39:46 user nova-compute[75672]:     </console>
Nov 30 12:39:46 user nova-compute[75672]:     <input type='mouse' bus='ps2'>
Nov 30 12:39:46 user nova-compute[75672]:       <alias name='input0'/>
Nov 30 12:39:46 user nova-compute[75672]:     </input>
Nov 30 12:39:46 user nova-compute[75672]:     <input type='keyboard' bus='ps2'>
Nov 30 12:39:46 user nova-compute[75672]:       <alias name='input1'/>
Nov 30 12:39:46 user nova-compute[75672]:     </input>
Nov 30 12:39:46 user nova-compute[75672]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 30 12:39:46 user nova-compute[75672]:       <listen type='address' address='0.0.0.0'/>
Nov 30 12:39:46 user nova-compute[75672]:     </graphics>
Nov 30 12:39:46 user nova-compute[75672]:     <audio id='1' type='none'/>
Nov 30 12:39:46 user nova-compute[75672]:     <video>
Nov 30 12:39:46 user nova-compute[75672]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 12:39:46 user nova-compute[75672]:       <alias name='video0'/>
Nov 30 12:39:46 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 12:39:46 user nova-compute[75672]:     </video>
Nov 30 12:39:46 user nova-compute[75672]:     <memballoon model='virtio'>
Nov 30 12:39:46 user nova-compute[75672]:       <stats period='10'/>
Nov 30 12:39:46 user nova-compute[75672]:       <alias name='balloon0'/>
Nov 30 12:39:46 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 12:39:46 user nova-compute[75672]:     </memballoon>
Nov 30 12:39:46 user nova-compute[75672]:     <rng model='virtio'>
Nov 30 12:39:46 user nova-compute[75672]:       <backend model='random'>/dev/urandom</backend>
Nov 30 12:39:46 user nova-compute[75672]:       <alias name='rng0'/>
Nov 30 12:39:46 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 12:39:46 user nova-compute[75672]:     </rng>
Nov 30 12:39:46 user nova-compute[75672]:   </devices>
Nov 30 12:39:46 user nova-compute[75672]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 12:39:46 user nova-compute[75672]:     <label>libvirt-f53f77ca-8471-4c62-a779-f64a0a4e57aa</label>
Nov 30 12:39:46 user nova-compute[75672]:     <imagelabel>libvirt-f53f77ca-8471-4c62-a779-f64a0a4e57aa</imagelabel>
Nov 30 12:39:46 user nova-compute[75672]:   </seclabel>
Nov 30 12:39:46 user nova-compute[75672]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 12:39:46 user nova-compute[75672]:     <label>+64055:+108</label>
Nov 30 12:39:46 user nova-compute[75672]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 12:39:46 user nova-compute[75672]:   </seclabel>
Nov 30 12:39:46 user nova-compute[75672]: </domain>
Nov 30 12:39:46 user nova-compute[75672]:  {{(pid=75672) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 12:39:46 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Successfully detached device tap3213551f-b6 from instance f53f77ca-8471-4c62-a779-f64a0a4e57aa from the persistent domain config.
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] (1/8): Attempting to detach device tap3213551f-b6 with device alias net1 from instance f53f77ca-8471-4c62-a779-f64a0a4e57aa from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] detach device xml: <interface type="ethernet">
Nov 30 12:39:46 user nova-compute[75672]:   <mac address="fa:16:3e:09:e6:5b"/>
Nov 30 12:39:46 user nova-compute[75672]:   <model type="virtio"/>
Nov 30 12:39:46 user nova-compute[75672]:   <mtu size="1442"/>
Nov 30 12:39:46 user nova-compute[75672]:   <target dev="tap3213551f-b6"/>
Nov 30 12:39:46 user nova-compute[75672]: </interface>
Nov 30 12:39:46 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Start waiting for the detach event from libvirt for device tap3213551f-b6 with device alias net1 for instance f53f77ca-8471-4c62-a779-f64a0a4e57aa {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-bbf2ef72-90d4-436a-8464-f031df3ef712 req-24c8ab5e-be8d-43d8-9592-9c60144e8ab7 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received event network-vif-unplugged-3213551f-b697-44bf-818e-a4fd4cb37e72 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bbf2ef72-90d4-436a-8464-f031df3ef712 req-24c8ab5e-be8d-43d8-9592-9c60144e8ab7 service nova] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bbf2ef72-90d4-436a-8464-f031df3ef712 req-24c8ab5e-be8d-43d8-9592-9c60144e8ab7 service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bbf2ef72-90d4-436a-8464-f031df3ef712 req-24c8ab5e-be8d-43d8-9592-9c60144e8ab7 service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-bbf2ef72-90d4-436a-8464-f031df3ef712 req-24c8ab5e-be8d-43d8-9592-9c60144e8ab7 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] No waiting events found dispatching network-vif-unplugged-3213551f-b697-44bf-818e-a4fd4cb37e72 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:46 user nova-compute[75672]: WARNING nova.compute.manager [req-bbf2ef72-90d4-436a-8464-f031df3ef712 req-24c8ab5e-be8d-43d8-9592-9c60144e8ab7 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received unexpected event network-vif-unplugged-3213551f-b697-44bf-818e-a4fd4cb37e72 for instance with vm_state active and task_state None.
Nov 30 12:39:48 user nova-compute[75672]: DEBUG nova.compute.manager [req-a0f5f4f7-2a97-4530-9ee3-780f52a063dc req-5a580ceb-8e9c-4896-9ee0-89b92591ce0b service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received event network-vif-plugged-3213551f-b697-44bf-818e-a4fd4cb37e72 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a0f5f4f7-2a97-4530-9ee3-780f52a063dc req-5a580ceb-8e9c-4896-9ee0-89b92591ce0b service nova] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a0f5f4f7-2a97-4530-9ee3-780f52a063dc req-5a580ceb-8e9c-4896-9ee0-89b92591ce0b service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a0f5f4f7-2a97-4530-9ee3-780f52a063dc req-5a580ceb-8e9c-4896-9ee0-89b92591ce0b service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:48 user nova-compute[75672]: DEBUG nova.compute.manager [req-a0f5f4f7-2a97-4530-9ee3-780f52a063dc req-5a580ceb-8e9c-4896-9ee0-89b92591ce0b service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] No waiting events found dispatching network-vif-plugged-3213551f-b697-44bf-818e-a4fd4cb37e72 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:48 user nova-compute[75672]: WARNING nova.compute.manager [req-a0f5f4f7-2a97-4530-9ee3-780f52a063dc req-5a580ceb-8e9c-4896-9ee0-89b92591ce0b service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received unexpected event network-vif-plugged-3213551f-b697-44bf-818e-a4fd4cb37e72 for instance with vm_state active and task_state None.
Nov 30 12:39:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:39:50 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Creating image(s)
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Ensure instance console log exists: /opt/stack/data/nova/instances/3df9c388-08c6-4153-9666-8e492acda60c/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Start _get_guest_xml network_info=[{"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '538bc553-4e9e-4c7d-82f6-635afc4a9477', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lmCEdvRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3df9c388-08c6-4153-9666-8e492acda60c', 'attached_at': '', 'detached_at': '', 'volume_id': '9764ed21-1fb1-4191-abba-933061358224', 'serial': '9764ed21-1fb1-4191-abba-933061358224'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:39:50 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 12:39:50 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:39:50 user nova-compute[75672]: DEBUG nova.objects.instance [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3df9c388-08c6-4153-9666-8e492acda60c {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lmCEdvRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:39:51 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:39:51 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:39:51 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:39:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f120ed57-9638-45f3-b8c1-05374f0b6656]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:39:51 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f65e335-d072-41be-970a-2a87021620c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224] added
Nov 30 12:39:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[03812f04-67d1-479c-85ce-508324b38b71]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[240098ba-14bb-4f36-b6c5-624e875f7794]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lmCEdvRt {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lmCEdvRt" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[707b6ece-f284-49aa-8097-2cf243372360]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lmCEdvRt'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6a4545-f7de-4a46-bdbc-dee563805671]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9bea26-9f72-44f0-b61b-9a00c75c21c6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7dc70a-a58a-4025-94e1-d8d5d301363d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260]
Nov 30 12:39:51 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260] successful.
Nov 30 12:39:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19a2b66-c02d-4d15-a8db-b738f439f2a6]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[51161498-ab34-4834-b830-6e51ba67c3bf]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:51 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:39:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:39:51 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:39:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d89fb0-f29b-4fe0-9da7-cf916ed89edd]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:39:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lmCEdvRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26637633865356564', 'path': '/dev/sdc'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637633865356564', 'path': '/dev/sdc'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T12:37:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-67116884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1014565837',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxVNzI61C+OsJEwoPnrmP+C9u0Q3vxKD7EbOWbJUoD3wO5iAP3H5v2ErA0fq8PwQEvcEJsCQLdoim+V3xyoHIeOXDIbKXCEfzED1p1bzn0arLa41lNMTF7Ls62V6j5bJQ==',key_name='tempest-keypair-224557939',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:37:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c7e24ecd9d04dd4b8bccda3e63fa11d',ramdisk_id='',reservation_id='r-1br6g41s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-679548509',owner_user_name='tempest-ServerActionsV293TestJSON-679548509-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:39:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8b5b87badbf493088f822838b837eb2',uuid=3df9c388-08c6-4153-9666-8e492acda60c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Converting VIF {"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=b14a6da4-b394-4ecc-bdbb-483cdbd2c581,network=Network(38c2361b-fa3a-44d1-9764-a4a7a9af6d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14a6da4-b3') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:39:52 user nova-compute[75672]:   <uuid>3df9c388-08c6-4153-9666-8e492acda60c</uuid>
Nov 30 12:39:52 user nova-compute[75672]:   <name>instance-00000013</name>
Nov 30 12:39:52 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:39:52 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:39:52 user nova-compute[75672]:   <metadata>
Nov 30 12:39:52 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:39:52 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:39:52 user nova-compute[75672]:       <nova:name>tempest-ServerActionsV293TestJSON-server-67116884</nova:name>
Nov 30 12:39:52 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:39:50</nova:creationTime>
Nov 30 12:39:52 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:39:52 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:39:52 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:39:52 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:39:52 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:39:52 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:39:52 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:39:52 user nova-compute[75672]:       <nova:owner>
Nov 30 12:39:52 user nova-compute[75672]:         <nova:user uuid="a8b5b87badbf493088f822838b837eb2">tempest-ServerActionsV293TestJSON-679548509-project-member</nova:user>
Nov 30 12:39:52 user nova-compute[75672]:         <nova:project uuid="3c7e24ecd9d04dd4b8bccda3e63fa11d">tempest-ServerActionsV293TestJSON-679548509</nova:project>
Nov 30 12:39:52 user nova-compute[75672]:       </nova:owner>
Nov 30 12:39:52 user nova-compute[75672]:       <nova:ports>
Nov 30 12:39:52 user nova-compute[75672]:         <nova:port uuid="b14a6da4-b394-4ecc-bdbb-483cdbd2c581">
Nov 30 12:39:52 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 12:39:52 user nova-compute[75672]:         </nova:port>
Nov 30 12:39:52 user nova-compute[75672]:       </nova:ports>
Nov 30 12:39:52 user nova-compute[75672]:     </nova:instance>
Nov 30 12:39:52 user nova-compute[75672]:   </metadata>
Nov 30 12:39:52 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:39:52 user nova-compute[75672]:     <system>
Nov 30 12:39:52 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:39:52 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:39:52 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:39:52 user nova-compute[75672]:       <entry name="serial">3df9c388-08c6-4153-9666-8e492acda60c</entry>
Nov 30 12:39:52 user nova-compute[75672]:       <entry name="uuid">3df9c388-08c6-4153-9666-8e492acda60c</entry>
Nov 30 12:39:52 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:39:52 user nova-compute[75672]:     </system>
Nov 30 12:39:52 user nova-compute[75672]:   </sysinfo>
Nov 30 12:39:52 user nova-compute[75672]:   <os>
Nov 30 12:39:52 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:39:52 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:39:52 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:39:52 user nova-compute[75672]:   </os>
Nov 30 12:39:52 user nova-compute[75672]:   <features>
Nov 30 12:39:52 user nova-compute[75672]:     <acpi/>
Nov 30 12:39:52 user nova-compute[75672]:     <apic/>
Nov 30 12:39:52 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:39:52 user nova-compute[75672]:   </features>
Nov 30 12:39:52 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:39:52 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:39:52 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:39:52 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:39:52 user nova-compute[75672]:   </clock>
Nov 30 12:39:52 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:39:52 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:39:52 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:39:52 user nova-compute[75672]:   </cpu>
Nov 30 12:39:52 user nova-compute[75672]:   <devices>
Nov 30 12:39:52 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:39:52 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:39:52 user nova-compute[75672]:       <source dev="/dev/sdc"/>
Nov 30 12:39:52 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:39:52 user nova-compute[75672]:       <serial>9764ed21-1fb1-4191-abba-933061358224</serial>
Nov 30 12:39:52 user nova-compute[75672]:     </disk>
Nov 30 12:39:52 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:39:52 user nova-compute[75672]:       <mac address="fa:16:3e:f4:6e:b8"/>
Nov 30 12:39:52 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:39:52 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:39:52 user nova-compute[75672]:       <target dev="tapb14a6da4-b3"/>
Nov 30 12:39:52 user nova-compute[75672]:     </interface>
Nov 30 12:39:52 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:39:52 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/3df9c388-08c6-4153-9666-8e492acda60c/console.log" append="off"/>
Nov 30 12:39:52 user nova-compute[75672]:     </serial>
Nov 30 12:39:52 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:39:52 user nova-compute[75672]:     <video>
Nov 30 12:39:52 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:39:52 user nova-compute[75672]:     </video>
Nov 30 12:39:52 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:39:52 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:39:52 user nova-compute[75672]:     </rng>
Nov 30 12:39:52 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:39:52 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:39:52 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:39:52 user nova-compute[75672]:     </memballoon>
Nov 30 12:39:52 user nova-compute[75672]:   </devices>
Nov 30 12:39:52 user nova-compute[75672]: </domain>
Nov 30 12:39:52 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T12:37:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-67116884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1014565837',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxVNzI61C+OsJEwoPnrmP+C9u0Q3vxKD7EbOWbJUoD3wO5iAP3H5v2ErA0fq8PwQEvcEJsCQLdoim+V3xyoHIeOXDIbKXCEfzED1p1bzn0arLa41lNMTF7Ls62V6j5bJQ==',key_name='tempest-keypair-224557939',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:37:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c7e24ecd9d04dd4b8bccda3e63fa11d',ramdisk_id='',reservation_id='r-1br6g41s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-679548509',owner_user_name='tempest-ServerActionsV293TestJSON-679548509-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:39:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8b5b87badbf493088f822838b837eb2',uuid=3df9c388-08c6-4153-9666-8e492acda60c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Converting VIF {"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=b14a6da4-b394-4ecc-bdbb-483cdbd2c581,network=Network(38c2361b-fa3a-44d1-9764-a4a7a9af6d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14a6da4-b3') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG os_vif [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=b14a6da4-b394-4ecc-bdbb-483cdbd2c581,network=Network(38c2361b-fa3a-44d1-9764-a4a7a9af6d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14a6da4-b3') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f52d2cdc-ec1e-5075-a3aa-c31758bad295', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb14a6da4-b3, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb14a6da4-b3, col_values=(('qos', UUID('ca3c6362-a0ef-4c97-95c2-f67ed6c678d4')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb14a6da4-b3, col_values=(('external_ids', {'iface-id': 'b14a6da4-b394-4ecc-bdbb-483cdbd2c581', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:6e:b8', 'vm-uuid': '3df9c388-08c6-4153-9666-8e492acda60c'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:52 user nova-compute[75672]: INFO os_vif [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=b14a6da4-b394-4ecc-bdbb-483cdbd2c581,network=Network(38c2361b-fa3a-44d1-9764-a4a7a9af6d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14a6da4-b3')
Nov 30 12:39:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:39:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] No VIF found with MAC fa:16:3e:f4:6e:b8, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:39:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-52e0a05a-fa6f-4545-8c74-6b4cdc785850 req-74cd73cd-80fd-4daf-b337-6f1823d870db service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received event network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-52e0a05a-fa6f-4545-8c74-6b4cdc785850 req-74cd73cd-80fd-4daf-b337-6f1823d870db service nova] Acquiring lock "3df9c388-08c6-4153-9666-8e492acda60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-52e0a05a-fa6f-4545-8c74-6b4cdc785850 req-74cd73cd-80fd-4daf-b337-6f1823d870db service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-52e0a05a-fa6f-4545-8c74-6b4cdc785850 req-74cd73cd-80fd-4daf-b337-6f1823d870db service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-52e0a05a-fa6f-4545-8c74-6b4cdc785850 req-74cd73cd-80fd-4daf-b337-6f1823d870db service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] No waiting events found dispatching network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:53 user nova-compute[75672]: WARNING nova.compute.manager [req-52e0a05a-fa6f-4545-8c74-6b4cdc785850 req-74cd73cd-80fd-4daf-b337-6f1823d870db service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received unexpected event network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 for instance with vm_state active and task_state rebuild_spawning.
Nov 30 12:39:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:39:55 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Instance spawned successfully.
Nov 30 12:39:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG nova.objects.instance [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75672) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-5fb87256-0a50-46b3-b81e-38f9bb9cbb1a req-42a6b897-6d34-4895-b2b4-9c5d6f123edb service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received event network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5fb87256-0a50-46b3-b81e-38f9bb9cbb1a req-42a6b897-6d34-4895-b2b4-9c5d6f123edb service nova] Acquiring lock "3df9c388-08c6-4153-9666-8e492acda60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5fb87256-0a50-46b3-b81e-38f9bb9cbb1a req-42a6b897-6d34-4895-b2b4-9c5d6f123edb service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5fb87256-0a50-46b3-b81e-38f9bb9cbb1a req-42a6b897-6d34-4895-b2b4-9c5d6f123edb service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-5fb87256-0a50-46b3-b81e-38f9bb9cbb1a req-42a6b897-6d34-4895-b2b4-9c5d6f123edb service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] No waiting events found dispatching network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:55 user nova-compute[75672]: WARNING nova.compute.manager [req-5fb87256-0a50-46b3-b81e-38f9bb9cbb1a req-42a6b897-6d34-4895-b2b4-9c5d6f123edb service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received unexpected event network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 for instance with vm_state active and task_state None.
Nov 30 12:39:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-18fabc27-ccfc-40e7-a2e6-bea710041d08 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'flavor' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquired lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.network.neutron [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'info_cache' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.objects.base [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Object Instance<1fba8af1-8074-4ce8-be23-912e9850fc41> lazy-loaded attributes: flavor,info_cache {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.network.neutron [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Updating instance_info_cache with network_info: [{"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Releasing lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:39:56 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Instance destroyed successfully.
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'resources' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.objects.base [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Object Instance<1fba8af1-8074-4ce8-be23-912e9850fc41> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1561719818',display_name='tempest-AttachVolumeTestJSON-server-1561719818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1561719818',id=4,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdea+lvE9UsOmP6FYZGbGByAYyZUFyR2cvDgR8GqqqfKWiRxkUCGs+K9HROvIA5wapQ0MyZOJSLL3feZaXU9b6HVLyibqADHJmmyyoRAcM/oJWT1i+VE463gQZDjaPsHw==',key_name='tempest-keypair-145731974',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:32:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7a0ca8eb58644e058b2019a4faa41a46',ramdisk_id='',reservation_id='r-crpjd40b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2004678694',owner_user_name='tempest-AttachVolumeTestJSON-2004678694-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98ee9bd3b604b39a3f6013a40398642',uuid=1fba8af1-8074-4ce8-be23-912e9850fc41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converting VIF {"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG os_vif [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bfc6970-5d, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b659b5b4-29b8-4260-99cd-576b978217a5) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:56 user nova-compute[75672]: INFO os_vif [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d')
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Start _get_guest_xml network_info=[{"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'numa_topology' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.objects.base [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Object Instance<1fba8af1-8074-4ce8-be23-912e9850fc41> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:39:56 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:39:56 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.objects.base [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Object Instance<1fba8af1-8074-4ce8-be23-912e9850fc41> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1561719818',display_name='tempest-AttachVolumeTestJSON-server-1561719818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1561719818',id=4,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdea+lvE9UsOmP6FYZGbGByAYyZUFyR2cvDgR8GqqqfKWiRxkUCGs+K9HROvIA5wapQ0MyZOJSLL3feZaXU9b6HVLyibqADHJmmyyoRAcM/oJWT1i+VE463gQZDjaPsHw==',key_name='tempest-keypair-145731974',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:32:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7a0ca8eb58644e058b2019a4faa41a46',ramdisk_id='',reservation_id='r-crpjd40b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2004678694',owner_user_name='tempest-AttachVolumeTestJSON-2004678694-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98ee9bd3b604b39a3f6013a40398642',uuid=1fba8af1-8074-4ce8-be23-912e9850fc41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converting VIF {"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.objects.base [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Object Instance<1fba8af1-8074-4ce8-be23-912e9850fc41> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:39:56 user nova-compute[75672]:   <uuid>1fba8af1-8074-4ce8-be23-912e9850fc41</uuid>
Nov 30 12:39:56 user nova-compute[75672]:   <name>instance-00000004</name>
Nov 30 12:39:56 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:39:56 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:39:56 user nova-compute[75672]:   <metadata>
Nov 30 12:39:56 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:39:56 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:39:56 user nova-compute[75672]:       <nova:name>tempest-AttachVolumeTestJSON-server-1561719818</nova:name>
Nov 30 12:39:56 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:39:56</nova:creationTime>
Nov 30 12:39:56 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:39:56 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:39:56 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:39:56 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:39:56 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:39:56 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:39:56 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:39:56 user nova-compute[75672]:       <nova:owner>
Nov 30 12:39:56 user nova-compute[75672]:         <nova:user uuid="e98ee9bd3b604b39a3f6013a40398642">tempest-AttachVolumeTestJSON-2004678694-project-member</nova:user>
Nov 30 12:39:56 user nova-compute[75672]:         <nova:project uuid="7a0ca8eb58644e058b2019a4faa41a46">tempest-AttachVolumeTestJSON-2004678694</nova:project>
Nov 30 12:39:56 user nova-compute[75672]:       </nova:owner>
Nov 30 12:39:56 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:39:56 user nova-compute[75672]:       <nova:ports>
Nov 30 12:39:56 user nova-compute[75672]:         <nova:port uuid="5bfc6970-5d97-4f13-8603-d508342c282a">
Nov 30 12:39:56 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 12:39:56 user nova-compute[75672]:         </nova:port>
Nov 30 12:39:56 user nova-compute[75672]:       </nova:ports>
Nov 30 12:39:56 user nova-compute[75672]:     </nova:instance>
Nov 30 12:39:56 user nova-compute[75672]:   </metadata>
Nov 30 12:39:56 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:39:56 user nova-compute[75672]:     <system>
Nov 30 12:39:56 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:39:56 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:39:56 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:39:56 user nova-compute[75672]:       <entry name="serial">1fba8af1-8074-4ce8-be23-912e9850fc41</entry>
Nov 30 12:39:56 user nova-compute[75672]:       <entry name="uuid">1fba8af1-8074-4ce8-be23-912e9850fc41</entry>
Nov 30 12:39:56 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:39:56 user nova-compute[75672]:     </system>
Nov 30 12:39:56 user nova-compute[75672]:   </sysinfo>
Nov 30 12:39:56 user nova-compute[75672]:   <os>
Nov 30 12:39:56 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:39:56 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:39:56 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:39:56 user nova-compute[75672]:   </os>
Nov 30 12:39:56 user nova-compute[75672]:   <features>
Nov 30 12:39:56 user nova-compute[75672]:     <acpi/>
Nov 30 12:39:56 user nova-compute[75672]:     <apic/>
Nov 30 12:39:56 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:39:56 user nova-compute[75672]:   </features>
Nov 30 12:39:56 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:39:56 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:39:56 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:39:56 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:39:56 user nova-compute[75672]:   </clock>
Nov 30 12:39:56 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:39:56 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:39:56 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:39:56 user nova-compute[75672]:   </cpu>
Nov 30 12:39:56 user nova-compute[75672]:   <devices>
Nov 30 12:39:56 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:39:56 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:39:56 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk"/>
Nov 30 12:39:56 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:39:56 user nova-compute[75672]:     </disk>
Nov 30 12:39:56 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:39:56 user nova-compute[75672]:       <mac address="fa:16:3e:99:e9:ab"/>
Nov 30 12:39:56 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:39:56 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:39:56 user nova-compute[75672]:       <target dev="tap5bfc6970-5d"/>
Nov 30 12:39:56 user nova-compute[75672]:     </interface>
Nov 30 12:39:56 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:39:56 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/console.log" append="off"/>
Nov 30 12:39:56 user nova-compute[75672]:     </serial>
Nov 30 12:39:56 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:39:56 user nova-compute[75672]:     <video>
Nov 30 12:39:56 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:39:56 user nova-compute[75672]:     </video>
Nov 30 12:39:56 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:39:56 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:39:56 user nova-compute[75672]:     </rng>
Nov 30 12:39:56 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:39:56 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:39:56 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:39:56 user nova-compute[75672]:     </memballoon>
Nov 30 12:39:56 user nova-compute[75672]:   </devices>
Nov 30 12:39:56 user nova-compute[75672]: </domain>
Nov 30 12:39:56 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG nova.objects.base [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Object Instance<1fba8af1-8074-4ce8-be23-912e9850fc41> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.188s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Cannot resize image /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'migration_context' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG nova.objects.base [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Object Instance<1fba8af1-8074-4ce8-be23-912e9850fc41> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1561719818',display_name='tempest-AttachVolumeTestJSON-server-1561719818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1561719818',id=4,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdea+lvE9UsOmP6FYZGbGByAYyZUFyR2cvDgR8GqqqfKWiRxkUCGs+K9HROvIA5wapQ0MyZOJSLL3feZaXU9b6HVLyibqADHJmmyyoRAcM/oJWT1i+VE463gQZDjaPsHw==',key_name='tempest-keypair-145731974',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:32:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7a0ca8eb58644e058b2019a4faa41a46',ramdisk_id='',reservation_id='r-crpjd40b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2004678694',owner_user_name='tempest-AttachVolumeTestJSON-2004678694-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98ee9bd3b604b39a3f6013a40398642',uuid=1fba8af1-8074-4ce8-be23-912e9850fc41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converting VIF {"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG os_vif [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5487a777-6857-54ac-86e5-c2478f878475', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bfc6970-5d, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bfc6970-5d, col_values=(('qos', UUID('be8f1687-7ca4-449b-8e56-874dbb597182')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bfc6970-5d, col_values=(('external_ids', {'iface-id': '5bfc6970-5d97-4f13-8603-d508342c282a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:e9:ab', 'vm-uuid': '1fba8af1-8074-4ce8-be23-912e9850fc41'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:39:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:57 user nova-compute[75672]: INFO os_vif [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d')
Nov 30 12:39:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-0ea8ccbc-3d2b-4148-b9bc-4a71e44b088a req-347b37cb-d087-4114-9b50-780926425b1e service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:39:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0ea8ccbc-3d2b-4148-b9bc-4a71e44b088a req-347b37cb-d087-4114-9b50-780926425b1e service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:39:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0ea8ccbc-3d2b-4148-b9bc-4a71e44b088a req-347b37cb-d087-4114-9b50-780926425b1e service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:39:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0ea8ccbc-3d2b-4148-b9bc-4a71e44b088a req-347b37cb-d087-4114-9b50-780926425b1e service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:39:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-0ea8ccbc-3d2b-4148-b9bc-4a71e44b088a req-347b37cb-d087-4114-9b50-780926425b1e service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:39:59 user nova-compute[75672]: WARNING nova.compute.manager [req-0ea8ccbc-3d2b-4148-b9bc-4a71e44b088a req-347b37cb-d087-4114-9b50-780926425b1e service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state stopped and task_state powering-on.
Nov 30 12:39:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:39:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:01 user nova-compute[75672]: DEBUG nova.compute.manager [req-6c45deff-8067-4b46-8999-153470075d1f req-928a0903-fd05-4405-af30-3b73e9827f9e service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6c45deff-8067-4b46-8999-153470075d1f req-928a0903-fd05-4405-af30-3b73e9827f9e service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6c45deff-8067-4b46-8999-153470075d1f req-928a0903-fd05-4405-af30-3b73e9827f9e service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6c45deff-8067-4b46-8999-153470075d1f req-928a0903-fd05-4405-af30-3b73e9827f9e service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:01 user nova-compute[75672]: DEBUG nova.compute.manager [req-6c45deff-8067-4b46-8999-153470075d1f req-928a0903-fd05-4405-af30-3b73e9827f9e service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:40:01 user nova-compute[75672]: WARNING nova.compute.manager [req-6c45deff-8067-4b46-8999-153470075d1f req-928a0903-fd05-4405-af30-3b73e9827f9e service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state stopped and task_state powering-on.
Nov 30 12:40:01 user nova-compute[75672]: DEBUG nova.compute.manager [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:40:01 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Instance rebooted successfully.
Nov 30 12:40:01 user nova-compute[75672]: DEBUG nova.compute.manager [None req-e9816d08-3be1-4827-8eda-ffdc31e63fd5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:40:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:06 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Waiting for libvirt event about the detach of device tap3213551f-b6 with device alias net1 from instance f53f77ca-8471-4c62-a779-f64a0a4e57aa is timed out.
Nov 30 12:40:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:09:e6:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3213551f-b6"/></interface> {{(pid=75672) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 12:40:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:09:e6:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3213551f-b6"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 30 12:40:06 user nova-compute[75672]:   <name>instance-00000011</name>
Nov 30 12:40:06 user nova-compute[75672]:   <uuid>f53f77ca-8471-4c62-a779-f64a0a4e57aa</uuid>
Nov 30 12:40:06 user nova-compute[75672]:   <metadata>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:40:06 user nova-compute[75672]:   <nova:package version="0.0.0"/>
Nov 30 12:40:06 user nova-compute[75672]:   <nova:name>tempest-device-tagging-server-128968609</nova:name>
Nov 30 12:40:06 user nova-compute[75672]:   <nova:creationTime>2023-11-30 12:39:09</nova:creationTime>
Nov 30 12:40:06 user nova-compute[75672]:   <nova:flavor name="m1.tiny">
Nov 30 12:40:06 user nova-compute[75672]:     <nova:memory>512</nova:memory>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:disk>1</nova:disk>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:swap>0</nova:swap>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:vcpus>1</nova:vcpus>
Nov 30 12:40:06 user nova-compute[75672]:   </nova:flavor>
Nov 30 12:40:06 user nova-compute[75672]:   <nova:owner>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:user uuid="b9544ed3bcf2407fac6a6a41e68e2a9c">tempest-TaggedAttachmentsTest-1737137422-project-member</nova:user>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:project uuid="3c117afa27d447fd9c8c0eb0d59c5d28">tempest-TaggedAttachmentsTest-1737137422</nova:project>
Nov 30 12:40:06 user nova-compute[75672]:   </nova:owner>
Nov 30 12:40:06 user nova-compute[75672]:   <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:40:06 user nova-compute[75672]:   <nova:ports>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:port uuid="20e0a542-befb-47a2-bc78-f9d4bc75ef67">
Nov 30 12:40:06 user nova-compute[75672]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 12:40:06 user nova-compute[75672]:     </nova:port>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:port uuid="3213551f-b697-44bf-818e-a4fd4cb37e72">
Nov 30 12:40:06 user nova-compute[75672]:       <nova:ip type="fixed" address="10.10.10.222" ipVersion="4"/>
Nov 30 12:40:06 user nova-compute[75672]:     </nova:port>
Nov 30 12:40:06 user nova-compute[75672]:   </nova:ports>
Nov 30 12:40:06 user nova-compute[75672]: </nova:instance>
Nov 30 12:40:06 user nova-compute[75672]:   </metadata>
Nov 30 12:40:06 user nova-compute[75672]:   <memory unit='KiB'>524288</memory>
Nov 30 12:40:06 user nova-compute[75672]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 12:40:06 user nova-compute[75672]:   <vcpu placement='static'>1</vcpu>
Nov 30 12:40:06 user nova-compute[75672]:   <resource>
Nov 30 12:40:06 user nova-compute[75672]:     <partition>/machine</partition>
Nov 30 12:40:06 user nova-compute[75672]:   </resource>
Nov 30 12:40:06 user nova-compute[75672]:   <sysinfo type='smbios'>
Nov 30 12:40:06 user nova-compute[75672]:     <system>
Nov 30 12:40:06 user nova-compute[75672]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 12:40:06 user nova-compute[75672]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 12:40:06 user nova-compute[75672]:       <entry name='version'>0.0.0</entry>
Nov 30 12:40:06 user nova-compute[75672]:       <entry name='serial'>f53f77ca-8471-4c62-a779-f64a0a4e57aa</entry>
Nov 30 12:40:06 user nova-compute[75672]:       <entry name='uuid'>f53f77ca-8471-4c62-a779-f64a0a4e57aa</entry>
Nov 30 12:40:06 user nova-compute[75672]:       <entry name='family'>Virtual Machine</entry>
Nov 30 12:40:06 user nova-compute[75672]:     </system>
Nov 30 12:40:06 user nova-compute[75672]:   </sysinfo>
Nov 30 12:40:06 user nova-compute[75672]:   <os>
Nov 30 12:40:06 user nova-compute[75672]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 12:40:06 user nova-compute[75672]:     <boot dev='hd'/>
Nov 30 12:40:06 user nova-compute[75672]:     <smbios mode='sysinfo'/>
Nov 30 12:40:06 user nova-compute[75672]:   </os>
Nov 30 12:40:06 user nova-compute[75672]:   <features>
Nov 30 12:40:06 user nova-compute[75672]:     <acpi/>
Nov 30 12:40:06 user nova-compute[75672]:     <apic/>
Nov 30 12:40:06 user nova-compute[75672]:     <vmcoreinfo state='on'/>
Nov 30 12:40:06 user nova-compute[75672]:   </features>
Nov 30 12:40:06 user nova-compute[75672]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 12:40:06 user nova-compute[75672]:     <model fallback='forbid'>Nehalem</model>
Nov 30 12:40:06 user nova-compute[75672]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 12:40:06 user nova-compute[75672]:     <feature policy='require' name='vme'/>
Nov 30 12:40:06 user nova-compute[75672]:     <feature policy='require' name='x2apic'/>
Nov 30 12:40:06 user nova-compute[75672]:     <feature policy='require' name='hypervisor'/>
Nov 30 12:40:06 user nova-compute[75672]:   </cpu>
Nov 30 12:40:06 user nova-compute[75672]:   <clock offset='utc'>
Nov 30 12:40:06 user nova-compute[75672]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 12:40:06 user nova-compute[75672]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 12:40:06 user nova-compute[75672]:     <timer name='hpet' present='no'/>
Nov 30 12:40:06 user nova-compute[75672]:   </clock>
Nov 30 12:40:06 user nova-compute[75672]:   <on_poweroff>destroy</on_poweroff>
Nov 30 12:40:06 user nova-compute[75672]:   <on_reboot>restart</on_reboot>
Nov 30 12:40:06 user nova-compute[75672]:   <on_crash>destroy</on_crash>
Nov 30 12:40:06 user nova-compute[75672]:   <devices>
Nov 30 12:40:06 user nova-compute[75672]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 12:40:06 user nova-compute[75672]:     <disk type='file' device='disk'>
Nov 30 12:40:06 user nova-compute[75672]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 12:40:06 user nova-compute[75672]:       <source file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk' index='2'/>
Nov 30 12:40:06 user nova-compute[75672]:       <backingStore type='file' index='3'>
Nov 30 12:40:06 user nova-compute[75672]:         <format type='raw'/>
Nov 30 12:40:06 user nova-compute[75672]:         <source file='/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211'/>
Nov 30 12:40:06 user nova-compute[75672]:         <backingStore/>
Nov 30 12:40:06 user nova-compute[75672]:       </backingStore>
Nov 30 12:40:06 user nova-compute[75672]:       <target dev='vda' bus='virtio'/>
Nov 30 12:40:06 user nova-compute[75672]:       <alias name='virtio-disk0'/>
Nov 30 12:40:06 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 12:40:06 user nova-compute[75672]:     </disk>
Nov 30 12:40:06 user nova-compute[75672]:     <disk type='file' device='cdrom'>
Nov 30 12:40:06 user nova-compute[75672]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 12:40:06 user nova-compute[75672]:       <source file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk.config' index='1'/>
Nov 30 12:40:06 user nova-compute[75672]:       <backingStore/>
Nov 30 12:40:06 user nova-compute[75672]:       <target dev='hda' bus='ide'/>
Nov 30 12:40:06 user nova-compute[75672]:       <readonly/>
Nov 30 12:40:06 user nova-compute[75672]:       <alias name='ide0-0-0'/>
Nov 30 12:40:06 user nova-compute[75672]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 12:40:06 user nova-compute[75672]:     </disk>
Nov 30 12:40:06 user nova-compute[75672]:     <controller type='usb' index='0' model='none'>
Nov 30 12:40:06 user nova-compute[75672]:       <alias name='usb'/>
Nov 30 12:40:06 user nova-compute[75672]:     </controller>
Nov 30 12:40:06 user nova-compute[75672]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 12:40:06 user nova-compute[75672]:       <alias name='pci.0'/>
Nov 30 12:40:06 user nova-compute[75672]:     </controller>
Nov 30 12:40:06 user nova-compute[75672]:     <controller type='ide' index='0'>
Nov 30 12:40:06 user nova-compute[75672]:       <alias name='ide'/>
Nov 30 12:40:06 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 12:40:06 user nova-compute[75672]:     </controller>
Nov 30 12:40:06 user nova-compute[75672]:     <interface type='ethernet'>
Nov 30 12:40:06 user nova-compute[75672]:       <mac address='fa:16:3e:ed:94:83'/>
Nov 30 12:40:06 user nova-compute[75672]:       <target dev='tap20e0a542-be'/>
Nov 30 12:40:06 user nova-compute[75672]:       <model type='virtio'/>
Nov 30 12:40:06 user nova-compute[75672]:       <mtu size='1442'/>
Nov 30 12:40:06 user nova-compute[75672]:       <alias name='net0'/>
Nov 30 12:40:06 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 12:40:06 user nova-compute[75672]:     </interface>
Nov 30 12:40:06 user nova-compute[75672]:     <serial type='pty'>
Nov 30 12:40:06 user nova-compute[75672]:       <source path='/dev/pts/7'/>
Nov 30 12:40:06 user nova-compute[75672]:       <log file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/console.log' append='off'/>
Nov 30 12:40:06 user nova-compute[75672]:       <target type='isa-serial' port='0'>
Nov 30 12:40:06 user nova-compute[75672]:         <model name='isa-serial'/>
Nov 30 12:40:06 user nova-compute[75672]:       </target>
Nov 30 12:40:06 user nova-compute[75672]:       <alias name='serial0'/>
Nov 30 12:40:06 user nova-compute[75672]:     </serial>
Nov 30 12:40:06 user nova-compute[75672]:     <console type='pty' tty='/dev/pts/7'>
Nov 30 12:40:06 user nova-compute[75672]:       <source path='/dev/pts/7'/>
Nov 30 12:40:06 user nova-compute[75672]:       <log file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/console.log' append='off'/>
Nov 30 12:40:06 user nova-compute[75672]:       <target type='serial' port='0'/>
Nov 30 12:40:06 user nova-compute[75672]:       <alias name='serial0'/>
Nov 30 12:40:06 user nova-compute[75672]:     </console>
Nov 30 12:40:06 user nova-compute[75672]:     <input type='mouse' bus='ps2'>
Nov 30 12:40:06 user nova-compute[75672]:       <alias name='input0'/>
Nov 30 12:40:06 user nova-compute[75672]:     </input>
Nov 30 12:40:06 user nova-compute[75672]:     <input type='keyboard' bus='ps2'>
Nov 30 12:40:06 user nova-compute[75672]:       <alias name='input1'/>
Nov 30 12:40:06 user nova-compute[75672]:     </input>
Nov 30 12:40:06 user nova-compute[75672]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 30 12:40:06 user nova-compute[75672]:       <listen type='address' address='0.0.0.0'/>
Nov 30 12:40:06 user nova-compute[75672]:     </graphics>
Nov 30 12:40:06 user nova-compute[75672]:     <audio id='1' type='none'/>
Nov 30 12:40:06 user nova-compute[75672]:     <video>
Nov 30 12:40:06 user nova-compute[75672]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 12:40:06 user nova-compute[75672]:       <alias name='video0'/>
Nov 30 12:40:06 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 12:40:06 user nova-compute[75672]:     </video>
Nov 30 12:40:06 user nova-compute[75672]:     <memballoon model='virtio'>
Nov 30 12:40:06 user nova-compute[75672]:       <stats period='10'/>
Nov 30 12:40:06 user nova-compute[75672]:       <alias name='balloon0'/>
Nov 30 12:40:06 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 12:40:06 user nova-compute[75672]:     </memballoon>
Nov 30 12:40:06 user nova-compute[75672]:     <rng model='virtio'>
Nov 30 12:40:06 user nova-compute[75672]:       <backend model='random'>/dev/urandom</backend>
Nov 30 12:40:06 user nova-compute[75672]:       <alias name='rng0'/>
Nov 30 12:40:06 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 12:40:06 user nova-compute[75672]:     </rng>
Nov 30 12:40:06 user nova-compute[75672]:   </devices>
Nov 30 12:40:06 user nova-compute[75672]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 12:40:06 user nova-compute[75672]:     <label>libvirt-f53f77ca-8471-4c62-a779-f64a0a4e57aa</label>
Nov 30 12:40:06 user nova-compute[75672]:     <imagelabel>libvirt-f53f77ca-8471-4c62-a779-f64a0a4e57aa</imagelabel>
Nov 30 12:40:06 user nova-compute[75672]:   </seclabel>
Nov 30 12:40:06 user nova-compute[75672]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 12:40:06 user nova-compute[75672]:     <label>+64055:+108</label>
Nov 30 12:40:06 user nova-compute[75672]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 12:40:06 user nova-compute[75672]:   </seclabel>
Nov 30 12:40:06 user nova-compute[75672]: </domain>
Nov 30 12:40:06 user nova-compute[75672]:  {{(pid=75672) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 12:40:06 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Successfully detached device tap3213551f-b6 from instance f53f77ca-8471-4c62-a779-f64a0a4e57aa from the live domain config.
Nov 30 12:40:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-128968609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-128968609',id=17,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl6klT0bzM05mjTlIY/+hxTDH4pH81fsasTPeFhXIw9kr7DGRshU4ifFY299yAb2HtCh0ILgMcRORtuH+9N2Hw5W6pQ+sfpRUATNL8WBx7USNA23ssXCHaD8O36MbtQ5g==',key_name='tempest-keypair-2079457822',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:37:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c117afa27d447fd9c8c0eb0d59c5d28',ramdisk_id='',reservation_id='r-j719jspw',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737137422',owner_user_name='tempest-TaggedAttachmentsTest-1737137422-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9544ed3bcf2407fac6a6a41e68e2a9c',uuid=f53f77ca-8471-4c62-a779-f64a0a4e57aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3213551f-b697-44bf-818e-a4fd4cb37e72", "address": "fa:16:3e:09:e6:5b", "network": {"id": "409a923c-d899-4c3e-850c-1867d39ecd79", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1562327751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3213551f-b6", "ovs_interfaceid": "3213551f-b697-44bf-818e-a4fd4cb37e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:40:06 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Converting VIF {"id": "3213551f-b697-44bf-818e-a4fd4cb37e72", "address": "fa:16:3e:09:e6:5b", "network": {"id": "409a923c-d899-4c3e-850c-1867d39ecd79", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1562327751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3213551f-b6", "ovs_interfaceid": "3213551f-b697-44bf-818e-a4fd4cb37e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:40:06 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:e6:5b,bridge_name='br-int',has_traffic_filtering=True,id=3213551f-b697-44bf-818e-a4fd4cb37e72,network=Network(409a923c-d899-4c3e-850c-1867d39ecd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3213551f-b6') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:40:06 user nova-compute[75672]: DEBUG os_vif [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:e6:5b,bridge_name='br-int',has_traffic_filtering=True,id=3213551f-b697-44bf-818e-a4fd4cb37e72,network=Network(409a923c-d899-4c3e-850c-1867d39ecd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3213551f-b6') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:40:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3213551f-b6, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:40:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aeedde85-16ce-4fd4-a1b2-b6897982125a) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:06 user nova-compute[75672]: INFO os_vif [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:e6:5b,bridge_name='br-int',has_traffic_filtering=True,id=3213551f-b697-44bf-818e-a4fd4cb37e72,network=Network(409a923c-d899-4c3e-850c-1867d39ecd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3213551f-b6')
Nov 30 12:40:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:40:06 user nova-compute[75672]:   <nova:package version="0.0.0"/>
Nov 30 12:40:06 user nova-compute[75672]:   <nova:name>tempest-device-tagging-server-128968609</nova:name>
Nov 30 12:40:06 user nova-compute[75672]:   <nova:creationTime>2023-11-30 12:40:06</nova:creationTime>
Nov 30 12:40:06 user nova-compute[75672]:   <nova:flavor name="m1.tiny">
Nov 30 12:40:06 user nova-compute[75672]:     <nova:memory>512</nova:memory>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:disk>1</nova:disk>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:swap>0</nova:swap>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:vcpus>1</nova:vcpus>
Nov 30 12:40:06 user nova-compute[75672]:   </nova:flavor>
Nov 30 12:40:06 user nova-compute[75672]:   <nova:owner>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:user uuid="b9544ed3bcf2407fac6a6a41e68e2a9c">tempest-TaggedAttachmentsTest-1737137422-project-member</nova:user>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:project uuid="3c117afa27d447fd9c8c0eb0d59c5d28">tempest-TaggedAttachmentsTest-1737137422</nova:project>
Nov 30 12:40:06 user nova-compute[75672]:   </nova:owner>
Nov 30 12:40:06 user nova-compute[75672]:   <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:40:06 user nova-compute[75672]:   <nova:ports>
Nov 30 12:40:06 user nova-compute[75672]:     <nova:port uuid="20e0a542-befb-47a2-bc78-f9d4bc75ef67">
Nov 30 12:40:06 user nova-compute[75672]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 12:40:06 user nova-compute[75672]:     </nova:port>
Nov 30 12:40:06 user nova-compute[75672]:   </nova:ports>
Nov 30 12:40:06 user nova-compute[75672]: </nova:instance>
Nov 30 12:40:06 user nova-compute[75672]:  {{(pid=75672) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received event network-vif-deleted-3213551f-b697-44bf-818e-a4fd4cb37e72 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:07 user nova-compute[75672]: INFO nova.compute.manager [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Neutron deleted interface 3213551f-b697-44bf-818e-a4fd4cb37e72; detaching it from the instance and deleting it from the info cache
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.network.neutron [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Updating instance_info_cache with network_info: [{"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquired lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.objects.instance [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] Lazy-loading 'system_metadata' on Instance uuid f53f77ca-8471-4c62-a779-f64a0a4e57aa {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.objects.instance [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] Lazy-loading 'flavor' on Instance uuid f53f77ca-8471-4c62-a779-f64a0a4e57aa {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.objects.base [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] Object Instance<f53f77ca-8471-4c62-a779-f64a0a4e57aa> lazy-loaded attributes: system_metadata,flavor {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-128968609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-128968609',id=17,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl6klT0bzM05mjTlIY/+hxTDH4pH81fsasTPeFhXIw9kr7DGRshU4ifFY299yAb2HtCh0ILgMcRORtuH+9N2Hw5W6pQ+sfpRUATNL8WBx7USNA23ssXCHaD8O36MbtQ5g==',key_name='tempest-keypair-2079457822',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:37:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c117afa27d447fd9c8c0eb0d59c5d28',ramdisk_id='',reservation_id='r-j719jspw',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737137422',owner_user_name='tempest-TaggedAttachmentsTest-1737137422-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9544ed3bcf2407fac6a6a41e68e2a9c',uuid=f53f77ca-8471-4c62-a779-f64a0a4e57aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3213551f-b697-44bf-818e-a4fd4cb37e72", "address": "fa:16:3e:09:e6:5b", "network": {"id": "409a923c-d899-4c3e-850c-1867d39ecd79", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1562327751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3213551f-b6", "ovs_interfaceid": "3213551f-b697-44bf-818e-a4fd4cb37e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] Converting VIF {"id": "3213551f-b697-44bf-818e-a4fd4cb37e72", "address": "fa:16:3e:09:e6:5b", "network": {"id": "409a923c-d899-4c3e-850c-1867d39ecd79", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1562327751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3213551f-b6", "ovs_interfaceid": "3213551f-b697-44bf-818e-a4fd4cb37e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:e6:5b,bridge_name='br-int',has_traffic_filtering=True,id=3213551f-b697-44bf-818e-a4fd4cb37e72,network=Network(409a923c-d899-4c3e-850c-1867d39ecd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3213551f-b6') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:09:e6:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3213551f-b6"/></interface> {{(pid=75672) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:09:e6:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3213551f-b6"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 30 12:40:07 user nova-compute[75672]:   <name>instance-00000011</name>
Nov 30 12:40:07 user nova-compute[75672]:   <uuid>f53f77ca-8471-4c62-a779-f64a0a4e57aa</uuid>
Nov 30 12:40:07 user nova-compute[75672]:   <metadata>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:40:07 user nova-compute[75672]:   <nova:package version="0.0.0"/>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:name>tempest-device-tagging-server-128968609</nova:name>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:creationTime>2023-11-30 12:40:06</nova:creationTime>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:flavor name="m1.tiny">
Nov 30 12:40:07 user nova-compute[75672]:     <nova:memory>512</nova:memory>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:disk>1</nova:disk>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:swap>0</nova:swap>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:vcpus>1</nova:vcpus>
Nov 30 12:40:07 user nova-compute[75672]:   </nova:flavor>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:owner>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:user uuid="b9544ed3bcf2407fac6a6a41e68e2a9c">tempest-TaggedAttachmentsTest-1737137422-project-member</nova:user>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:project uuid="3c117afa27d447fd9c8c0eb0d59c5d28">tempest-TaggedAttachmentsTest-1737137422</nova:project>
Nov 30 12:40:07 user nova-compute[75672]:   </nova:owner>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:ports>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:port uuid="20e0a542-befb-47a2-bc78-f9d4bc75ef67">
Nov 30 12:40:07 user nova-compute[75672]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 12:40:07 user nova-compute[75672]:     </nova:port>
Nov 30 12:40:07 user nova-compute[75672]:   </nova:ports>
Nov 30 12:40:07 user nova-compute[75672]: </nova:instance>
Nov 30 12:40:07 user nova-compute[75672]:   </metadata>
Nov 30 12:40:07 user nova-compute[75672]:   <memory unit='KiB'>524288</memory>
Nov 30 12:40:07 user nova-compute[75672]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 12:40:07 user nova-compute[75672]:   <vcpu placement='static'>1</vcpu>
Nov 30 12:40:07 user nova-compute[75672]:   <resource>
Nov 30 12:40:07 user nova-compute[75672]:     <partition>/machine</partition>
Nov 30 12:40:07 user nova-compute[75672]:   </resource>
Nov 30 12:40:07 user nova-compute[75672]:   <sysinfo type='smbios'>
Nov 30 12:40:07 user nova-compute[75672]:     <system>
Nov 30 12:40:07 user nova-compute[75672]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 12:40:07 user nova-compute[75672]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 12:40:07 user nova-compute[75672]:       <entry name='version'>0.0.0</entry>
Nov 30 12:40:07 user nova-compute[75672]:       <entry name='serial'>f53f77ca-8471-4c62-a779-f64a0a4e57aa</entry>
Nov 30 12:40:07 user nova-compute[75672]:       <entry name='uuid'>f53f77ca-8471-4c62-a779-f64a0a4e57aa</entry>
Nov 30 12:40:07 user nova-compute[75672]:       <entry name='family'>Virtual Machine</entry>
Nov 30 12:40:07 user nova-compute[75672]:     </system>
Nov 30 12:40:07 user nova-compute[75672]:   </sysinfo>
Nov 30 12:40:07 user nova-compute[75672]:   <os>
Nov 30 12:40:07 user nova-compute[75672]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 12:40:07 user nova-compute[75672]:     <boot dev='hd'/>
Nov 30 12:40:07 user nova-compute[75672]:     <smbios mode='sysinfo'/>
Nov 30 12:40:07 user nova-compute[75672]:   </os>
Nov 30 12:40:07 user nova-compute[75672]:   <features>
Nov 30 12:40:07 user nova-compute[75672]:     <acpi/>
Nov 30 12:40:07 user nova-compute[75672]:     <apic/>
Nov 30 12:40:07 user nova-compute[75672]:     <vmcoreinfo state='on'/>
Nov 30 12:40:07 user nova-compute[75672]:   </features>
Nov 30 12:40:07 user nova-compute[75672]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 12:40:07 user nova-compute[75672]:     <model fallback='forbid'>Nehalem</model>
Nov 30 12:40:07 user nova-compute[75672]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 12:40:07 user nova-compute[75672]:     <feature policy='require' name='vme'/>
Nov 30 12:40:07 user nova-compute[75672]:     <feature policy='require' name='x2apic'/>
Nov 30 12:40:07 user nova-compute[75672]:     <feature policy='require' name='hypervisor'/>
Nov 30 12:40:07 user nova-compute[75672]:   </cpu>
Nov 30 12:40:07 user nova-compute[75672]:   <clock offset='utc'>
Nov 30 12:40:07 user nova-compute[75672]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 12:40:07 user nova-compute[75672]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 12:40:07 user nova-compute[75672]:     <timer name='hpet' present='no'/>
Nov 30 12:40:07 user nova-compute[75672]:   </clock>
Nov 30 12:40:07 user nova-compute[75672]:   <on_poweroff>destroy</on_poweroff>
Nov 30 12:40:07 user nova-compute[75672]:   <on_reboot>restart</on_reboot>
Nov 30 12:40:07 user nova-compute[75672]:   <on_crash>destroy</on_crash>
Nov 30 12:40:07 user nova-compute[75672]:   <devices>
Nov 30 12:40:07 user nova-compute[75672]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 12:40:07 user nova-compute[75672]:     <disk type='file' device='disk'>
Nov 30 12:40:07 user nova-compute[75672]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 12:40:07 user nova-compute[75672]:       <source file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk' index='2'/>
Nov 30 12:40:07 user nova-compute[75672]:       <backingStore type='file' index='3'>
Nov 30 12:40:07 user nova-compute[75672]:         <format type='raw'/>
Nov 30 12:40:07 user nova-compute[75672]:         <source file='/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211'/>
Nov 30 12:40:07 user nova-compute[75672]:         <backingStore/>
Nov 30 12:40:07 user nova-compute[75672]:       </backingStore>
Nov 30 12:40:07 user nova-compute[75672]:       <target dev='vda' bus='virtio'/>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='virtio-disk0'/>
Nov 30 12:40:07 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </disk>
Nov 30 12:40:07 user nova-compute[75672]:     <disk type='file' device='cdrom'>
Nov 30 12:40:07 user nova-compute[75672]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 12:40:07 user nova-compute[75672]:       <source file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk.config' index='1'/>
Nov 30 12:40:07 user nova-compute[75672]:       <backingStore/>
Nov 30 12:40:07 user nova-compute[75672]:       <target dev='hda' bus='ide'/>
Nov 30 12:40:07 user nova-compute[75672]:       <readonly/>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='ide0-0-0'/>
Nov 30 12:40:07 user nova-compute[75672]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </disk>
Nov 30 12:40:07 user nova-compute[75672]:     <controller type='usb' index='0' model='none'>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='usb'/>
Nov 30 12:40:07 user nova-compute[75672]:     </controller>
Nov 30 12:40:07 user nova-compute[75672]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='pci.0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </controller>
Nov 30 12:40:07 user nova-compute[75672]:     <controller type='ide' index='0'>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='ide'/>
Nov 30 12:40:07 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 12:40:07 user nova-compute[75672]:     </controller>
Nov 30 12:40:07 user nova-compute[75672]:     <interface type='ethernet'>
Nov 30 12:40:07 user nova-compute[75672]:       <mac address='fa:16:3e:ed:94:83'/>
Nov 30 12:40:07 user nova-compute[75672]:       <target dev='tap20e0a542-be'/>
Nov 30 12:40:07 user nova-compute[75672]:       <model type='virtio'/>
Nov 30 12:40:07 user nova-compute[75672]:       <mtu size='1442'/>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='net0'/>
Nov 30 12:40:07 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </interface>
Nov 30 12:40:07 user nova-compute[75672]:     <serial type='pty'>
Nov 30 12:40:07 user nova-compute[75672]:       <source path='/dev/pts/7'/>
Nov 30 12:40:07 user nova-compute[75672]:       <log file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/console.log' append='off'/>
Nov 30 12:40:07 user nova-compute[75672]:       <target type='isa-serial' port='0'>
Nov 30 12:40:07 user nova-compute[75672]:         <model name='isa-serial'/>
Nov 30 12:40:07 user nova-compute[75672]:       </target>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='serial0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </serial>
Nov 30 12:40:07 user nova-compute[75672]:     <console type='pty' tty='/dev/pts/7'>
Nov 30 12:40:07 user nova-compute[75672]:       <source path='/dev/pts/7'/>
Nov 30 12:40:07 user nova-compute[75672]:       <log file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/console.log' append='off'/>
Nov 30 12:40:07 user nova-compute[75672]:       <target type='serial' port='0'/>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='serial0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </console>
Nov 30 12:40:07 user nova-compute[75672]:     <input type='mouse' bus='ps2'>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='input0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </input>
Nov 30 12:40:07 user nova-compute[75672]:     <input type='keyboard' bus='ps2'>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='input1'/>
Nov 30 12:40:07 user nova-compute[75672]:     </input>
Nov 30 12:40:07 user nova-compute[75672]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 30 12:40:07 user nova-compute[75672]:       <listen type='address' address='0.0.0.0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </graphics>
Nov 30 12:40:07 user nova-compute[75672]:     <audio id='1' type='none'/>
Nov 30 12:40:07 user nova-compute[75672]:     <video>
Nov 30 12:40:07 user nova-compute[75672]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='video0'/>
Nov 30 12:40:07 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </video>
Nov 30 12:40:07 user nova-compute[75672]:     <memballoon model='virtio'>
Nov 30 12:40:07 user nova-compute[75672]:       <stats period='10'/>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='balloon0'/>
Nov 30 12:40:07 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </memballoon>
Nov 30 12:40:07 user nova-compute[75672]:     <rng model='virtio'>
Nov 30 12:40:07 user nova-compute[75672]:       <backend model='random'>/dev/urandom</backend>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='rng0'/>
Nov 30 12:40:07 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </rng>
Nov 30 12:40:07 user nova-compute[75672]:   </devices>
Nov 30 12:40:07 user nova-compute[75672]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 12:40:07 user nova-compute[75672]:     <label>libvirt-f53f77ca-8471-4c62-a779-f64a0a4e57aa</label>
Nov 30 12:40:07 user nova-compute[75672]:     <imagelabel>libvirt-f53f77ca-8471-4c62-a779-f64a0a4e57aa</imagelabel>
Nov 30 12:40:07 user nova-compute[75672]:   </seclabel>
Nov 30 12:40:07 user nova-compute[75672]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 12:40:07 user nova-compute[75672]:     <label>+64055:+108</label>
Nov 30 12:40:07 user nova-compute[75672]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 12:40:07 user nova-compute[75672]:   </seclabel>
Nov 30 12:40:07 user nova-compute[75672]: </domain>
Nov 30 12:40:07 user nova-compute[75672]:  {{(pid=75672) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:09:e6:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3213551f-b6"/></interface> {{(pid=75672) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:09:e6:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3213551f-b6"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 30 12:40:07 user nova-compute[75672]:   <name>instance-00000011</name>
Nov 30 12:40:07 user nova-compute[75672]:   <uuid>f53f77ca-8471-4c62-a779-f64a0a4e57aa</uuid>
Nov 30 12:40:07 user nova-compute[75672]:   <metadata>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:40:07 user nova-compute[75672]:   <nova:package version="0.0.0"/>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:name>tempest-device-tagging-server-128968609</nova:name>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:creationTime>2023-11-30 12:40:06</nova:creationTime>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:flavor name="m1.tiny">
Nov 30 12:40:07 user nova-compute[75672]:     <nova:memory>512</nova:memory>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:disk>1</nova:disk>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:swap>0</nova:swap>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:vcpus>1</nova:vcpus>
Nov 30 12:40:07 user nova-compute[75672]:   </nova:flavor>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:owner>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:user uuid="b9544ed3bcf2407fac6a6a41e68e2a9c">tempest-TaggedAttachmentsTest-1737137422-project-member</nova:user>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:project uuid="3c117afa27d447fd9c8c0eb0d59c5d28">tempest-TaggedAttachmentsTest-1737137422</nova:project>
Nov 30 12:40:07 user nova-compute[75672]:   </nova:owner>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:ports>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:port uuid="20e0a542-befb-47a2-bc78-f9d4bc75ef67">
Nov 30 12:40:07 user nova-compute[75672]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 12:40:07 user nova-compute[75672]:     </nova:port>
Nov 30 12:40:07 user nova-compute[75672]:   </nova:ports>
Nov 30 12:40:07 user nova-compute[75672]: </nova:instance>
Nov 30 12:40:07 user nova-compute[75672]:   </metadata>
Nov 30 12:40:07 user nova-compute[75672]:   <memory unit='KiB'>524288</memory>
Nov 30 12:40:07 user nova-compute[75672]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 12:40:07 user nova-compute[75672]:   <vcpu placement='static'>1</vcpu>
Nov 30 12:40:07 user nova-compute[75672]:   <resource>
Nov 30 12:40:07 user nova-compute[75672]:     <partition>/machine</partition>
Nov 30 12:40:07 user nova-compute[75672]:   </resource>
Nov 30 12:40:07 user nova-compute[75672]:   <sysinfo type='smbios'>
Nov 30 12:40:07 user nova-compute[75672]:     <system>
Nov 30 12:40:07 user nova-compute[75672]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 12:40:07 user nova-compute[75672]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 12:40:07 user nova-compute[75672]:       <entry name='version'>0.0.0</entry>
Nov 30 12:40:07 user nova-compute[75672]:       <entry name='serial'>f53f77ca-8471-4c62-a779-f64a0a4e57aa</entry>
Nov 30 12:40:07 user nova-compute[75672]:       <entry name='uuid'>f53f77ca-8471-4c62-a779-f64a0a4e57aa</entry>
Nov 30 12:40:07 user nova-compute[75672]:       <entry name='family'>Virtual Machine</entry>
Nov 30 12:40:07 user nova-compute[75672]:     </system>
Nov 30 12:40:07 user nova-compute[75672]:   </sysinfo>
Nov 30 12:40:07 user nova-compute[75672]:   <os>
Nov 30 12:40:07 user nova-compute[75672]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 12:40:07 user nova-compute[75672]:     <boot dev='hd'/>
Nov 30 12:40:07 user nova-compute[75672]:     <smbios mode='sysinfo'/>
Nov 30 12:40:07 user nova-compute[75672]:   </os>
Nov 30 12:40:07 user nova-compute[75672]:   <features>
Nov 30 12:40:07 user nova-compute[75672]:     <acpi/>
Nov 30 12:40:07 user nova-compute[75672]:     <apic/>
Nov 30 12:40:07 user nova-compute[75672]:     <vmcoreinfo state='on'/>
Nov 30 12:40:07 user nova-compute[75672]:   </features>
Nov 30 12:40:07 user nova-compute[75672]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 12:40:07 user nova-compute[75672]:     <model fallback='forbid'>Nehalem</model>
Nov 30 12:40:07 user nova-compute[75672]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 12:40:07 user nova-compute[75672]:     <feature policy='require' name='vme'/>
Nov 30 12:40:07 user nova-compute[75672]:     <feature policy='require' name='x2apic'/>
Nov 30 12:40:07 user nova-compute[75672]:     <feature policy='require' name='hypervisor'/>
Nov 30 12:40:07 user nova-compute[75672]:   </cpu>
Nov 30 12:40:07 user nova-compute[75672]:   <clock offset='utc'>
Nov 30 12:40:07 user nova-compute[75672]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 12:40:07 user nova-compute[75672]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 12:40:07 user nova-compute[75672]:     <timer name='hpet' present='no'/>
Nov 30 12:40:07 user nova-compute[75672]:   </clock>
Nov 30 12:40:07 user nova-compute[75672]:   <on_poweroff>destroy</on_poweroff>
Nov 30 12:40:07 user nova-compute[75672]:   <on_reboot>restart</on_reboot>
Nov 30 12:40:07 user nova-compute[75672]:   <on_crash>destroy</on_crash>
Nov 30 12:40:07 user nova-compute[75672]:   <devices>
Nov 30 12:40:07 user nova-compute[75672]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 12:40:07 user nova-compute[75672]:     <disk type='file' device='disk'>
Nov 30 12:40:07 user nova-compute[75672]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 12:40:07 user nova-compute[75672]:       <source file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk' index='2'/>
Nov 30 12:40:07 user nova-compute[75672]:       <backingStore type='file' index='3'>
Nov 30 12:40:07 user nova-compute[75672]:         <format type='raw'/>
Nov 30 12:40:07 user nova-compute[75672]:         <source file='/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211'/>
Nov 30 12:40:07 user nova-compute[75672]:         <backingStore/>
Nov 30 12:40:07 user nova-compute[75672]:       </backingStore>
Nov 30 12:40:07 user nova-compute[75672]:       <target dev='vda' bus='virtio'/>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='virtio-disk0'/>
Nov 30 12:40:07 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </disk>
Nov 30 12:40:07 user nova-compute[75672]:     <disk type='file' device='cdrom'>
Nov 30 12:40:07 user nova-compute[75672]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 12:40:07 user nova-compute[75672]:       <source file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk.config' index='1'/>
Nov 30 12:40:07 user nova-compute[75672]:       <backingStore/>
Nov 30 12:40:07 user nova-compute[75672]:       <target dev='hda' bus='ide'/>
Nov 30 12:40:07 user nova-compute[75672]:       <readonly/>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='ide0-0-0'/>
Nov 30 12:40:07 user nova-compute[75672]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </disk>
Nov 30 12:40:07 user nova-compute[75672]:     <controller type='usb' index='0' model='none'>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='usb'/>
Nov 30 12:40:07 user nova-compute[75672]:     </controller>
Nov 30 12:40:07 user nova-compute[75672]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='pci.0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </controller>
Nov 30 12:40:07 user nova-compute[75672]:     <controller type='ide' index='0'>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='ide'/>
Nov 30 12:40:07 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 12:40:07 user nova-compute[75672]:     </controller>
Nov 30 12:40:07 user nova-compute[75672]:     <interface type='ethernet'>
Nov 30 12:40:07 user nova-compute[75672]:       <mac address='fa:16:3e:ed:94:83'/>
Nov 30 12:40:07 user nova-compute[75672]:       <target dev='tap20e0a542-be'/>
Nov 30 12:40:07 user nova-compute[75672]:       <model type='virtio'/>
Nov 30 12:40:07 user nova-compute[75672]:       <mtu size='1442'/>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='net0'/>
Nov 30 12:40:07 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </interface>
Nov 30 12:40:07 user nova-compute[75672]:     <serial type='pty'>
Nov 30 12:40:07 user nova-compute[75672]:       <source path='/dev/pts/7'/>
Nov 30 12:40:07 user nova-compute[75672]:       <log file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/console.log' append='off'/>
Nov 30 12:40:07 user nova-compute[75672]:       <target type='isa-serial' port='0'>
Nov 30 12:40:07 user nova-compute[75672]:         <model name='isa-serial'/>
Nov 30 12:40:07 user nova-compute[75672]:       </target>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='serial0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </serial>
Nov 30 12:40:07 user nova-compute[75672]:     <console type='pty' tty='/dev/pts/7'>
Nov 30 12:40:07 user nova-compute[75672]:       <source path='/dev/pts/7'/>
Nov 30 12:40:07 user nova-compute[75672]:       <log file='/opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/console.log' append='off'/>
Nov 30 12:40:07 user nova-compute[75672]:       <target type='serial' port='0'/>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='serial0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </console>
Nov 30 12:40:07 user nova-compute[75672]:     <input type='mouse' bus='ps2'>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='input0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </input>
Nov 30 12:40:07 user nova-compute[75672]:     <input type='keyboard' bus='ps2'>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='input1'/>
Nov 30 12:40:07 user nova-compute[75672]:     </input>
Nov 30 12:40:07 user nova-compute[75672]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 30 12:40:07 user nova-compute[75672]:       <listen type='address' address='0.0.0.0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </graphics>
Nov 30 12:40:07 user nova-compute[75672]:     <audio id='1' type='none'/>
Nov 30 12:40:07 user nova-compute[75672]:     <video>
Nov 30 12:40:07 user nova-compute[75672]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='video0'/>
Nov 30 12:40:07 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </video>
Nov 30 12:40:07 user nova-compute[75672]:     <memballoon model='virtio'>
Nov 30 12:40:07 user nova-compute[75672]:       <stats period='10'/>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='balloon0'/>
Nov 30 12:40:07 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </memballoon>
Nov 30 12:40:07 user nova-compute[75672]:     <rng model='virtio'>
Nov 30 12:40:07 user nova-compute[75672]:       <backend model='random'>/dev/urandom</backend>
Nov 30 12:40:07 user nova-compute[75672]:       <alias name='rng0'/>
Nov 30 12:40:07 user nova-compute[75672]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 12:40:07 user nova-compute[75672]:     </rng>
Nov 30 12:40:07 user nova-compute[75672]:   </devices>
Nov 30 12:40:07 user nova-compute[75672]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 12:40:07 user nova-compute[75672]:     <label>libvirt-f53f77ca-8471-4c62-a779-f64a0a4e57aa</label>
Nov 30 12:40:07 user nova-compute[75672]:     <imagelabel>libvirt-f53f77ca-8471-4c62-a779-f64a0a4e57aa</imagelabel>
Nov 30 12:40:07 user nova-compute[75672]:   </seclabel>
Nov 30 12:40:07 user nova-compute[75672]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 12:40:07 user nova-compute[75672]:     <label>+64055:+108</label>
Nov 30 12:40:07 user nova-compute[75672]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 12:40:07 user nova-compute[75672]:   </seclabel>
Nov 30 12:40:07 user nova-compute[75672]: </domain>
Nov 30 12:40:07 user nova-compute[75672]:  {{(pid=75672) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 12:40:07 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Detaching interface fa:16:3e:09:e6:5b failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap3213551f-b6' not found.
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-128968609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-128968609',id=17,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl6klT0bzM05mjTlIY/+hxTDH4pH81fsasTPeFhXIw9kr7DGRshU4ifFY299yAb2HtCh0ILgMcRORtuH+9N2Hw5W6pQ+sfpRUATNL8WBx7USNA23ssXCHaD8O36MbtQ5g==',key_name='tempest-keypair-2079457822',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:37:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c117afa27d447fd9c8c0eb0d59c5d28',ramdisk_id='',reservation_id='r-j719jspw',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737137422',owner_user_name='tempest-TaggedAttachmentsTest-1737137422-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9544ed3bcf2407fac6a6a41e68e2a9c',uuid=f53f77ca-8471-4c62-a779-f64a0a4e57aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3213551f-b697-44bf-818e-a4fd4cb37e72", "address": "fa:16:3e:09:e6:5b", "network": {"id": "409a923c-d899-4c3e-850c-1867d39ecd79", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1562327751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3213551f-b6", "ovs_interfaceid": "3213551f-b697-44bf-818e-a4fd4cb37e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] Converting VIF {"id": "3213551f-b697-44bf-818e-a4fd4cb37e72", "address": "fa:16:3e:09:e6:5b", "network": {"id": "409a923c-d899-4c3e-850c-1867d39ecd79", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1562327751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3213551f-b6", "ovs_interfaceid": "3213551f-b697-44bf-818e-a4fd4cb37e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:e6:5b,bridge_name='br-int',has_traffic_filtering=True,id=3213551f-b697-44bf-818e-a4fd4cb37e72,network=Network(409a923c-d899-4c3e-850c-1867d39ecd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3213551f-b6') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG os_vif [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:e6:5b,bridge_name='br-int',has_traffic_filtering=True,id=3213551f-b697-44bf-818e-a4fd4cb37e72,network=Network(409a923c-d899-4c3e-850c-1867d39ecd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3213551f-b6') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3213551f-b6, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:40:07 user nova-compute[75672]: INFO os_vif [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:e6:5b,bridge_name='br-int',has_traffic_filtering=True,id=3213551f-b697-44bf-818e-a4fd4cb37e72,network=Network(409a923c-d899-4c3e-850c-1867d39ecd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3213551f-b6')
Nov 30 12:40:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [req-97c7c80b-e436-4add-8cbd-b3dafe3f24b5 req-808aadb9-0fd0-4e15-944c-0f8865293f56 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:40:07 user nova-compute[75672]:   <nova:package version="0.0.0"/>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:name>tempest-device-tagging-server-128968609</nova:name>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:creationTime>2023-11-30 12:40:07</nova:creationTime>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:flavor name="m1.tiny">
Nov 30 12:40:07 user nova-compute[75672]:     <nova:memory>512</nova:memory>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:disk>1</nova:disk>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:swap>0</nova:swap>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:vcpus>1</nova:vcpus>
Nov 30 12:40:07 user nova-compute[75672]:   </nova:flavor>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:owner>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:user uuid="b9544ed3bcf2407fac6a6a41e68e2a9c">tempest-TaggedAttachmentsTest-1737137422-project-member</nova:user>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:project uuid="3c117afa27d447fd9c8c0eb0d59c5d28">tempest-TaggedAttachmentsTest-1737137422</nova:project>
Nov 30 12:40:07 user nova-compute[75672]:   </nova:owner>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:40:07 user nova-compute[75672]:   <nova:ports>
Nov 30 12:40:07 user nova-compute[75672]:     <nova:port uuid="20e0a542-befb-47a2-bc78-f9d4bc75ef67">
Nov 30 12:40:07 user nova-compute[75672]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 12:40:07 user nova-compute[75672]:     </nova:port>
Nov 30 12:40:07 user nova-compute[75672]:   </nova:ports>
Nov 30 12:40:07 user nova-compute[75672]: </nova:instance>
Nov 30 12:40:07 user nova-compute[75672]:  {{(pid=75672) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 30 12:40:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Updating instance_info_cache with network_info: [{"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:40:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Releasing lock "refresh_cache-f53f77ca-8471-4c62-a779-f64a0a4e57aa" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:40:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6158ed80-39ec-4eb0-816b-b4b7c5df3665 tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "interface-f53f77ca-8471-4c62-a779-f64a0a4e57aa-3213551f-b697-44bf-818e-a4fd4cb37e72" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.785s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:40:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:40:09 user nova-compute[75672]: INFO nova.compute.claims [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Claim successful on node user
Nov 30 12:40:10 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:40:10 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:40:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:10 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:40:10 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:40:10 user nova-compute[75672]: DEBUG nova.network.neutron [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:40:10 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:40:10 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:40:10 user nova-compute[75672]: DEBUG nova.policy [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c663fb001aa64ec6a8e5861449ec2bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc2e7dfcbff457c9e394b1e5d0d23e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:40:10 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:40:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:40:10 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Creating image(s)
Nov 30 12:40:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "/opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "/opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "/opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea.part --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG nova.network.neutron [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Successfully created port: 1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea.part --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG nova.virt.images [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] 1fd06ffb-4611-4ca5-a581-f0dfec4e24a8 was qcow2, converting to raw {{(pid=75672) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea.part /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea.converted {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea.part /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea.converted" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea.converted --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea.converted --force-share --output=json" returned: 0 in 0.288s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.148s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea --force-share --output=json" returned: 0 in 0.198s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.network.neutron [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Successfully updated port: 1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea --force-share --output=json" returned: 0 in 0.186s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea,backing_fmt=raw /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.compute.manager [req-8976b0a7-82d4-44b8-b3c2-63023441f1d4 req-44f93de7-1a25-4d10-8e12-22cf2f82838f service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-changed-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.compute.manager [req-8976b0a7-82d4-44b8-b3c2-63023441f1d4 req-44f93de7-1a25-4d10-8e12-22cf2f82838f service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Refreshing instance network info cache due to event network-changed-1a9e56c6-c320-4afe-9ae3-d1ddca150724. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8976b0a7-82d4-44b8-b3c2-63023441f1d4 req-44f93de7-1a25-4d10-8e12-22cf2f82838f service nova] Acquiring lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8976b0a7-82d4-44b8-b3c2-63023441f1d4 req-44f93de7-1a25-4d10-8e12-22cf2f82838f service nova] Acquired lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.network.neutron [req-8976b0a7-82d4-44b8-b3c2-63023441f1d4 req-44f93de7-1a25-4d10-8e12-22cf2f82838f service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Refreshing network info cache for port 1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea,backing_fmt=raw /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk 1073741824" returned: 0 in 0.053s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.network.neutron [req-8976b0a7-82d4-44b8-b3c2-63023441f1d4 req-44f93de7-1a25-4d10-8e12-22cf2f82838f service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea --force-share --output=json" returned: 0 in 0.195s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.network.neutron [req-8976b0a7-82d4-44b8-b3c2-63023441f1d4 req-44f93de7-1a25-4d10-8e12-22cf2f82838f service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8976b0a7-82d4-44b8-b3c2-63023441f1d4 req-44f93de7-1a25-4d10-8e12-22cf2f82838f service nova] Releasing lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquired lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.network.neutron [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.network.neutron [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Cannot resize image /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Ensure instance console log exists: /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.network.neutron [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Updating instance_info_cache with network_info: [{"id": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "address": "fa:16:3e:bd:1f:55", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9e56c6-c3", "ovs_interfaceid": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Releasing lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Instance network_info: |[{"id": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "address": "fa:16:3e:bd:1f:55", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9e56c6-c3", "ovs_interfaceid": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Start _get_guest_xml network_info=[{"id": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "address": "fa:16:3e:bd:1f:55", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9e56c6-c3", "ovs_interfaceid": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:40:07Z,direct_url=<?>,disk_format='qcow2',id=1fd06ffb-4611-4ca5-a581-f0dfec4e24a8,min_disk=0,min_ram=0,name='tempest-scenario-img--238527859',owner='ebc2e7dfcbff457c9e394b1e5d0d23e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:40:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': '1fd06ffb-4611-4ca5-a581-f0dfec4e24a8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:40:12 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:40:12 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:40:07Z,direct_url=<?>,disk_format='qcow2',id=1fd06ffb-4611-4ca5-a581-f0dfec4e24a8,min_disk=0,min_ram=0,name='tempest-scenario-img--238527859',owner='ebc2e7dfcbff457c9e394b1e5d0d23e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:40:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-288700133',display_name='tempest-TestMinimumBasicScenario-server-288700133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-288700133',id=24,image_ref='1fd06ffb-4611-4ca5-a581-f0dfec4e24a8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+NKdDgCCLODYWhObm6nfZvQ+lqNaHUCf/r3dsyiCFT7WQ5ffknXihC91em5wy/sgYFziPZ0GCJqHlF8dRTe3+FiZwbYva78zPGlah21XeEQmQAOsySHLYariVK0Ca3KA==',key_name='tempest-TestMinimumBasicScenario-123450134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc2e7dfcbff457c9e394b1e5d0d23e6',ramdisk_id='',reservation_id='r-pio6fc7w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1fd06ffb-4611-4ca5-a581-f0dfec4e24a8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-950497565',owner_user_name='tempest-TestMinimumBasicScenario-950497565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:40:10Z,user_data=None,user_id='c663fb001aa64ec6a8e5861449ec2bbb',uuid=9db955e1-4b9b-4627-b604-5f07ef8e5ad4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "address": "fa:16:3e:bd:1f:55", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9e56c6-c3", "ovs_interfaceid": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converting VIF {"id": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "address": "fa:16:3e:bd:1f:55", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9e56c6-c3", "ovs_interfaceid": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:55,bridge_name='br-int',has_traffic_filtering=True,id=1a9e56c6-c320-4afe-9ae3-d1ddca150724,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9e56c6-c3') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.objects.instance [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'pci_devices' on Instance uuid 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:40:12 user nova-compute[75672]:   <uuid>9db955e1-4b9b-4627-b604-5f07ef8e5ad4</uuid>
Nov 30 12:40:12 user nova-compute[75672]:   <name>instance-00000018</name>
Nov 30 12:40:12 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:40:12 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:40:12 user nova-compute[75672]:   <metadata>
Nov 30 12:40:12 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:40:12 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:40:12 user nova-compute[75672]:       <nova:name>tempest-TestMinimumBasicScenario-server-288700133</nova:name>
Nov 30 12:40:12 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:40:12</nova:creationTime>
Nov 30 12:40:12 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:40:12 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:40:12 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:40:12 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:40:12 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:40:12 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:40:12 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:40:12 user nova-compute[75672]:       <nova:owner>
Nov 30 12:40:12 user nova-compute[75672]:         <nova:user uuid="c663fb001aa64ec6a8e5861449ec2bbb">tempest-TestMinimumBasicScenario-950497565-project-member</nova:user>
Nov 30 12:40:12 user nova-compute[75672]:         <nova:project uuid="ebc2e7dfcbff457c9e394b1e5d0d23e6">tempest-TestMinimumBasicScenario-950497565</nova:project>
Nov 30 12:40:12 user nova-compute[75672]:       </nova:owner>
Nov 30 12:40:12 user nova-compute[75672]:       <nova:root type="image" uuid="1fd06ffb-4611-4ca5-a581-f0dfec4e24a8"/>
Nov 30 12:40:12 user nova-compute[75672]:       <nova:ports>
Nov 30 12:40:12 user nova-compute[75672]:         <nova:port uuid="1a9e56c6-c320-4afe-9ae3-d1ddca150724">
Nov 30 12:40:12 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 12:40:12 user nova-compute[75672]:         </nova:port>
Nov 30 12:40:12 user nova-compute[75672]:       </nova:ports>
Nov 30 12:40:12 user nova-compute[75672]:     </nova:instance>
Nov 30 12:40:12 user nova-compute[75672]:   </metadata>
Nov 30 12:40:12 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:40:12 user nova-compute[75672]:     <system>
Nov 30 12:40:12 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:40:12 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:40:12 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:40:12 user nova-compute[75672]:       <entry name="serial">9db955e1-4b9b-4627-b604-5f07ef8e5ad4</entry>
Nov 30 12:40:12 user nova-compute[75672]:       <entry name="uuid">9db955e1-4b9b-4627-b604-5f07ef8e5ad4</entry>
Nov 30 12:40:12 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:40:12 user nova-compute[75672]:     </system>
Nov 30 12:40:12 user nova-compute[75672]:   </sysinfo>
Nov 30 12:40:12 user nova-compute[75672]:   <os>
Nov 30 12:40:12 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:40:12 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:40:12 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:40:12 user nova-compute[75672]:   </os>
Nov 30 12:40:12 user nova-compute[75672]:   <features>
Nov 30 12:40:12 user nova-compute[75672]:     <acpi/>
Nov 30 12:40:12 user nova-compute[75672]:     <apic/>
Nov 30 12:40:12 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:40:12 user nova-compute[75672]:   </features>
Nov 30 12:40:12 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:40:12 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:40:12 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:40:12 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:40:12 user nova-compute[75672]:   </clock>
Nov 30 12:40:12 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:40:12 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:40:12 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:40:12 user nova-compute[75672]:   </cpu>
Nov 30 12:40:12 user nova-compute[75672]:   <devices>
Nov 30 12:40:12 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:40:12 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:40:12 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk"/>
Nov 30 12:40:12 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:40:12 user nova-compute[75672]:     </disk>
Nov 30 12:40:12 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:40:12 user nova-compute[75672]:       <mac address="fa:16:3e:bd:1f:55"/>
Nov 30 12:40:12 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:40:12 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:40:12 user nova-compute[75672]:       <target dev="tap1a9e56c6-c3"/>
Nov 30 12:40:12 user nova-compute[75672]:     </interface>
Nov 30 12:40:12 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:40:12 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/console.log" append="off"/>
Nov 30 12:40:12 user nova-compute[75672]:     </serial>
Nov 30 12:40:12 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:40:12 user nova-compute[75672]:     <video>
Nov 30 12:40:12 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:40:12 user nova-compute[75672]:     </video>
Nov 30 12:40:12 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:40:12 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:40:12 user nova-compute[75672]:     </rng>
Nov 30 12:40:12 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:40:12 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:40:12 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:40:12 user nova-compute[75672]:     </memballoon>
Nov 30 12:40:12 user nova-compute[75672]:   </devices>
Nov 30 12:40:12 user nova-compute[75672]: </domain>
Nov 30 12:40:12 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-288700133',display_name='tempest-TestMinimumBasicScenario-server-288700133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-288700133',id=24,image_ref='1fd06ffb-4611-4ca5-a581-f0dfec4e24a8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+NKdDgCCLODYWhObm6nfZvQ+lqNaHUCf/r3dsyiCFT7WQ5ffknXihC91em5wy/sgYFziPZ0GCJqHlF8dRTe3+FiZwbYva78zPGlah21XeEQmQAOsySHLYariVK0Ca3KA==',key_name='tempest-TestMinimumBasicScenario-123450134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc2e7dfcbff457c9e394b1e5d0d23e6',ramdisk_id='',reservation_id='r-pio6fc7w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1fd06ffb-4611-4ca5-a581-f0dfec4e24a8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-950497565',owner_user_name='tempest-TestMinimumBasicScenario-950497565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:40:10Z,user_data=None,user_id='c663fb001aa64ec6a8e5861449ec2bbb',uuid=9db955e1-4b9b-4627-b604-5f07ef8e5ad4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "address": "fa:16:3e:bd:1f:55", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9e56c6-c3", "ovs_interfaceid": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converting VIF {"id": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "address": "fa:16:3e:bd:1f:55", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9e56c6-c3", "ovs_interfaceid": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:55,bridge_name='br-int',has_traffic_filtering=True,id=1a9e56c6-c320-4afe-9ae3-d1ddca150724,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9e56c6-c3') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG os_vif [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:55,bridge_name='br-int',has_traffic_filtering=True,id=1a9e56c6-c320-4afe-9ae3-d1ddca150724,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9e56c6-c3') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ca6b95d-7ff4-5f55-9e13-50d531e72d44', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a9e56c6-c3, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a9e56c6-c3, col_values=(('qos', UUID('95f8eac6-d7ff-46fb-9610-d80813042c7f')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a9e56c6-c3, col_values=(('external_ids', {'iface-id': '1a9e56c6-c320-4afe-9ae3-d1ddca150724', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:1f:55', 'vm-uuid': '9db955e1-4b9b-4627-b604-5f07ef8e5ad4'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:12 user nova-compute[75672]: INFO os_vif [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:55,bridge_name='br-int',has_traffic_filtering=True,id=1a9e56c6-c320-4afe-9ae3-d1ddca150724,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9e56c6-c3')
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:40:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] No VIF found with MAC fa:16:3e:bd:1f:55, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:40:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-d3ef35bf-f833-4914-9069-51a1731db07b req-ffaa30e6-4290-4bb1-95a0-bbb51d8c19c4 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d3ef35bf-f833-4914-9069-51a1731db07b req-ffaa30e6-4290-4bb1-95a0-bbb51d8c19c4 service nova] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d3ef35bf-f833-4914-9069-51a1731db07b req-ffaa30e6-4290-4bb1-95a0-bbb51d8c19c4 service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d3ef35bf-f833-4914-9069-51a1731db07b req-ffaa30e6-4290-4bb1-95a0-bbb51d8c19c4 service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-d3ef35bf-f833-4914-9069-51a1731db07b req-ffaa30e6-4290-4bb1-95a0-bbb51d8c19c4 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] No waiting events found dispatching network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:40:14 user nova-compute[75672]: WARNING nova.compute.manager [req-d3ef35bf-f833-4914-9069-51a1731db07b req-ffaa30e6-4290-4bb1-95a0-bbb51d8c19c4 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received unexpected event network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 for instance with vm_state building and task_state spawning.
Nov 30 12:40:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:15 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:40:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:15 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:40:15 user nova-compute[75672]: INFO nova.compute.claims [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Claim successful on node user
Nov 30 12:40:15 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:40:15 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.network.neutron [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:40:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.policy [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61c6bf770dfe4eadba28f371b29f1d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d2f3e56844b68b3a0c71f8a7f5454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:40:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Creating image(s)
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "/opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "/opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "/opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.170s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:40:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Instance spawned successfully.
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.compute.manager [req-5432fb8b-ff93-4e37-8003-70c278e0a14e req-39424b94-b7bf-4722-8d1d-038dd7c91617 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5432fb8b-ff93-4e37-8003-70c278e0a14e req-39424b94-b7bf-4722-8d1d-038dd7c91617 service nova] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5432fb8b-ff93-4e37-8003-70c278e0a14e req-39424b94-b7bf-4722-8d1d-038dd7c91617 service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5432fb8b-ff93-4e37-8003-70c278e0a14e req-39424b94-b7bf-4722-8d1d-038dd7c91617 service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.compute.manager [req-5432fb8b-ff93-4e37-8003-70c278e0a14e req-39424b94-b7bf-4722-8d1d-038dd7c91617 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] No waiting events found dispatching network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:40:16 user nova-compute[75672]: WARNING nova.compute.manager [req-5432fb8b-ff93-4e37-8003-70c278e0a14e req-39424b94-b7bf-4722-8d1d-038dd7c91617 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received unexpected event network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 for instance with vm_state building and task_state spawning.
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.213s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:16 user nova-compute[75672]: INFO nova.compute.manager [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 30 12:40:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk 1073741824" returned: 0 in 0.239s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.455s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:17 user nova-compute[75672]: INFO nova.compute.manager [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Took 7.33 seconds to build instance.
Nov 30 12:40:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8e3caf5f-82eb-40a9-bb90-56313f4ec51a tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.422s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG nova.network.neutron [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Successfully created port: e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Cannot resize image /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Ensure instance console log exists: /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG nova.network.neutron [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Successfully updated port: e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquired lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG nova.network.neutron [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:17 user nova-compute[75672]: DEBUG nova.network.neutron [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.network.neutron [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Updating instance_info_cache with network_info: [{"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Releasing lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Instance network_info: |[{"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Start _get_guest_xml network_info=[{"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:40:18 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:40:18 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:40:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1869500337',display_name='tempest-ServerRescueNegativeTestJSON-server-1869500337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1869500337',id=25,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKvX8kREpKHdh7QTeqLrDuWRIr/0HgYYg/g29TAlyvhlnFXG14JSKT5CfnTGyflUqYYfYdN7lRf5nU1oNeKgDqmKR3vKW6jKYX535rLOk8b3qYyPl+hAKXOZnV2LrefZA==',key_name='tempest-keypair-1145147896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='601d2f3e56844b68b3a0c71f8a7f5454',ramdisk_id='',reservation_id='r-res9s6m6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-928198583',owner_user_name='tempest-ServerRescueNegativeTestJSON-928198583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:40:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61c6bf770dfe4eadba28f371b29f1d79',uuid=b06bea0f-9186-4ab8-8bad-588beb48a1f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converting VIF {"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e5d9e2a3-ef19-41bb-b090-13c40c8986ee,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5d9e2a3-ef') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.objects.instance [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'pci_devices' on Instance uuid b06bea0f-9186-4ab8-8bad-588beb48a1f1 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:40:18 user nova-compute[75672]:   <uuid>b06bea0f-9186-4ab8-8bad-588beb48a1f1</uuid>
Nov 30 12:40:18 user nova-compute[75672]:   <name>instance-00000019</name>
Nov 30 12:40:18 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:40:18 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:40:18 user nova-compute[75672]:   <metadata>
Nov 30 12:40:18 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:40:18 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:40:18 user nova-compute[75672]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1869500337</nova:name>
Nov 30 12:40:18 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:40:18</nova:creationTime>
Nov 30 12:40:18 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:40:18 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:40:18 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:40:18 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:40:18 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:40:18 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:40:18 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:40:18 user nova-compute[75672]:       <nova:owner>
Nov 30 12:40:18 user nova-compute[75672]:         <nova:user uuid="61c6bf770dfe4eadba28f371b29f1d79">tempest-ServerRescueNegativeTestJSON-928198583-project-member</nova:user>
Nov 30 12:40:18 user nova-compute[75672]:         <nova:project uuid="601d2f3e56844b68b3a0c71f8a7f5454">tempest-ServerRescueNegativeTestJSON-928198583</nova:project>
Nov 30 12:40:18 user nova-compute[75672]:       </nova:owner>
Nov 30 12:40:18 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:40:18 user nova-compute[75672]:       <nova:ports>
Nov 30 12:40:18 user nova-compute[75672]:         <nova:port uuid="e5d9e2a3-ef19-41bb-b090-13c40c8986ee">
Nov 30 12:40:18 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 12:40:18 user nova-compute[75672]:         </nova:port>
Nov 30 12:40:18 user nova-compute[75672]:       </nova:ports>
Nov 30 12:40:18 user nova-compute[75672]:     </nova:instance>
Nov 30 12:40:18 user nova-compute[75672]:   </metadata>
Nov 30 12:40:18 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:40:18 user nova-compute[75672]:     <system>
Nov 30 12:40:18 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:40:18 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:40:18 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:40:18 user nova-compute[75672]:       <entry name="serial">b06bea0f-9186-4ab8-8bad-588beb48a1f1</entry>
Nov 30 12:40:18 user nova-compute[75672]:       <entry name="uuid">b06bea0f-9186-4ab8-8bad-588beb48a1f1</entry>
Nov 30 12:40:18 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:40:18 user nova-compute[75672]:     </system>
Nov 30 12:40:18 user nova-compute[75672]:   </sysinfo>
Nov 30 12:40:18 user nova-compute[75672]:   <os>
Nov 30 12:40:18 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:40:18 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:40:18 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:40:18 user nova-compute[75672]:   </os>
Nov 30 12:40:18 user nova-compute[75672]:   <features>
Nov 30 12:40:18 user nova-compute[75672]:     <acpi/>
Nov 30 12:40:18 user nova-compute[75672]:     <apic/>
Nov 30 12:40:18 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:40:18 user nova-compute[75672]:   </features>
Nov 30 12:40:18 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:40:18 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:40:18 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:40:18 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:40:18 user nova-compute[75672]:   </clock>
Nov 30 12:40:18 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:40:18 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:40:18 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:40:18 user nova-compute[75672]:   </cpu>
Nov 30 12:40:18 user nova-compute[75672]:   <devices>
Nov 30 12:40:18 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:40:18 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:40:18 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk"/>
Nov 30 12:40:18 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:40:18 user nova-compute[75672]:     </disk>
Nov 30 12:40:18 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:40:18 user nova-compute[75672]:       <mac address="fa:16:3e:64:5c:19"/>
Nov 30 12:40:18 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:40:18 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:40:18 user nova-compute[75672]:       <target dev="tape5d9e2a3-ef"/>
Nov 30 12:40:18 user nova-compute[75672]:     </interface>
Nov 30 12:40:18 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:40:18 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/console.log" append="off"/>
Nov 30 12:40:18 user nova-compute[75672]:     </serial>
Nov 30 12:40:18 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:40:18 user nova-compute[75672]:     <video>
Nov 30 12:40:18 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:40:18 user nova-compute[75672]:     </video>
Nov 30 12:40:18 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:40:18 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:40:18 user nova-compute[75672]:     </rng>
Nov 30 12:40:18 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:40:18 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:40:18 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:40:18 user nova-compute[75672]:     </memballoon>
Nov 30 12:40:18 user nova-compute[75672]:   </devices>
Nov 30 12:40:18 user nova-compute[75672]: </domain>
Nov 30 12:40:18 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:40:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1869500337',display_name='tempest-ServerRescueNegativeTestJSON-server-1869500337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1869500337',id=25,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKvX8kREpKHdh7QTeqLrDuWRIr/0HgYYg/g29TAlyvhlnFXG14JSKT5CfnTGyflUqYYfYdN7lRf5nU1oNeKgDqmKR3vKW6jKYX535rLOk8b3qYyPl+hAKXOZnV2LrefZA==',key_name='tempest-keypair-1145147896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='601d2f3e56844b68b3a0c71f8a7f5454',ramdisk_id='',reservation_id='r-res9s6m6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-928198583',owner_user_name='tempest-ServerRescueNegativeTestJSON-928198583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:40:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61c6bf770dfe4eadba28f371b29f1d79',uuid=b06bea0f-9186-4ab8-8bad-588beb48a1f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converting VIF {"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e5d9e2a3-ef19-41bb-b090-13c40c8986ee,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5d9e2a3-ef') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG os_vif [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e5d9e2a3-ef19-41bb-b090-13c40c8986ee,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5d9e2a3-ef') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb403721-4aa5-5a6f-b347-662e5f97ce73', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5d9e2a3-ef, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5d9e2a3-ef, col_values=(('qos', UUID('d5b05e75-848c-4d21-a725-f32870bebf5d')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5d9e2a3-ef, col_values=(('external_ids', {'iface-id': 'e5d9e2a3-ef19-41bb-b090-13c40c8986ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:5c:19', 'vm-uuid': 'b06bea0f-9186-4ab8-8bad-588beb48a1f1'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:18 user nova-compute[75672]: INFO os_vif [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e5d9e2a3-ef19-41bb-b090-13c40c8986ee,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5d9e2a3-ef')
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No VIF found with MAC fa:16:3e:64:5c:19, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.compute.manager [req-564fe430-9c37-4435-bb58-58bd33319fdd req-ed68e95f-3653-4e59-99f5-079767b5059c service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-changed-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.compute.manager [req-564fe430-9c37-4435-bb58-58bd33319fdd req-ed68e95f-3653-4e59-99f5-079767b5059c service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Refreshing instance network info cache due to event network-changed-e5d9e2a3-ef19-41bb-b090-13c40c8986ee. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-564fe430-9c37-4435-bb58-58bd33319fdd req-ed68e95f-3653-4e59-99f5-079767b5059c service nova] Acquiring lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-564fe430-9c37-4435-bb58-58bd33319fdd req-ed68e95f-3653-4e59-99f5-079767b5059c service nova] Acquired lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:40:18 user nova-compute[75672]: DEBUG nova.network.neutron [req-564fe430-9c37-4435-bb58-58bd33319fdd req-ed68e95f-3653-4e59-99f5-079767b5059c service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Refreshing network info cache for port e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:40:19 user nova-compute[75672]: DEBUG nova.network.neutron [req-564fe430-9c37-4435-bb58-58bd33319fdd req-ed68e95f-3653-4e59-99f5-079767b5059c service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Updated VIF entry in instance network info cache for port e5d9e2a3-ef19-41bb-b090-13c40c8986ee. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:40:19 user nova-compute[75672]: DEBUG nova.network.neutron [req-564fe430-9c37-4435-bb58-58bd33319fdd req-ed68e95f-3653-4e59-99f5-079767b5059c service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Updating instance_info_cache with network_info: [{"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:40:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-564fe430-9c37-4435-bb58-58bd33319fdd req-ed68e95f-3653-4e59-99f5-079767b5059c service nova] Releasing lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:40:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-d5e5c915-a77e-44bc-a765-3d86b0526b64 req-9fce5958-9490-458c-a282-447f664509f5 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d5e5c915-a77e-44bc-a765-3d86b0526b64 req-9fce5958-9490-458c-a282-447f664509f5 service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d5e5c915-a77e-44bc-a765-3d86b0526b64 req-9fce5958-9490-458c-a282-447f664509f5 service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d5e5c915-a77e-44bc-a765-3d86b0526b64 req-9fce5958-9490-458c-a282-447f664509f5 service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-d5e5c915-a77e-44bc-a765-3d86b0526b64 req-9fce5958-9490-458c-a282-447f664509f5 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:40:20 user nova-compute[75672]: WARNING nova.compute.manager [req-d5e5c915-a77e-44bc-a765-3d86b0526b64 req-9fce5958-9490-458c-a282-447f664509f5 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received unexpected event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with vm_state building and task_state spawning.
Nov 30 12:40:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-d5e5c915-a77e-44bc-a765-3d86b0526b64 req-9fce5958-9490-458c-a282-447f664509f5 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d5e5c915-a77e-44bc-a765-3d86b0526b64 req-9fce5958-9490-458c-a282-447f664509f5 service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d5e5c915-a77e-44bc-a765-3d86b0526b64 req-9fce5958-9490-458c-a282-447f664509f5 service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d5e5c915-a77e-44bc-a765-3d86b0526b64 req-9fce5958-9490-458c-a282-447f664509f5 service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-d5e5c915-a77e-44bc-a765-3d86b0526b64 req-9fce5958-9490-458c-a282-447f664509f5 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:40:20 user nova-compute[75672]: WARNING nova.compute.manager [req-d5e5c915-a77e-44bc-a765-3d86b0526b64 req-9fce5958-9490-458c-a282-447f664509f5 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received unexpected event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with vm_state building and task_state spawning.
Nov 30 12:40:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-7f578bd9-9526-4d0d-a9e8-d0ec29c42bae req-36e2e169-72fd-418f-8e59-91b2466904f6 service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Received event network-changed-a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-7f578bd9-9526-4d0d-a9e8-d0ec29c42bae req-36e2e169-72fd-418f-8e59-91b2466904f6 service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Refreshing instance network info cache due to event network-changed-a5f78084-b8e7-44f5-a614-ae1e4b0e189d. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:40:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7f578bd9-9526-4d0d-a9e8-d0ec29c42bae req-36e2e169-72fd-418f-8e59-91b2466904f6 service nova] Acquiring lock "refresh_cache-492a3775-dc6e-4c94-9ce0-26bc2da43e24" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:40:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7f578bd9-9526-4d0d-a9e8-d0ec29c42bae req-36e2e169-72fd-418f-8e59-91b2466904f6 service nova] Acquired lock "refresh_cache-492a3775-dc6e-4c94-9ce0-26bc2da43e24" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:40:21 user nova-compute[75672]: DEBUG nova.network.neutron [req-7f578bd9-9526-4d0d-a9e8-d0ec29c42bae req-36e2e169-72fd-418f-8e59-91b2466904f6 service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Refreshing network info cache for port a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:40:21 user nova-compute[75672]: DEBUG nova.network.neutron [req-7f578bd9-9526-4d0d-a9e8-d0ec29c42bae req-36e2e169-72fd-418f-8e59-91b2466904f6 service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Updated VIF entry in instance network info cache for port a5f78084-b8e7-44f5-a614-ae1e4b0e189d. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:40:21 user nova-compute[75672]: DEBUG nova.network.neutron [req-7f578bd9-9526-4d0d-a9e8-d0ec29c42bae req-36e2e169-72fd-418f-8e59-91b2466904f6 service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Updating instance_info_cache with network_info: [{"id": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "address": "fa:16:3e:3e:9e:81", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f78084-b8", "ovs_interfaceid": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:40:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7f578bd9-9526-4d0d-a9e8-d0ec29c42bae req-36e2e169-72fd-418f-8e59-91b2466904f6 service nova] Releasing lock "refresh_cache-492a3775-dc6e-4c94-9ce0-26bc2da43e24" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:40:22 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:40:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:40:22 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Instance spawned successfully.
Nov 30 12:40:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:40:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:22 user nova-compute[75672]: INFO nova.compute.manager [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 30 12:40:22 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:40:22 user nova-compute[75672]: INFO nova.compute.manager [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Took 6.95 seconds to build instance.
Nov 30 12:40:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0dee8b14-7768-4973-b844-21170bd199de tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.051s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'flavor' on Instance uuid 492a3775-dc6e-4c94-9ce0-26bc2da43e24 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:24 user nova-compute[75672]: INFO nova.compute.manager [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Attaching volume 512469b6-9572-436c-97a3-d3fe737fe1ce to /dev/vdb
Nov 30 12:40:24 user nova-compute[75672]: DEBUG os_brick.utils [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b079cd54-4ad9-46eb-838c-34b61c957b0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdeb5fc-ca6b-45a3-8b15-bcadf5455a16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4454cce9-d76a-4f01-b30b-bc349d3cc432]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcb116d-b56c-4a82-b768-8a71139bcb0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:40:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:40:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:40:25 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:40:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec11d7b3-781c-44a2-883d-8d5632d95856]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:40:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:40:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:40:25 user nova-compute[75672]: DEBUG os_brick.utils [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:40:25 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Updating existing volume attachment record: 2c874c26-2bb3-4086-8a5a-9dae27b28c04 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:40:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:32 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:40:32 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:40:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:40:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:40:32 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:40:33 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Updating instance_info_cache with network_info: [{"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:40:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:40:33 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:40:33 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:40:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:33 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:40:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "0a41ad0b-978b-4931-a30c-573e20f166a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:33 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:40:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:33 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:40:33 user nova-compute[75672]: INFO nova.compute.claims [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Claim successful on node user
Nov 30 12:40:34 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:40:34 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:40:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:40:34 user nova-compute[75672]: INFO nova.virt.block_device [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Booting with volume caee8471-7089-44b3-889a-56cc0df84480 at /dev/vda
Nov 30 12:40:34 user nova-compute[75672]: DEBUG os_brick.utils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[13767793-f0b2-476a-aae9-e0feb1a35a94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cade88-4e69-4c27-997b-c7a2ea086d66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2441b4f-a59d-4efe-b98f-791789b4400b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[255dd8c9-254e-472f-805f-4b87e289a41a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG nova.policy [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '924cf8ff73154f8fadb371175a0d8fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513644b3a140400dbdf6b07e8e727dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:40:34 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ae02e8-a5a5-4c96-a4a4-ffb04bf995f6]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG os_brick.utils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Updating existing volume attachment record: 7e0bff33-b8b4-41dc-a269-94f7b6ed7b8e {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsAZzihr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:40:34 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:40:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:40:34 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:40:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:40:34 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39f1444-2697-47ca-9344-21cb3b19452d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:40:34 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c03485b-2252-42d5-8e93-6a1303541859]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce] added
Nov 30 12:40:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deb96dc-e000-42ed-bf86-270c001d0c6b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c24497e-9f15-4dc6-8b68-6988e30a83c9]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TsAZzihr {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TsAZzihr" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[131076d4-5bc4-40f5-9036-e7548e2df160]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TsAZzihr'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[26049691-923d-430b-92c5-90cb8910b2e3]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a1fc67-e21d-49f2-ade9-c968d71ad124]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:40:35 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:40:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:40:35 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:40:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1acacea-1e2b-494d-b476-a0bf5b75875a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce, portal: 172.16.0.220,3260]
Nov 30 12:40:35 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce, portal: 172.16.0.220,3260] successful.
Nov 30 12:40:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b2fca9-2b69-4d88-afdd-b088424dea98]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eeb7957-9446-472d-a02b-4605f67f0458]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:40:35 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:40:35 user nova-compute[75672]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)
Nov 30 12:40:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:40:35 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:40:35 user nova-compute[75672]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)
Nov 30 12:40:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[609e2b43-a988-45d1-a757-b69b8579670f]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsAZzihr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG nova.compute.manager [req-5dc15836-75b4-4379-95ca-ba6ab325e657 req-1038bacc-91b1-45b7-a0ae-94409ada9f0e service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received event network-changed-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG nova.compute.manager [req-5dc15836-75b4-4379-95ca-ba6ab325e657 req-1038bacc-91b1-45b7-a0ae-94409ada9f0e service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Refreshing instance network info cache due to event network-changed-449f9465-ff37-41ba-a779-b6791644bfbe. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5dc15836-75b4-4379-95ca-ba6ab325e657 req-1038bacc-91b1-45b7-a0ae-94409ada9f0e service nova] Acquiring lock "refresh_cache-76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5dc15836-75b4-4379-95ca-ba6ab325e657 req-1038bacc-91b1-45b7-a0ae-94409ada9f0e service nova] Acquired lock "refresh_cache-76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:40:35 user nova-compute[75672]: DEBUG nova.network.neutron [req-5dc15836-75b4-4379-95ca-ba6ab325e657 req-1038bacc-91b1-45b7-a0ae-94409ada9f0e service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Refreshing network info cache for port 449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Successfully created port: 4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG nova.network.neutron [req-5dc15836-75b4-4379-95ca-ba6ab325e657 req-1038bacc-91b1-45b7-a0ae-94409ada9f0e service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Updated VIF entry in instance network info cache for port 449f9465-ff37-41ba-a779-b6791644bfbe. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG nova.network.neutron [req-5dc15836-75b4-4379-95ca-ba6ab325e657 req-1038bacc-91b1-45b7-a0ae-94409ada9f0e service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Updating instance_info_cache with network_info: [{"id": "449f9465-ff37-41ba-a779-b6791644bfbe", "address": "fa:16:3e:16:c6:38", "network": {"id": "3fb890d7-13c7-46cd-a675-2e37f8faebcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1255737074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af7cfb45ca64a1ab37299ecbc1a1ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449f9465-ff", "ovs_interfaceid": "449f9465-ff37-41ba-a779-b6791644bfbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5dc15836-75b4-4379-95ca-ba6ab325e657 req-1038bacc-91b1-45b7-a0ae-94409ada9f0e service nova] Releasing lock "refresh_cache-76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26138346365643662', 'path': '/dev/sdd'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138346365643662', 'path': '/dev/sdd'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'flavor' on Instance uuid 492a3775-dc6e-4c94-9ce0-26bc2da43e24 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:40:36 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:40:36 user nova-compute[75672]:   <source dev="/dev/sdd"/>
Nov 30 12:40:36 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:40:36 user nova-compute[75672]:   <serial>512469b6-9572-436c-97a3-d3fe737fe1ce</serial>
Nov 30 12:40:36 user nova-compute[75672]: </disk>
Nov 30 12:40:36 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG nova.objects.instance [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lazy-loading 'flavor' on Instance uuid 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Successfully updated port: 4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "refresh_cache-0a41ad0b-978b-4931-a30c-573e20f166a8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquired lock "refresh_cache-0a41ad0b-978b-4931-a30c-573e20f166a8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:36 user nova-compute[75672]: INFO nova.compute.manager [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Attaching volume 88d337fb-25c6-4aea-a867-147aaa39c907 to /dev/vdb
Nov 30 12:40:36 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG os_brick.utils [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d54655-7a2d-42ab-8200-e367f5943545]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d11c16b-d545-440f-afdd-5522102bfee7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc80fd0-f96a-4973-a685-0acc84b7bd32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b82773b-0287-405a-87f9-d8bedd9dce06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:40:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No VIF found with MAC fa:16:3e:3e:9e:81, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:40:37 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[712d649f-ef25-4b96-b7b1-53ffeb142573]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG os_brick.utils [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Updating existing volume attachment record: 6c63265a-0c7a-482d-9440-390f92e50152 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1039119-037b-4d6b-89d3-3675fc5b76b8 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.359s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Updating instance_info_cache with network_info: [{"id": "4a57924f-2da2-49db-9db8-3ee51193d52d", "address": "fa:16:3e:6d:59:18", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57924f-2d", "ovs_interfaceid": "4a57924f-2da2-49db-9db8-3ee51193d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Releasing lock "refresh_cache-0a41ad0b-978b-4931-a30c-573e20f166a8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Instance network_info: |[{"id": "4a57924f-2da2-49db-9db8-3ee51193d52d", "address": "fa:16:3e:6d:59:18", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57924f-2d", "ovs_interfaceid": "4a57924f-2da2-49db-9db8-3ee51193d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:37 user nova-compute[75672]: INFO nova.compute.manager [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Terminating instance
Nov 30 12:40:37 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd4336b2-06ee-449e-8afd-a6e6cc4d7092 req-5f690fd8-ef19-406e-a118-9cdd678dba78 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received event network-changed-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd4336b2-06ee-449e-8afd-a6e6cc4d7092 req-5f690fd8-ef19-406e-a118-9cdd678dba78 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Refreshing instance network info cache due to event network-changed-4a57924f-2da2-49db-9db8-3ee51193d52d. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd4336b2-06ee-449e-8afd-a6e6cc4d7092 req-5f690fd8-ef19-406e-a118-9cdd678dba78 service nova] Acquiring lock "refresh_cache-0a41ad0b-978b-4931-a30c-573e20f166a8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd4336b2-06ee-449e-8afd-a6e6cc4d7092 req-5f690fd8-ef19-406e-a118-9cdd678dba78 service nova] Acquired lock "refresh_cache-0a41ad0b-978b-4931-a30c-573e20f166a8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG nova.network.neutron [req-bd4336b2-06ee-449e-8afd-a6e6cc4d7092 req-5f690fd8-ef19-406e-a118-9cdd678dba78 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Refreshing network info cache for port 4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:38 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Instance destroyed successfully.
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.objects.instance [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lazy-loading 'resources' on Instance uuid f53f77ca-8471-4c62-a779-f64a0a4e57aa {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T12:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-128968609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-128968609',id=17,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl6klT0bzM05mjTlIY/+hxTDH4pH81fsasTPeFhXIw9kr7DGRshU4ifFY299yAb2HtCh0ILgMcRORtuH+9N2Hw5W6pQ+sfpRUATNL8WBx7USNA23ssXCHaD8O36MbtQ5g==',key_name='tempest-keypair-2079457822',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:37:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c117afa27d447fd9c8c0eb0d59c5d28',ramdisk_id='',reservation_id='r-j719jspw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737137422',owner_user_name='tempest-TaggedAttachmentsTest-1737137422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9544ed3bcf2407fac6a6a41e68e2a9c',uuid=f53f77ca-8471-4c62-a779-f64a0a4e57aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Converting VIF {"id": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "address": "fa:16:3e:ed:94:83", "network": {"id": "95b8d2af-4f27-444f-a163-88e0d148f972", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-82302020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c117afa27d447fd9c8c0eb0d59c5d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e0a542-be", "ovs_interfaceid": "20e0a542-befb-47a2-bc78-f9d4bc75ef67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:94:83,bridge_name='br-int',has_traffic_filtering=True,id=20e0a542-befb-47a2-bc78-f9d4bc75ef67,network=Network(95b8d2af-4f27-444f-a163-88e0d148f972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e0a542-be') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG os_vif [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:94:83,bridge_name='br-int',has_traffic_filtering=True,id=20e0a542-befb-47a2-bc78-f9d4bc75ef67,network=Network(95b8d2af-4f27-444f-a163-88e0d148f972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e0a542-be') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20e0a542-be, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cdbd595-706f-4349-89cd-87d1f738309f) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.network.neutron [req-bd4336b2-06ee-449e-8afd-a6e6cc4d7092 req-5f690fd8-ef19-406e-a118-9cdd678dba78 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Updated VIF entry in instance network info cache for port 4a57924f-2da2-49db-9db8-3ee51193d52d. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.network.neutron [req-bd4336b2-06ee-449e-8afd-a6e6cc4d7092 req-5f690fd8-ef19-406e-a118-9cdd678dba78 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Updating instance_info_cache with network_info: [{"id": "4a57924f-2da2-49db-9db8-3ee51193d52d", "address": "fa:16:3e:6d:59:18", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57924f-2d", "ovs_interfaceid": "4a57924f-2da2-49db-9db8-3ee51193d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:40:38 user nova-compute[75672]: INFO os_vif [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:94:83,bridge_name='br-int',has_traffic_filtering=True,id=20e0a542-befb-47a2-bc78-f9d4bc75ef67,network=Network(95b8d2af-4f27-444f-a163-88e0d148f972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e0a542-be')
Nov 30 12:40:38 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Deleting instance files /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa_del
Nov 30 12:40:38 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Deletion of /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa_del complete
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd4336b2-06ee-449e-8afd-a6e6cc4d7092 req-5f690fd8-ef19-406e-a118-9cdd678dba78 service nova] Releasing lock "refresh_cache-0a41ad0b-978b-4931-a30c-573e20f166a8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd4336b2-06ee-449e-8afd-a6e6cc4d7092 req-5f690fd8-ef19-406e-a118-9cdd678dba78 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received event network-vif-unplugged-20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd4336b2-06ee-449e-8afd-a6e6cc4d7092 req-5f690fd8-ef19-406e-a118-9cdd678dba78 service nova] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd4336b2-06ee-449e-8afd-a6e6cc4d7092 req-5f690fd8-ef19-406e-a118-9cdd678dba78 service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd4336b2-06ee-449e-8afd-a6e6cc4d7092 req-5f690fd8-ef19-406e-a118-9cdd678dba78 service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd4336b2-06ee-449e-8afd-a6e6cc4d7092 req-5f690fd8-ef19-406e-a118-9cdd678dba78 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] No waiting events found dispatching network-vif-unplugged-20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd4336b2-06ee-449e-8afd-a6e6cc4d7092 req-5f690fd8-ef19-406e-a118-9cdd678dba78 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received event network-vif-unplugged-20e0a542-befb-47a2-bc78-f9d4bc75ef67 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json" returned: 1 in 0.211s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk --force-share --output=json' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:40:38 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000011, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/f53f77ca-8471-4c62-a779-f64a0a4e57aa/disk
Nov 30 12:40:38 user nova-compute[75672]: INFO nova.compute.manager [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:38 user nova-compute[75672]: INFO nova.compute.manager [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Detaching volume 512469b6-9572-436c-97a3-d3fe737fe1ce
Nov 30 12:40:38 user nova-compute[75672]: INFO nova.virt.block_device [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Attempting to driver detach volume 512469b6-9572-436c-97a3-d3fe737fe1ce from mountpoint /dev/vdb
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Attempting to detach device vdb from instance 492a3775-dc6e-4c94-9ce0-26bc2da43e24 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:40:38 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:40:38 user nova-compute[75672]:   <source dev="/dev/sdd"/>
Nov 30 12:40:38 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:40:38 user nova-compute[75672]:   <serial>512469b6-9572-436c-97a3-d3fe737fe1ce</serial>
Nov 30 12:40:38 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:40:38 user nova-compute[75672]: </disk>
Nov 30 12:40:38 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:40:38 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Successfully detached device vdb from instance 492a3775-dc6e-4c94-9ce0-26bc2da43e24 from the persistent domain config.
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 492a3775-dc6e-4c94-9ce0-26bc2da43e24 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:40:38 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:40:38 user nova-compute[75672]:   <source dev="/dev/sdd"/>
Nov 30 12:40:38 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:40:38 user nova-compute[75672]:   <serial>512469b6-9572-436c-97a3-d3fe737fe1ce</serial>
Nov 30 12:40:38 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:40:38 user nova-compute[75672]: </disk>
Nov 30 12:40:38 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 492a3775-dc6e-4c94-9ce0-26bc2da43e24 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:40:39 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Took 0.95 seconds to deallocate network for instance.
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-977a0a6a-70af-4e18-8f35-983586f7c992 req-1f40a35a-2eed-49d2-90be-46d1a2fd7c67 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received event network-vif-plugged-20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-977a0a6a-70af-4e18-8f35-983586f7c992 req-1f40a35a-2eed-49d2-90be-46d1a2fd7c67 service nova] Acquiring lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-977a0a6a-70af-4e18-8f35-983586f7c992 req-1f40a35a-2eed-49d2-90be-46d1a2fd7c67 service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-977a0a6a-70af-4e18-8f35-983586f7c992 req-1f40a35a-2eed-49d2-90be-46d1a2fd7c67 service nova] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-977a0a6a-70af-4e18-8f35-983586f7c992 req-1f40a35a-2eed-49d2-90be-46d1a2fd7c67 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] No waiting events found dispatching network-vif-plugged-20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:40:39 user nova-compute[75672]: WARNING nova.compute.manager [req-977a0a6a-70af-4e18-8f35-983586f7c992 req-1f40a35a-2eed-49d2-90be-46d1a2fd7c67 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received unexpected event network-vif-plugged-20e0a542-befb-47a2-bc78-f9d4bc75ef67 for instance with vm_state deleted and task_state None.
Nov 30 12:40:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-977a0a6a-70af-4e18-8f35-983586f7c992 req-1f40a35a-2eed-49d2-90be-46d1a2fd7c67 service nova] [instance: f53f77ca-8471-4c62-a779-f64a0a4e57aa] Received event network-vif-deleted-20e0a542-befb-47a2-bc78-f9d4bc75ef67 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:40 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:40:40 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:40:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.795s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:40 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Deleted allocations for instance f53f77ca-8471-4c62-a779-f64a0a4e57aa
Nov 30 12:40:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ae45eca1-6ca4-4c52-831f-f770896ee77b tempest-TaggedAttachmentsTest-1737137422 tempest-TaggedAttachmentsTest-1737137422-project-member] Lock "f53f77ca-8471-4c62-a779-f64a0a4e57aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.056s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:40:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:42 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:40:42 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=6870MB free_disk=25.184295654296875GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:42 user nova-compute[75672]: INFO nova.compute.manager [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Detaching volume c675a5ae-91ed-48ce-a295-2f20fe60b721
Nov 30 12:40:42 user nova-compute[75672]: INFO nova.virt.block_device [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Attempting to driver detach volume c675a5ae-91ed-48ce-a295-2f20fe60b721 from mountpoint /dev/vdb
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Attempting to detach device vdb from instance 3338ed96-33ff-45e6-b3da-05fbb242a3a9 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:40:42 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:40:42 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 12:40:42 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:40:42 user nova-compute[75672]:   <serial>c675a5ae-91ed-48ce-a295-2f20fe60b721</serial>
Nov 30 12:40:42 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 12:40:42 user nova-compute[75672]: </disk>
Nov 30 12:40:42 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:40:42 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Successfully detached device vdb from instance 3338ed96-33ff-45e6-b3da-05fbb242a3a9 from the persistent domain config.
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3338ed96-33ff-45e6-b3da-05fbb242a3a9 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:40:42 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:40:42 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 12:40:42 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:40:42 user nova-compute[75672]:   <serial>c675a5ae-91ed-48ce-a295-2f20fe60b721</serial>
Nov 30 12:40:42 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 12:40:42 user nova-compute[75672]: </disk>
Nov 30 12:40:42 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 1fba8af1-8074-4ce8-be23-912e9850fc41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 3338ed96-33ff-45e6-b3da-05fbb242a3a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 3df9c388-08c6-4153-9666-8e492acda60c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 492a3775-dc6e-4c94-9ce0-26bc2da43e24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 874354b8-bf12-44d6-86f8-0db17ce28faa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance b06bea0f-9186-4ab8-8bad-588beb48a1f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 0a41ad0b-978b-4931-a30c-573e20f166a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:40:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:40:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:43 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:40:43 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:40:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:40:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3338ed96-33ff-45e6-b3da-05fbb242a3a9 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:40:44 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Creating image(s)
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Ensure instance console log exists: /opt/stack/data/nova/instances/0a41ad0b-978b-4931-a30c-573e20f166a8/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Start _get_guest_xml network_info=[{"id": "4a57924f-2da2-49db-9db8-3ee51193d52d", "address": "fa:16:3e:6d:59:18", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57924f-2d", "ovs_interfaceid": "4a57924f-2da2-49db-9db8-3ee51193d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '7e0bff33-b8b4-41dc-a269-94f7b6ed7b8e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfUdoLSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a41ad0b-978b-4931-a30c-573e20f166a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'caee8471-7089-44b3-889a-56cc0df84480', 'serial': 'caee8471-7089-44b3-889a-56cc0df84480'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:40:44 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:40:44 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfUdoLSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:40:44 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:40:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:40:44 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:40:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:40:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:40:44 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[addcf928-ee37-4ff5-ab1d-91062fd0c86b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:40:45 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[327b2431-58b5-4815-974d-465564cc073d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480] added
Nov 30 12:40:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68688ef-26b3-4c98-871c-70cfe5b8c346]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ebc147-98b8-40ab-8798-1e9345ef45bf]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WfUdoLSl {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WfUdoLSl" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bda59a-b1b1-451f-9ce5-717cfc11ddfc]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WfUdoLSl'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0353cd39-7e72-4c0e-8d13-9c9e910a5c7a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2010df3e-9ecd-4319-97f3-f1471d294b1c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:40:45 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:40:45 user nova-compute[75672]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)
Nov 30 12:40:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:40:45 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:40:45 user nova-compute[75672]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)
Nov 30 12:40:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e906eab4-e579-4d50-a7fd-4760223844ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480, portal: 172.16.0.220,3260]
Nov 30 12:40:45 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480, portal: 172.16.0.220,3260] successful.
Nov 30 12:40:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cdd5d8-9c69-49c7-ad8e-654d275b64d8]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[572949fe-86d0-4770-90fb-3e828fc4d7d6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:40:45 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:40:45 user nova-compute[75672]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)
Nov 30 12:40:45 user nova-compute[75672]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:40:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:40:45 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:40:45 user nova-compute[75672]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)
Nov 30 12:40:45 user nova-compute[75672]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:40:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c60d93-eaa2-4b38-a731-d6c1e921d08a]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfUdoLSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:40:45 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23238376363626230', 'path': '/dev/sde'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238376363626230', 'path': '/dev/sde'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:40:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1408614858',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1408614858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1408614858',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5JXvu5nEJT82w4GUYAY25ltXp/bf9JoyLCMso/vG1vdn4ljM1yWs+9MEfmAZ9b8ximDYMFDPbN9X7uDRTfSLJom/g3ZmGMwUFzIezl/NNGjMK02KLxodEiE4Iz07DxEg==',key_name='tempest-keypair-356641453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-jbi87e8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=0a41ad0b-978b-4931-a30c-573e20f166a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a57924f-2da2-49db-9db8-3ee51193d52d", "address": "fa:16:3e:6d:59:18", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57924f-2d", "ovs_interfaceid": "4a57924f-2da2-49db-9db8-3ee51193d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "4a57924f-2da2-49db-9db8-3ee51193d52d", "address": "fa:16:3e:6d:59:18", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57924f-2d", "ovs_interfaceid": "4a57924f-2da2-49db-9db8-3ee51193d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:59:18,bridge_name='br-int',has_traffic_filtering=True,id=4a57924f-2da2-49db-9db8-3ee51193d52d,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57924f-2d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG nova.objects.instance [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a41ad0b-978b-4931-a30c-573e20f166a8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:40:46 user nova-compute[75672]:   <uuid>0a41ad0b-978b-4931-a30c-573e20f166a8</uuid>
Nov 30 12:40:46 user nova-compute[75672]:   <name>instance-0000001a</name>
Nov 30 12:40:46 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:40:46 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:40:46 user nova-compute[75672]:   <metadata>
Nov 30 12:40:46 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:40:46 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:40:46 user nova-compute[75672]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1408614858</nova:name>
Nov 30 12:40:46 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:40:44</nova:creationTime>
Nov 30 12:40:46 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:40:46 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:40:46 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:40:46 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:40:46 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:40:46 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:40:46 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:40:46 user nova-compute[75672]:       <nova:owner>
Nov 30 12:40:46 user nova-compute[75672]:         <nova:user uuid="924cf8ff73154f8fadb371175a0d8fc4">tempest-TestVolumeBootPattern-1743139468-project-member</nova:user>
Nov 30 12:40:46 user nova-compute[75672]:         <nova:project uuid="513644b3a140400dbdf6b07e8e727dd4">tempest-TestVolumeBootPattern-1743139468</nova:project>
Nov 30 12:40:46 user nova-compute[75672]:       </nova:owner>
Nov 30 12:40:46 user nova-compute[75672]:       <nova:ports>
Nov 30 12:40:46 user nova-compute[75672]:         <nova:port uuid="4a57924f-2da2-49db-9db8-3ee51193d52d">
Nov 30 12:40:46 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 12:40:46 user nova-compute[75672]:         </nova:port>
Nov 30 12:40:46 user nova-compute[75672]:       </nova:ports>
Nov 30 12:40:46 user nova-compute[75672]:     </nova:instance>
Nov 30 12:40:46 user nova-compute[75672]:   </metadata>
Nov 30 12:40:46 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:40:46 user nova-compute[75672]:     <system>
Nov 30 12:40:46 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:40:46 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:40:46 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:40:46 user nova-compute[75672]:       <entry name="serial">0a41ad0b-978b-4931-a30c-573e20f166a8</entry>
Nov 30 12:40:46 user nova-compute[75672]:       <entry name="uuid">0a41ad0b-978b-4931-a30c-573e20f166a8</entry>
Nov 30 12:40:46 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:40:46 user nova-compute[75672]:     </system>
Nov 30 12:40:46 user nova-compute[75672]:   </sysinfo>
Nov 30 12:40:46 user nova-compute[75672]:   <os>
Nov 30 12:40:46 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:40:46 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:40:46 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:40:46 user nova-compute[75672]:   </os>
Nov 30 12:40:46 user nova-compute[75672]:   <features>
Nov 30 12:40:46 user nova-compute[75672]:     <acpi/>
Nov 30 12:40:46 user nova-compute[75672]:     <apic/>
Nov 30 12:40:46 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:40:46 user nova-compute[75672]:   </features>
Nov 30 12:40:46 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:40:46 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:40:46 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:40:46 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:40:46 user nova-compute[75672]:   </clock>
Nov 30 12:40:46 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:40:46 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:40:46 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:40:46 user nova-compute[75672]:   </cpu>
Nov 30 12:40:46 user nova-compute[75672]:   <devices>
Nov 30 12:40:46 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:40:46 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:40:46 user nova-compute[75672]:       <source dev="/dev/sde"/>
Nov 30 12:40:46 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:40:46 user nova-compute[75672]:       <serial>caee8471-7089-44b3-889a-56cc0df84480</serial>
Nov 30 12:40:46 user nova-compute[75672]:     </disk>
Nov 30 12:40:46 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:40:46 user nova-compute[75672]:       <mac address="fa:16:3e:6d:59:18"/>
Nov 30 12:40:46 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:40:46 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:40:46 user nova-compute[75672]:       <target dev="tap4a57924f-2d"/>
Nov 30 12:40:46 user nova-compute[75672]:     </interface>
Nov 30 12:40:46 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:40:46 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/0a41ad0b-978b-4931-a30c-573e20f166a8/console.log" append="off"/>
Nov 30 12:40:46 user nova-compute[75672]:     </serial>
Nov 30 12:40:46 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:40:46 user nova-compute[75672]:     <video>
Nov 30 12:40:46 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:40:46 user nova-compute[75672]:     </video>
Nov 30 12:40:46 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:40:46 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:40:46 user nova-compute[75672]:     </rng>
Nov 30 12:40:46 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:40:46 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:40:46 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:40:46 user nova-compute[75672]:     </memballoon>
Nov 30 12:40:46 user nova-compute[75672]:   </devices>
Nov 30 12:40:46 user nova-compute[75672]: </domain>
Nov 30 12:40:46 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:40:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1408614858',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1408614858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1408614858',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5JXvu5nEJT82w4GUYAY25ltXp/bf9JoyLCMso/vG1vdn4ljM1yWs+9MEfmAZ9b8ximDYMFDPbN9X7uDRTfSLJom/g3ZmGMwUFzIezl/NNGjMK02KLxodEiE4Iz07DxEg==',key_name='tempest-keypair-356641453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-jbi87e8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=0a41ad0b-978b-4931-a30c-573e20f166a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a57924f-2da2-49db-9db8-3ee51193d52d", "address": "fa:16:3e:6d:59:18", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57924f-2d", "ovs_interfaceid": "4a57924f-2da2-49db-9db8-3ee51193d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "4a57924f-2da2-49db-9db8-3ee51193d52d", "address": "fa:16:3e:6d:59:18", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57924f-2d", "ovs_interfaceid": "4a57924f-2da2-49db-9db8-3ee51193d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:59:18,bridge_name='br-int',has_traffic_filtering=True,id=4a57924f-2da2-49db-9db8-3ee51193d52d,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57924f-2d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_vif [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:59:18,bridge_name='br-int',has_traffic_filtering=True,id=4a57924f-2da2-49db-9db8-3ee51193d52d,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57924f-2d') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a173bc8f-7b97-5b19-8635-770270b50a72', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a57924f-2d, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a57924f-2d, col_values=(('qos', UUID('8a311aa0-eb39-496a-a461-2567166cce7a')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a57924f-2d, col_values=(('external_ids', {'iface-id': '4a57924f-2da2-49db-9db8-3ee51193d52d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:59:18', 'vm-uuid': '0a41ad0b-978b-4931-a30c-573e20f166a8'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:46 user nova-compute[75672]: INFO os_vif [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:59:18,bridge_name='br-int',has_traffic_filtering=True,id=4a57924f-2da2-49db-9db8-3ee51193d52d,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57924f-2d')
Nov 30 12:40:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] No VIF found with MAC fa:16:3e:6d:59:18, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYDJxaZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:40:46 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:40:46 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:40:46 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[14139568-ffd4-49d8-ab36-50868d74e521]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:40:46 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1375bd-81ed-4182-bd83-0f21c0242bd7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907] added
Nov 30 12:40:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[08622d49-8c77-43e8-a4e1-df4cba1a8d89]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b27518f-d8a6-43e4-a022-6809d64de721]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wYDJxaZI {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wYDJxaZI" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[946eb79c-61de-42db-87ca-fee09107dec5]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wYDJxaZI'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[86096b88-7238-4ddd-ae01-2222e2e0354b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a49659-4c45-45c3-be2d-0e1744118a13]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:40:46 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:40:46 user nova-compute[75672]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)
Nov 30 12:40:46 user nova-compute[75672]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:40:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:40:46 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:40:46 user nova-compute[75672]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)
Nov 30 12:40:46 user nova-compute[75672]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:40:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:40:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[31de0784-ba38-4bc3-89b4-f58d21fca4fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907, portal: 172.16.0.220,3260]
Nov 30 12:40:47 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907, portal: 172.16.0.220,3260] successful.
Nov 30 12:40:47 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9602955-735c-4f37-a7c1-be4909e98e40]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[942c33b2-f0d6-4c7b-9206-02f8cffd59c4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:40:47 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:40:47 user nova-compute[75672]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)
Nov 30 12:40:47 user nova-compute[75672]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:40:47 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:40:47 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:40:47 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:40:47 user nova-compute[75672]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)
Nov 30 12:40:47 user nova-compute[75672]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:40:47 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:40:47 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e47983-a5d0-41c6-ae1d-030f9b29677f]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: None {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-fe85ddcf-351d-48fa-bd24-c6a84648249e req-a4e7997e-a390-4219-9293-62672b7fbd13 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received event network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fe85ddcf-351d-48fa-bd24-c6a84648249e req-a4e7997e-a390-4219-9293-62672b7fbd13 service nova] Acquiring lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fe85ddcf-351d-48fa-bd24-c6a84648249e req-a4e7997e-a390-4219-9293-62672b7fbd13 service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fe85ddcf-351d-48fa-bd24-c6a84648249e req-a4e7997e-a390-4219-9293-62672b7fbd13 service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-fe85ddcf-351d-48fa-bd24-c6a84648249e req-a4e7997e-a390-4219-9293-62672b7fbd13 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] No waiting events found dispatching network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:40:47 user nova-compute[75672]: WARNING nova.compute.manager [req-fe85ddcf-351d-48fa-bd24-c6a84648249e req-a4e7997e-a390-4219-9293-62672b7fbd13 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received unexpected event network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d for instance with vm_state building and task_state spawning.
Nov 30 12:40:48 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:40:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYDJxaZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:40:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:40:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23436333831353263', 'path': '/dev/sdf'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:40:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436333831353263', 'path': '/dev/sdf'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:40:48 user nova-compute[75672]: DEBUG nova.objects.instance [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lazy-loading 'flavor' on Instance uuid 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:40:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:40:48 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:40:48 user nova-compute[75672]:   <source dev="/dev/sdf"/>
Nov 30 12:40:48 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:40:48 user nova-compute[75672]:   <serial>88d337fb-25c6-4aea-a867-147aaa39c907</serial>
Nov 30 12:40:48 user nova-compute[75672]: </disk>
Nov 30 12:40:48 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:40:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:40:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:40:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] No VIF found with MAC fa:16:3e:16:c6:38, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:40:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6423fce0-3f6d-4cb4-82db-ad92ce8f3f78 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.942s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:49 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:40:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:40:49 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Instance spawned successfully.
Nov 30 12:40:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:40:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:40:49 user nova-compute[75672]: INFO nova.compute.manager [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 30 12:40:49 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:40:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-69c2dbc4-4fce-47c3-a3d6-ad29aba9cb69 req-8504c039-18dc-4433-a612-e3bb28c6b19e service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received event network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:40:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-69c2dbc4-4fce-47c3-a3d6-ad29aba9cb69 req-8504c039-18dc-4433-a612-e3bb28c6b19e service nova] Acquiring lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-69c2dbc4-4fce-47c3-a3d6-ad29aba9cb69 req-8504c039-18dc-4433-a612-e3bb28c6b19e service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-69c2dbc4-4fce-47c3-a3d6-ad29aba9cb69 req-8504c039-18dc-4433-a612-e3bb28c6b19e service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-69c2dbc4-4fce-47c3-a3d6-ad29aba9cb69 req-8504c039-18dc-4433-a612-e3bb28c6b19e service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] No waiting events found dispatching network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:40:49 user nova-compute[75672]: WARNING nova.compute.manager [req-69c2dbc4-4fce-47c3-a3d6-ad29aba9cb69 req-8504c039-18dc-4433-a612-e3bb28c6b19e service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received unexpected event network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d for instance with vm_state building and task_state spawning.
Nov 30 12:40:50 user nova-compute[75672]: INFO nova.compute.manager [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Took 16.34 seconds to build instance.
Nov 30 12:40:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1ac81e55-355a-4660-9aff-1cc27a277215 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.641s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG nova.objects.instance [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lazy-loading 'flavor' on Instance uuid 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:53 user nova-compute[75672]: INFO nova.compute.manager [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Attaching volume 526d7eea-7753-4f58-993e-fab490424d30 to /dev/vdc
Nov 30 12:40:53 user nova-compute[75672]: DEBUG os_brick.utils [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dea9998-860a-46e0-9128-0d98a6c378b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cb7768-327a-4b33-ba46-b3f50bf4bcff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b01ac8-4a32-4eac-821d-1ec6538b4435]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e872d9d4-055d-420c-bc0d-c44c468e4c7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:40:53 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:40:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[077c0333-0c53-4f25-8177-595b3ba51240]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG os_brick.utils [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:40:53 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Updating existing volume attachment record: 7eb85aad-8bb4-41b9-a669-af9a59b8f44f {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:40:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:40:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Acquiring lock "874354b8-bf12-44d6-86f8-0db17ce28faa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:58 user nova-compute[75672]: DEBUG nova.objects.instance [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lazy-loading 'flavor' on Instance uuid 874354b8-bf12-44d6-86f8-0db17ce28faa {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:40:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:40:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Acquiring lock "874354b8-bf12-44d6-86f8-0db17ce28faa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:40:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:40:58 user nova-compute[75672]: INFO nova.compute.manager [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Attaching volume 5520952f-b0d2-437e-89fa-d653f9550960 to /dev/vdb
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.utils [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3884f47-6edc-4738-a035-41899a5d5ac0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9790f175-57bf-4478-8ef3-e722fd6827ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f214405d-95bc-4022-9543-3f8f32a5eb74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5b9b77-ce83-44e2-adfb-66803fdde167]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:40:59 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[037a132b-ef02-468c-bb44-99db4bb5d100]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.utils [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Updating existing volume attachment record: 68fd95fa-345c-42c6-adc8-3604282038d1 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:40:59 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 492a3775-dc6e-4c94-9ce0-26bc2da43e24 is timed out.
Nov 30 12:40:59 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Successfully detached device vdb from instance 492a3775-dc6e-4c94-9ce0-26bc2da43e24 from the live domain config.
Nov 30 12:40:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsAZzihr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:40:59 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02592b8-c2d9-490e-a81d-02bdb44687a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:40:59 user nova-compute[75672]: No targets found.
Nov 30 12:40:59 user nova-compute[75672]: iSNS:
Nov 30 12:40:59 user nova-compute[75672]: No targets found.
Nov 30 12:40:59 user nova-compute[75672]: STATIC:
Nov 30 12:40:59 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907
Nov 30 12:40:59 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:40:59 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:40:59 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480
Nov 30 12:40:59 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:40:59 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:40:59 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224
Nov 30 12:40:59 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:40:59 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:40:59 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721
Nov 30 12:40:59 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:40:59 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:40:59 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce
Nov 30 12:40:59 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:40:59 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:40:59 user nova-compute[75672]: FIRMWARE:
Nov 30 12:40:59 user nova-compute[75672]: No targets found.
Nov 30 12:40:59 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:40:59 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:40:59 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc832db-2d89-43ea-810f-28c84d3bcd69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3298b554-5c3c-4807-86e4-b38635eb35ff]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:40:59 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:40:59 user nova-compute[75672]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)
Nov 30 12:40:59 user nova-compute[75672]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:40:59 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:40:59 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:40:59 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:40:59 user nova-compute[75672]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce (non-flash)
Nov 30 12:40:59 user nova-compute[75672]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:40:59 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:40:59 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcb47caf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce'): ({'sdd'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Removing single pathed devices sdd {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[62948bd9-4098-47f8-ba9d-7178a393faeb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae999ca5-16b1-4af5-9f0e-ff0caae46a06]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Flushing IO for device /dev/sdd {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9431d0f-f3a2-43f8-bd64-c4403cd186ff]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dbcf31-1d63-4d49-b388-fe1a3a8ba091]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] SCSI volumes sdd have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0cd7d5-d212-4291-82c4-8bbbe085cebb]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b761e2-39f6-4e5d-b2b1-6df0f2db9e7f]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce, portal: 172.16.0.220,3260]
Nov 30 12:40:59 user nova-compute[75672]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce, portal: 172.16.0.220,3260] successful.
Nov 30 12:40:59 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512469b6-9572-436c-97a3-d3fe737fe1ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[15172133-0966-4908-aa80-1cdaec6b26ff]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] <== disconnect_volume: return (366ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:40:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:41:00 user nova-compute[75672]: DEBUG nova.objects.instance [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'flavor' on Instance uuid 492a3775-dc6e-4c94-9ce0-26bc2da43e24 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:41:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aaa28e50-5819-4911-879d-0b9e9b01976c tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.952s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.volume.cinder [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Update attachment failed for attachment 7eb85aad-8bb4-41b9-a669-af9a59b8f44f. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-73d8a6ab-ac4d-4c84-9cd5-e1f75abd3971) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-73d8a6ab-ac4d-4c84-9cd5-e1f75abd3971)
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Failed to attach 526d7eea-7753-4f58-993e-fab490424d30 at /dev/vdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-73d8a6ab-ac4d-4c84-9cd5-e1f75abd3971)
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Traceback (most recent call last):
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     ret_val = method(obj, context, *args, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     self._do_attach(context, instance, volume, volume_api,
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     self._volume_attach(context, volume, connector, instance,
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     connection_info = volume_api.attachment_update(
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     res = method(self, ctx, *args, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     with excutils.save_and_reraise_exception():
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     self.force_reraise()
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     raise self.value
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     context, '3.44', skip_version_check=True).attachments.update(
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     return method.func(obj, *args, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     resp = self._update('/attachments/%s' % id, body)
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     return self._cs_request(url, 'PUT', **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     return self.request(url, method, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2]     raise exceptions.from_response(resp, body)
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-73d8a6ab-ac4d-4c84-9cd5-e1f75abd3971)
Nov 30 12:41:00 user nova-compute[75672]: ERROR nova.compute.manager [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] 
Nov 30 12:41:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.516s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server [None req-8b7bc6b5-312c-4eb7-bcc7-4f74aae367b3 tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-73d8a6ab-ac4d-4c84-9cd5-e1f75abd3971)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-73d8a6ab-ac4d-4c84-9cd5-e1f75abd3971)
Nov 30 12:41:00 user nova-compute[75672]: ERROR oslo_messaging.rpc.server 
Nov 30 12:41:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:03 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3338ed96-33ff-45e6-b3da-05fbb242a3a9 is timed out.
Nov 30 12:41:03 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Successfully detached device vdb from instance 3338ed96-33ff-45e6-b3da-05fbb242a3a9 from the live domain config.
Nov 30 12:41:03 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCIWmolt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:41:03 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[606413a4-9d26-4e9b-bf8b-9fdc12044d2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:41:03 user nova-compute[75672]: No targets found.
Nov 30 12:41:03 user nova-compute[75672]: iSNS:
Nov 30 12:41:03 user nova-compute[75672]: No targets found.
Nov 30 12:41:03 user nova-compute[75672]: STATIC:
Nov 30 12:41:03 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907
Nov 30 12:41:03 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:41:03 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:41:03 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480
Nov 30 12:41:03 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:41:03 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:41:03 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224
Nov 30 12:41:03 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:41:03 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:41:03 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721
Nov 30 12:41:03 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:41:03 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:41:03 user nova-compute[75672]: FIRMWARE:
Nov 30 12:41:03 user nova-compute[75672]: No targets found.
Nov 30 12:41:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:41:03 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:41:03 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f277fc8-99f3-4fca-849b-da94a8a8bb92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[60884276-dbea-42d8-b4ae-14b95edf455e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:41:03 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:41:03 user nova-compute[75672]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:41:03 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:41:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 (non-flash)
Nov 30 12:41:03 user nova-compute[75672]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:41:03 user nova-compute[75672]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:41:03 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:41:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcb47c8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7626f50c-71f4-4bbf-887e-90a01722c324]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bf5cd6-4435-46f2-88e8-847f8fa642e4]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04c2a77-1b85-45cb-8043-7febf9f09b8d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eef8f3-fed8-4fc6-98aa-ad6711cb64dc]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a863959d-84d8-455a-ac1a-c1738d5ae5ed]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7170ec44-149e-4d07-99c0-7811ec616d00]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260]
Nov 30 12:41:03 user nova-compute[75672]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721, portal: 172.16.0.220,3260] successful.
Nov 30 12:41:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c675a5ae-91ed-48ce-a295-2f20fe60b721 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.074s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e082122-9c67-4749-a5bb-9a3bc855c993]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] <== disconnect_volume: return (373ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:41:03 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:41:05 user nova-compute[75672]: DEBUG nova.objects.instance [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lazy-loading 'flavor' on Instance uuid 3338ed96-33ff-45e6-b3da-05fbb242a3a9 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:41:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-424a6d90-5d6b-4a6c-baed-37b8a8aae236 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.398s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.volume.cinder [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Update attachment failed for attachment 68fd95fa-345c-42c6-adc8-3604282038d1. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93bedf96-7263-483c-a272-134f2eb3c428) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93bedf96-7263-483c-a272-134f2eb3c428)
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Failed to attach 5520952f-b0d2-437e-89fa-d653f9550960 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93bedf96-7263-483c-a272-134f2eb3c428)
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Traceback (most recent call last):
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     ret_val = method(obj, context, *args, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     self._do_attach(context, instance, volume, volume_api,
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     self._volume_attach(context, volume, connector, instance,
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     connection_info = volume_api.attachment_update(
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     res = method(self, ctx, *args, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     with excutils.save_and_reraise_exception():
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     self.force_reraise()
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     raise self.value
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     context, '3.44', skip_version_check=True).attachments.update(
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     return method.func(obj, *args, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     resp = self._update('/attachments/%s' % id, body)
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     return self._cs_request(url, 'PUT', **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     return self.request(url, method, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa]     raise exceptions.from_response(resp, body)
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93bedf96-7263-483c-a272-134f2eb3c428)
Nov 30 12:41:05 user nova-compute[75672]: ERROR nova.compute.manager [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] 
Nov 30 12:41:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.657s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server [None req-0f11eb88-857c-4000-bbbd-051ce6b36b4b tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93bedf96-7263-483c-a272-134f2eb3c428)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93bedf96-7263-483c-a272-134f2eb3c428)
Nov 30 12:41:05 user nova-compute[75672]: ERROR oslo_messaging.rpc.server 
Nov 30 12:41:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:09 user nova-compute[75672]: DEBUG nova.objects.instance [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lazy-loading 'flavor' on Instance uuid 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:41:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:10 user nova-compute[75672]: INFO nova.compute.manager [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Attaching volume dcc0c9fa-b1e3-4af4-bdda-830f8899be4b to /dev/vdb
Nov 30 12:41:10 user nova-compute[75672]: DEBUG os_brick.utils [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bab310-fab3-497a-8a19-4382615b6236]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac037937-0682-401c-9ccd-0b3f5cba9e25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b905be5a-c10f-44cc-94c4-a564f239d7ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e38cbd-ec4e-45af-b369-0e03798835e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:41:10 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:41:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4590ae00-341d-4724-b24e-948a26029061]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG os_brick.utils [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:41:10 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updating existing volume attachment record: d3a44f8f-7d56-4054-ade9-fefc0df3f924 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:41:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "3df9c388-08c6-4153-9666-8e492acda60c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "3df9c388-08c6-4153-9666-8e492acda60c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "3df9c388-08c6-4153-9666-8e492acda60c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:12 user nova-compute[75672]: INFO nova.compute.manager [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Terminating instance
Nov 30 12:41:12 user nova-compute[75672]: DEBUG nova.compute.manager [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG nova.compute.manager [req-ec45a06b-b1d2-4118-a350-6255924be90b req-077a3ac7-881c-475c-b713-414b76d7db0a service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received event network-vif-unplugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ec45a06b-b1d2-4118-a350-6255924be90b req-077a3ac7-881c-475c-b713-414b76d7db0a service nova] Acquiring lock "3df9c388-08c6-4153-9666-8e492acda60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ec45a06b-b1d2-4118-a350-6255924be90b req-077a3ac7-881c-475c-b713-414b76d7db0a service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ec45a06b-b1d2-4118-a350-6255924be90b req-077a3ac7-881c-475c-b713-414b76d7db0a service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG nova.compute.manager [req-ec45a06b-b1d2-4118-a350-6255924be90b req-077a3ac7-881c-475c-b713-414b76d7db0a service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] No waiting events found dispatching network-vif-unplugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG nova.compute.manager [req-ec45a06b-b1d2-4118-a350-6255924be90b req-077a3ac7-881c-475c-b713-414b76d7db0a service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received event network-vif-unplugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:41:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:13 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Instance destroyed successfully.
Nov 30 12:41:13 user nova-compute[75672]: DEBUG nova.objects.instance [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lazy-loading 'resources' on Instance uuid 3df9c388-08c6-4153-9666-8e492acda60c {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T12:37:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-67116884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1014565837',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxVNzI61C+OsJEwoPnrmP+C9u0Q3vxKD7EbOWbJUoD3wO5iAP3H5v2ErA0fq8PwQEvcEJsCQLdoim+V3xyoHIeOXDIbKXCEfzED1p1bzn0arLa41lNMTF7Ls62V6j5bJQ==',key_name='tempest-keypair-224557939',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:39:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c7e24ecd9d04dd4b8bccda3e63fa11d',ramdisk_id='',reservation_id='r-1br6g41s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-679548509',owner_user_name='tempest-ServerActionsV293TestJSON-679548509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:39:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8b5b87badbf493088f822838b837eb2',uuid=3df9c388-08c6-4153-9666-8e492acda60c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Converting VIF {"id": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "address": "fa:16:3e:f4:6e:b8", "network": {"id": "38c2361b-fa3a-44d1-9764-a4a7a9af6d5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-975530578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c7e24ecd9d04dd4b8bccda3e63fa11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14a6da4-b3", "ovs_interfaceid": "b14a6da4-b394-4ecc-bdbb-483cdbd2c581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=b14a6da4-b394-4ecc-bdbb-483cdbd2c581,network=Network(38c2361b-fa3a-44d1-9764-a4a7a9af6d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14a6da4-b3') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_vif [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=b14a6da4-b394-4ecc-bdbb-483cdbd2c581,network=Network(38c2361b-fa3a-44d1-9764-a4a7a9af6d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14a6da4-b3') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb14a6da4-b3, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca3c6362-a0ef-4c97-95c2-f67ed6c678d4) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:13 user nova-compute[75672]: INFO os_vif [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=b14a6da4-b394-4ecc-bdbb-483cdbd2c581,network=Network(38c2361b-fa3a-44d1-9764-a4a7a9af6d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14a6da4-b3')
Nov 30 12:41:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lmCEdvRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:41:13 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad3338d-4218-4df4-a8b1-7bba7ef48040]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:41:13 user nova-compute[75672]: No targets found.
Nov 30 12:41:13 user nova-compute[75672]: iSNS:
Nov 30 12:41:13 user nova-compute[75672]: No targets found.
Nov 30 12:41:13 user nova-compute[75672]: STATIC:
Nov 30 12:41:13 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907
Nov 30 12:41:13 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:41:13 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:41:13 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480
Nov 30 12:41:13 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:41:13 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:41:13 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224
Nov 30 12:41:13 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:41:13 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:41:13 user nova-compute[75672]: FIRMWARE:
Nov 30 12:41:13 user nova-compute[75672]: No targets found.
Nov 30 12:41:13 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:41:13 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:41:13 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c950736-541f-4a6c-a857-8d376b8fbc3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f55ccb-7ce1-45fb-b637-dc2b561e9550]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:41:13 user nova-compute[75672]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:41:13 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:41:13 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 (non-flash)
Nov 30 12:41:13 user nova-compute[75672]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:41:13 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:41:13 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd43270a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224'): ({'sdc'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Removing single pathed devices sdc {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e313df-93ca-49c1-a18c-70b44af97751]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc5cf46-d318-457c-9e83-b560b7653511]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Flushing IO for device /dev/sdc {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b7aac4-8321-427a-98c2-dc4075ba95f3]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c215d10-b048-4ba7-9e84-003d74baf924]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9382207-94ed-4be2-bd0a-b231e8dda8e5]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deb519b-d6e3-4a5e-9887-07184ffea096]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260]
Nov 30 12:41:13 user nova-compute[75672]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224, portal: 172.16.0.220,3260] successful.
Nov 30 12:41:13 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ed21-1fb1-4191-abba-933061358224 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb780647-204c-4e49-8f01-d82b947f0398]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] <== disconnect_volume: return (332ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:41:13 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Deleting instance files /opt/stack/data/nova/instances/3df9c388-08c6-4153-9666-8e492acda60c_del
Nov 30 12:41:13 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Deletion of /opt/stack/data/nova/instances/3df9c388-08c6-4153-9666-8e492acda60c_del complete
Nov 30 12:41:13 user nova-compute[75672]: INFO nova.compute.manager [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 30 12:41:13 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:41:13 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:41:14 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:41:14 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Took 0.63 seconds to deallocate network for instance.
Nov 30 12:41:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-3f0e7758-4f7a-4acb-a9ac-1f49421496cc req-04470492-e1b4-403f-97f9-78190c170a7d service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received event network-vif-deleted-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-0334d922-254b-4f44-990e-f3ad988f7760 req-197bc74f-b360-4c63-817d-dd476f84c12f service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received event network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0334d922-254b-4f44-990e-f3ad988f7760 req-197bc74f-b360-4c63-817d-dd476f84c12f service nova] Acquiring lock "3df9c388-08c6-4153-9666-8e492acda60c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0334d922-254b-4f44-990e-f3ad988f7760 req-197bc74f-b360-4c63-817d-dd476f84c12f service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0334d922-254b-4f44-990e-f3ad988f7760 req-197bc74f-b360-4c63-817d-dd476f84c12f service nova] Lock "3df9c388-08c6-4153-9666-8e492acda60c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-0334d922-254b-4f44-990e-f3ad988f7760 req-197bc74f-b360-4c63-817d-dd476f84c12f service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] No waiting events found dispatching network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:14 user nova-compute[75672]: WARNING nova.compute.manager [req-0334d922-254b-4f44-990e-f3ad988f7760 req-197bc74f-b360-4c63-817d-dd476f84c12f service nova] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Received unexpected event network-vif-plugged-b14a6da4-b394-4ecc-bdbb-483cdbd2c581 for instance with vm_state active and task_state deleting.
Nov 30 12:41:15 user nova-compute[75672]: INFO nova.compute.manager [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Took 1.14 seconds to detach 1 volumes for instance.
Nov 30 12:41:15 user nova-compute[75672]: DEBUG nova.compute.manager [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] [instance: 3df9c388-08c6-4153-9666-8e492acda60c] Deleting volume: 9764ed21-1fb1-4191-abba-933061358224 {{(pid=75672) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 12:41:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:15 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:41:15 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:41:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:15 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Deleted allocations for instance 3df9c388-08c6-4153-9666-8e492acda60c
Nov 30 12:41:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-49ade7ea-bf4a-4b59-8a7c-61dd71866560 tempest-ServerActionsV293TestJSON-679548509 tempest-ServerActionsV293TestJSON-679548509-project-member] Lock "3df9c388-08c6-4153-9666-8e492acda60c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.688s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpPaXMlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:41:19 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:41:19 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:41:19 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e4ba4c-8850-4389-9bb3-9367addc29f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:41:19 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6195eb2c-b440-4f4a-b9b8-656ed1edf8b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b] added
Nov 30 12:41:19 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea709293-64fb-4256-9e44-b6aaaf110091]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc88a75e-e0f0-4fe4-8936-034ea609b44d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GpPaXMlx {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GpPaXMlx" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b2b454-61ec-457f-b6c9-a3462364e2c4]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GpPaXMlx'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c27432b-b7ec-4661-a22b-253da4ab12d1]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab95a0b4-d411-4914-8e48-f6cb3a0ac828]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:41:19 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:41:19 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:41:19 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:41:19 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38dccb0-169f-4cdc-a4d7-aa6283427cfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260]
Nov 30 12:41:19 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260] successful.
Nov 30 12:41:19 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[255c618d-6d3a-4f8f-961a-cf66f9077754]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca489da-5fcd-4111-ac80-582136f7b65a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:41:19 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:41:19 user nova-compute[75672]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:41:19 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:41:19 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:41:19 user nova-compute[75672]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:41:19 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:41:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:41:20 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:41:20 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:41:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1e99ed-bf27-406b-b98e-567e7538a83d]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:20 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:41:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpPaXMlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:41:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:41:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23335373663623661', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:41:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335373663623661', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:41:21 user nova-compute[75672]: DEBUG nova.objects.instance [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lazy-loading 'flavor' on Instance uuid 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:41:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:41:21 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:41:21 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 12:41:21 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:41:21 user nova-compute[75672]:   <serial>dcc0c9fa-b1e3-4af4-bdda-830f8899be4b</serial>
Nov 30 12:41:21 user nova-compute[75672]: </disk>
Nov 30 12:41:21 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:41:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:41:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:41:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] No VIF found with MAC fa:16:3e:f3:03:0e, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:41:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a2e7dee5-669c-4ded-81c6-bef47d63bf5e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.536s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:23 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Stashing vm_state: active {{(pid=75672) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 30 12:41:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:41:23 user nova-compute[75672]: INFO nova.compute.claims [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Claim successful on node user
Nov 30 12:41:23 user nova-compute[75672]: INFO nova.compute.resource_tracker [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updating resource usage from migration f82dc564-73aa-4395-9cd3-fdcbe2a6e4f3
Nov 30 12:41:24 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:41:24 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:41:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.503s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:24 user nova-compute[75672]: INFO nova.compute.manager [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Migrating
Nov 30 12:41:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:41:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:41:24 user nova-compute[75672]: INFO nova.compute.rpcapi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 30 12:41:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:41:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:41:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquired lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:41:24 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:41:24 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updating instance_info_cache with network_info: [{"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:41:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Releasing lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:41:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Starting migrate_disk_and_power_off {{(pid=75672) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11481}}
Nov 30 12:41:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG nova.compute.manager [req-411c7939-5912-423d-be85-c6efc9ea7a50 req-7361a2d9-57d9-4dfb-9790-39ae9f59157c service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-unplugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-411c7939-5912-423d-be85-c6efc9ea7a50 req-7361a2d9-57d9-4dfb-9790-39ae9f59157c service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-411c7939-5912-423d-be85-c6efc9ea7a50 req-7361a2d9-57d9-4dfb-9790-39ae9f59157c service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-411c7939-5912-423d-be85-c6efc9ea7a50 req-7361a2d9-57d9-4dfb-9790-39ae9f59157c service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG nova.compute.manager [req-411c7939-5912-423d-be85-c6efc9ea7a50 req-7361a2d9-57d9-4dfb-9790-39ae9f59157c service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-unplugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:25 user nova-compute[75672]: WARNING nova.compute.manager [req-411c7939-5912-423d-be85-c6efc9ea7a50 req-7361a2d9-57d9-4dfb-9790-39ae9f59157c service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received unexpected event network-vif-unplugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with vm_state active and task_state resize_migrating.
Nov 30 12:41:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:25 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Instance destroyed successfully.
Nov 30 12:41:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-961439957',display_name='tempest-ServerActionsTestOtherB-server-961439957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-961439957',id=18,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9gzfXTAlw2XGf9HvtWm3alibDkZBaXqK6wU5D1XQgJAmyQFnvfR/7D9hAZOoFAhfgJYL3hqOw1f+3LmQPn02on/lNVBVazzydax1s8XfXwCPBkyn03q1zhUSD6eiHCpA==',key_name='tempest-keypair-1520780273',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69506305cadd4ab483ce9ee5e8da9625',ramdisk_id='',reservation_id='r-k234blik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-372668652',owner_user_name='tempest-ServerActionsTestOtherB-372668652-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68b5a0c78cb840038a79b946d02562a6',uuid=8de0a3f4-abcb-4302-90ea-aea9b8b996f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-689822038-network", "vif_mac": "fa:16:3e:f3:03:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converting VIF {"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-689822038-network", "vif_mac": "fa:16:3e:f3:03:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_vif [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap955b65e8-9d, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b10d979a-42b0-49ba-9840-bbb5996e0811) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:41:25 user nova-compute[75672]: INFO os_vif [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d')
Nov 30 12:41:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpPaXMlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:41:25 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5791eaa8-0fb2-4ab6-9b7c-002a51dddf76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:41:25 user nova-compute[75672]: No targets found.
Nov 30 12:41:25 user nova-compute[75672]: iSNS:
Nov 30 12:41:25 user nova-compute[75672]: No targets found.
Nov 30 12:41:25 user nova-compute[75672]: STATIC:
Nov 30 12:41:25 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907
Nov 30 12:41:25 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:41:25 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:41:25 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b
Nov 30 12:41:25 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:41:25 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:41:25 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480
Nov 30 12:41:25 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:41:25 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:41:25 user nova-compute[75672]: FIRMWARE:
Nov 30 12:41:25 user nova-compute[75672]: No targets found.
Nov 30 12:41:25 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:41:25 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:41:25 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf3df1a-9810-4d5f-96d1-6c1ff8832ffb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a02139-c215-4560-a736-3c8468da736f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:41:25 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:41:25 user nova-compute[75672]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:41:25 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:41:25 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:41:25 user nova-compute[75672]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:41:25 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd450fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4132bf7-da8f-49d2-b4e7-fc4c2da2e936]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf5ec68-91aa-4753-b4d4-1db0d142156f]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39c0d18-e4be-44ac-89ea-b64a77583fa6]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead92892-a83a-4f83-8f82-de7d18b448ee]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bd617e-2ee1-4dd5-bbe4-7c611b99a279]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bb9e10-d3aa-448d-930a-56b50b5583f7]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260]
Nov 30 12:41:25 user nova-compute[75672]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260] successful.
Nov 30 12:41:25 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dec0f0-dac4-425e-b8f8-902bcb582ddc]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] <== disconnect_volume: return (290ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:41:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:41:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2_resize/disk /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CMD "cp -r /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2_resize/disk /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk" returned: 0 in 0.264s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2_resize/disk.info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk.info {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CMD "cp -r /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2_resize/disk.info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk.info" returned: 0 in 0.031s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-1704a855-c254-4a71-a57c-aeb8014ae40e req-f7480f7b-4644-49ca-83bf-8fb4c8078788 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1704a855-c254-4a71-a57c-aeb8014ae40e req-f7480f7b-4644-49ca-83bf-8fb4c8078788 service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1704a855-c254-4a71-a57c-aeb8014ae40e req-f7480f7b-4644-49ca-83bf-8fb4c8078788 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1704a855-c254-4a71-a57c-aeb8014ae40e req-f7480f7b-4644-49ca-83bf-8fb4c8078788 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-1704a855-c254-4a71-a57c-aeb8014ae40e req-f7480f7b-4644-49ca-83bf-8fb4c8078788 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:27 user nova-compute[75672]: WARNING nova.compute.manager [req-1704a855-c254-4a71-a57c-aeb8014ae40e req-f7480f7b-4644-49ca-83bf-8fb4c8078788 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received unexpected event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with vm_state active and task_state resize_migrating.
Nov 30 12:41:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Port 955b65e8-9d92-4ba6-a330-7ca8fd6433ca binding to destination host user is already ACTIVE {{(pid=75672) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 30 12:41:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquired lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updating instance_info_cache with network_info: [{"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Releasing lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG os_brick.utils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3ce1be-4057-4d7b-8f41-bc21356dfb08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ea62ee-8b0c-4217-aaf4-ca32dac93d61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[411ebacb-3986-40db-8b17-563249aee53f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d733d257-1aa0-4f9a-bd6d-81002d08d9fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:41:28 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a47992e-ef18-4689-bcf5-1304613108b7]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG os_brick.utils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:28 user nova-compute[75672]: INFO nova.compute.manager [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Terminating instance
Nov 30 12:41:28 user nova-compute[75672]: DEBUG nova.compute.manager [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-cd9e4fbc-92cb-4e43-acea-cf2f10967931 req-b511e59a-40f0-42af-8181-abb13bc20eec service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Received event network-vif-unplugged-a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cd9e4fbc-92cb-4e43-acea-cf2f10967931 req-b511e59a-40f0-42af-8181-abb13bc20eec service nova] Acquiring lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cd9e4fbc-92cb-4e43-acea-cf2f10967931 req-b511e59a-40f0-42af-8181-abb13bc20eec service nova] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cd9e4fbc-92cb-4e43-acea-cf2f10967931 req-b511e59a-40f0-42af-8181-abb13bc20eec service nova] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-cd9e4fbc-92cb-4e43-acea-cf2f10967931 req-b511e59a-40f0-42af-8181-abb13bc20eec service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] No waiting events found dispatching network-vif-unplugged-a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-cd9e4fbc-92cb-4e43-acea-cf2f10967931 req-b511e59a-40f0-42af-8181-abb13bc20eec service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Received event network-vif-unplugged-a5f78084-b8e7-44f5-a614-ae1e4b0e189d for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:29 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Instance destroyed successfully.
Nov 30 12:41:29 user nova-compute[75672]: DEBUG nova.objects.instance [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'resources' on Instance uuid 492a3775-dc6e-4c94-9ce0-26bc2da43e24 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:38:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-41713594',display_name='tempest-AttachVolumeNegativeTest-server-41713594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-41713594',id=21,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0IzSNd2h5veSlcv1q/ZSjjAvkYmslaxMFSA7Ozoo3F+rPjwRkMTZqVxwVZVENMsdvlj1UmQkrmrwoXPgsyWNiOF+nPjEOypb9ro8gC1flvco/27XDYmtDsDqSi6MH2ng==',key_name='tempest-keypair-1276550109',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:38:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04f07019e3584771af197e865b6877cc',ramdisk_id='',reservation_id='r-u4rpk1zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1224349538',owner_user_name='tempest-AttachVolumeNegativeTest-1224349538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3166f2b3dee4aa4aa738f1f15ca7d19',uuid=492a3775-dc6e-4c94-9ce0-26bc2da43e24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "address": "fa:16:3e:3e:9e:81", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f78084-b8", "ovs_interfaceid": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converting VIF {"id": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "address": "fa:16:3e:3e:9e:81", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f78084-b8", "ovs_interfaceid": "a5f78084-b8e7-44f5-a614-ae1e4b0e189d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:9e:81,bridge_name='br-int',has_traffic_filtering=True,id=a5f78084-b8e7-44f5-a614-ae1e4b0e189d,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f78084-b8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG os_vif [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:9e:81,bridge_name='br-int',has_traffic_filtering=True,id=a5f78084-b8e7-44f5-a614-ae1e4b0e189d,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f78084-b8') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5f78084-b8, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=696ef067-a50e-4a6d-be32-eda357811b80) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:29 user nova-compute[75672]: INFO os_vif [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:9e:81,bridge_name='br-int',has_traffic_filtering=True,id=a5f78084-b8e7-44f5-a614-ae1e4b0e189d,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f78084-b8')
Nov 30 12:41:29 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Deleting instance files /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24_del
Nov 30 12:41:29 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Deletion of /opt/stack/data/nova/instances/492a3775-dc6e-4c94-9ce0-26bc2da43e24_del complete
Nov 30 12:41:29 user nova-compute[75672]: INFO nova.compute.manager [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 30 12:41:29 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:41:29 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:41:30 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:41:30 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Took 0.79 seconds to deallocate network for instance.
Nov 30 12:41:30 user nova-compute[75672]: DEBUG nova.compute.manager [req-819fe0f8-116a-432e-b5a7-b34898a6ed1a req-36ba3abf-6aa1-46e4-930f-3aa7f53a8c38 service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Received event network-vif-deleted-a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:30 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:41:30 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:41:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:31 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Deleted allocations for instance 492a3775-dc6e-4c94-9ce0-26bc2da43e24
Nov 30 12:41:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-596b88eb-452a-499b-978f-799b964f9f85 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.301s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-a57e63da-5090-4b6f-88a3-385848a4e19d req-282ab5f4-0968-46fc-8e3b-aec451a95bbb service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Received event network-vif-plugged-a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a57e63da-5090-4b6f-88a3-385848a4e19d req-282ab5f4-0968-46fc-8e3b-aec451a95bbb service nova] Acquiring lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a57e63da-5090-4b6f-88a3-385848a4e19d req-282ab5f4-0968-46fc-8e3b-aec451a95bbb service nova] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a57e63da-5090-4b6f-88a3-385848a4e19d req-282ab5f4-0968-46fc-8e3b-aec451a95bbb service nova] Lock "492a3775-dc6e-4c94-9ce0-26bc2da43e24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-a57e63da-5090-4b6f-88a3-385848a4e19d req-282ab5f4-0968-46fc-8e3b-aec451a95bbb service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] No waiting events found dispatching network-vif-plugged-a5f78084-b8e7-44f5-a614-ae1e4b0e189d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:31 user nova-compute[75672]: WARNING nova.compute.manager [req-a57e63da-5090-4b6f-88a3-385848a4e19d req-282ab5f4-0968-46fc-8e3b-aec451a95bbb service nova] [instance: 492a3775-dc6e-4c94-9ce0-26bc2da43e24] Received unexpected event network-vif-plugged-a5f78084-b8e7-44f5-a614-ae1e4b0e189d for instance with vm_state deleted and task_state None.
Nov 30 12:41:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:32 user nova-compute[75672]: INFO nova.compute.manager [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Terminating instance
Nov 30 12:41:32 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:41:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-216c0afe-3677-4527-862a-7f3024ed7454 req-e4f8005c-ec35-496e-a598-c2f96909029b service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received event network-vif-unplugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-216c0afe-3677-4527-862a-7f3024ed7454 req-e4f8005c-ec35-496e-a598-c2f96909029b service nova] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-216c0afe-3677-4527-862a-7f3024ed7454 req-e4f8005c-ec35-496e-a598-c2f96909029b service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-216c0afe-3677-4527-862a-7f3024ed7454 req-e4f8005c-ec35-496e-a598-c2f96909029b service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-216c0afe-3677-4527-862a-7f3024ed7454 req-e4f8005c-ec35-496e-a598-c2f96909029b service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] No waiting events found dispatching network-vif-unplugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-216c0afe-3677-4527-862a-7f3024ed7454 req-e4f8005c-ec35-496e-a598-c2f96909029b service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received event network-vif-unplugged-e6b0f7c3-fddc-4725-991e-7155b341322e for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:41:33 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Instance destroyed successfully.
Nov 30 12:41:33 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lazy-loading 'resources' on Instance uuid 3338ed96-33ff-45e6-b3da-05fbb242a3a9 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T12:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1391619292',display_name='tempest-ServerActionsTestOtherA-server-826538143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1391619292',id=16,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT+FpkNSPv7BTuQ0cGiU6Rv4YtX1ZWV5lv1HhpDo1sUC2n4QhYREUMjOJX6ptwW8wmUBY31zFAipq19+jfVo+chxFhdwghv2LqDjZfmlGZs/5ZFvO1nsasH0J73l3NYfQ==',key_name='tempest-keypair-21714305',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:38:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-40qany06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:38:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=3338ed96-33ff-45e6-b3da-05fbb242a3a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "e6b0f7c3-fddc-4725-991e-7155b341322e", "address": "fa:16:3e:57:20:54", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b0f7c3-fd", "ovs_interfaceid": "e6b0f7c3-fddc-4725-991e-7155b341322e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:20:54,bridge_name='br-int',has_traffic_filtering=True,id=e6b0f7c3-fddc-4725-991e-7155b341322e,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b0f7c3-fd') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG os_vif [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:20:54,bridge_name='br-int',has_traffic_filtering=True,id=e6b0f7c3-fddc-4725-991e-7155b341322e,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b0f7c3-fd') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6b0f7c3-fd, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1b40e62-0788-4f8e-be85-ea302e78e0b0) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:41:33 user nova-compute[75672]: INFO os_vif [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:20:54,bridge_name='br-int',has_traffic_filtering=True,id=e6b0f7c3-fddc-4725-991e-7155b341322e,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b0f7c3-fd')
Nov 30 12:41:33 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Deleting instance files /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9_del
Nov 30 12:41:33 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Deletion of /opt/stack/data/nova/instances/3338ed96-33ff-45e6-b3da-05fbb242a3a9_del complete
Nov 30 12:41:33 user nova-compute[75672]: INFO nova.compute.manager [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 30 12:41:33 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:41:33 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:41:34 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Updating instance_info_cache with network_info: [{"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:41:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-1fba8af1-8074-4ce8-be23-912e9850fc41" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:41:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:41:34 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:41:35 user nova-compute[75672]: DEBUG nova.compute.manager [req-7e1da432-2805-4257-ad10-47cc62463ea3 req-e3079ebd-ad3e-4078-b734-e96c852db516 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received event network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e1da432-2805-4257-ad10-47cc62463ea3 req-e3079ebd-ad3e-4078-b734-e96c852db516 service nova] Acquiring lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e1da432-2805-4257-ad10-47cc62463ea3 req-e3079ebd-ad3e-4078-b734-e96c852db516 service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e1da432-2805-4257-ad10-47cc62463ea3 req-e3079ebd-ad3e-4078-b734-e96c852db516 service nova] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:35 user nova-compute[75672]: DEBUG nova.compute.manager [req-7e1da432-2805-4257-ad10-47cc62463ea3 req-e3079ebd-ad3e-4078-b734-e96c852db516 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] No waiting events found dispatching network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:35 user nova-compute[75672]: WARNING nova.compute.manager [req-7e1da432-2805-4257-ad10-47cc62463ea3 req-e3079ebd-ad3e-4078-b734-e96c852db516 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received unexpected event network-vif-plugged-e6b0f7c3-fddc-4725-991e-7155b341322e for instance with vm_state active and task_state deleting.
Nov 30 12:41:35 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:41:35 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:41:35 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Took 1.76 seconds to deallocate network for instance.
Nov 30 12:41:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:36 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:41:36 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:41:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:36 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Deleted allocations for instance 3338ed96-33ff-45e6-b3da-05fbb242a3a9
Nov 30 12:41:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d54fe9ea-989d-4700-a673-ce5d84bd6e2e tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "3338ed96-33ff-45e6-b3da-05fbb242a3a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.329s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:36 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:41:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:36 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:41:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-935d5b1e-23eb-436b-b537-454494e11a5d req-8965cfd2-b3a3-4b75-aa27-2539da73fd52 service nova] [instance: 3338ed96-33ff-45e6-b3da-05fbb242a3a9] Received event network-vif-deleted-e6b0f7c3-fddc-4725-991e-7155b341322e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Starting finish_migration {{(pid=75672) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11668}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Instance directory exists: not creating {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Nov 30 12:41:38 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Creating image(s)
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.194s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk. size=21474836480 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk 21474836480 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk 21474836480" returned: 0 in 0.060s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Ensure instance console log exists: /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Start _get_guest_xml network_info=[{"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-689822038-network", "vif_mac": "fa:16:3e:f3:03:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '5b7cf383-d3d3-4e37-8477-3f600269d2b8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpPaXMlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8de0a3f4-abcb-4302-90ea-aea9b8b996f2', 'attached_at': '2023-11-30T12:41:38.000000', 'detached_at': '', 'volume_id': 'dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 'serial': 'dcc0c9fa-b1e3-4af4-bdda-830f8899be4b'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:41:38 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:41:38 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:41:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpPaXMlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:41:39 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:41:39 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:41:39 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa3074f-64a8-40f5-af8f-b125fb206072]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:41:39 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e06d8e-9217-4225-bf2c-0041201ba530]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b] added
Nov 30 12:41:39 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a65d2e7-e503-4457-ae19-efa0e6e6e53f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.101s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c165ea64-b929-4c33-a509-59de6ba3f573]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GpPaXMlx {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GpPaXMlx" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[042ee723-f162-44ee-a0af-f512e5951611]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GpPaXMlx'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[864935ab-70d0-4835-bf4c-240b2e0ac527]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8247be2b-44bc-4c9f-ba5d-7cdea29752db]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:41:39 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:41:39 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:41:39 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:41:39 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e332c751-08cc-42b2-81ea-2397d53e62d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260]
Nov 30 12:41:39 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260] successful.
Nov 30 12:41:39 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[823071f1-960c-460d-a71f-c14cc2426494]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b0535f-b7ff-453f-8538-d3546875af3f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:41:39 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:41:39 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:41:39 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:41:39 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:41:39 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:41:39 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.470s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a929d46-d80d-44d6-8a97-17c59b994870]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpPaXMlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.511s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] <== connect_volume: return (1515ms) {'type': 'block', 'scsi_wwn': '23335373663623661', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335373663623661', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-961439957',display_name='tempest-ServerActionsTestOtherB-server-961439957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-961439957',id=18,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9gzfXTAlw2XGf9HvtWm3alibDkZBaXqK6wU5D1XQgJAmyQFnvfR/7D9hAZOoFAhfgJYL3hqOw1f+3LmQPn02on/lNVBVazzydax1s8XfXwCPBkyn03q1zhUSD6eiHCpA==',key_name='tempest-keypair-1520780273',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69506305cadd4ab483ce9ee5e8da9625',ramdisk_id='',reservation_id='r-k234blik',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-372668652',owner_user_name='tempest-ServerActionsTestOtherB-372668652-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68b5a0c78cb840038a79b946d02562a6',uuid=8de0a3f4-abcb-4302-90ea-aea9b8b996f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-689822038-network", "vif_mac": "fa:16:3e:f3:03:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converting VIF {"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-689822038-network", "vif_mac": "fa:16:3e:f3:03:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:41:40 user nova-compute[75672]:   <uuid>8de0a3f4-abcb-4302-90ea-aea9b8b996f2</uuid>
Nov 30 12:41:40 user nova-compute[75672]:   <name>instance-00000012</name>
Nov 30 12:41:40 user nova-compute[75672]:   <memory>2097152</memory>
Nov 30 12:41:40 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:41:40 user nova-compute[75672]:   <metadata>
Nov 30 12:41:40 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:41:40 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:41:40 user nova-compute[75672]:       <nova:name>tempest-ServerActionsTestOtherB-server-961439957</nova:name>
Nov 30 12:41:40 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:41:38</nova:creationTime>
Nov 30 12:41:40 user nova-compute[75672]:       <nova:flavor name="m1.small">
Nov 30 12:41:40 user nova-compute[75672]:         <nova:memory>2048</nova:memory>
Nov 30 12:41:40 user nova-compute[75672]:         <nova:disk>20</nova:disk>
Nov 30 12:41:40 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:41:40 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:41:40 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:41:40 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:41:40 user nova-compute[75672]:       <nova:owner>
Nov 30 12:41:40 user nova-compute[75672]:         <nova:user uuid="68b5a0c78cb840038a79b946d02562a6">tempest-ServerActionsTestOtherB-372668652-project-member</nova:user>
Nov 30 12:41:40 user nova-compute[75672]:         <nova:project uuid="69506305cadd4ab483ce9ee5e8da9625">tempest-ServerActionsTestOtherB-372668652</nova:project>
Nov 30 12:41:40 user nova-compute[75672]:       </nova:owner>
Nov 30 12:41:40 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:41:40 user nova-compute[75672]:       <nova:ports>
Nov 30 12:41:40 user nova-compute[75672]:         <nova:port uuid="955b65e8-9d92-4ba6-a330-7ca8fd6433ca">
Nov 30 12:41:40 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 12:41:40 user nova-compute[75672]:         </nova:port>
Nov 30 12:41:40 user nova-compute[75672]:       </nova:ports>
Nov 30 12:41:40 user nova-compute[75672]:     </nova:instance>
Nov 30 12:41:40 user nova-compute[75672]:   </metadata>
Nov 30 12:41:40 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:41:40 user nova-compute[75672]:     <system>
Nov 30 12:41:40 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:41:40 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:41:40 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:41:40 user nova-compute[75672]:       <entry name="serial">8de0a3f4-abcb-4302-90ea-aea9b8b996f2</entry>
Nov 30 12:41:40 user nova-compute[75672]:       <entry name="uuid">8de0a3f4-abcb-4302-90ea-aea9b8b996f2</entry>
Nov 30 12:41:40 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:41:40 user nova-compute[75672]:     </system>
Nov 30 12:41:40 user nova-compute[75672]:   </sysinfo>
Nov 30 12:41:40 user nova-compute[75672]:   <os>
Nov 30 12:41:40 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:41:40 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:41:40 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:41:40 user nova-compute[75672]:   </os>
Nov 30 12:41:40 user nova-compute[75672]:   <features>
Nov 30 12:41:40 user nova-compute[75672]:     <acpi/>
Nov 30 12:41:40 user nova-compute[75672]:     <apic/>
Nov 30 12:41:40 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:41:40 user nova-compute[75672]:   </features>
Nov 30 12:41:40 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:41:40 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:41:40 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:41:40 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:41:40 user nova-compute[75672]:   </clock>
Nov 30 12:41:40 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:41:40 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:41:40 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:41:40 user nova-compute[75672]:   </cpu>
Nov 30 12:41:40 user nova-compute[75672]:   <devices>
Nov 30 12:41:40 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:41:40 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:41:40 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk"/>
Nov 30 12:41:40 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:41:40 user nova-compute[75672]:     </disk>
Nov 30 12:41:40 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:41:40 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:41:40 user nova-compute[75672]:       <source dev="/dev/sdb"/>
Nov 30 12:41:40 user nova-compute[75672]:       <target dev="vdb" bus="virtio"/>
Nov 30 12:41:40 user nova-compute[75672]:       <serial>dcc0c9fa-b1e3-4af4-bdda-830f8899be4b</serial>
Nov 30 12:41:40 user nova-compute[75672]:     </disk>
Nov 30 12:41:40 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:41:40 user nova-compute[75672]:       <mac address="fa:16:3e:f3:03:0e"/>
Nov 30 12:41:40 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:41:40 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:41:40 user nova-compute[75672]:       <target dev="tap955b65e8-9d"/>
Nov 30 12:41:40 user nova-compute[75672]:     </interface>
Nov 30 12:41:40 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:41:40 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/console.log" append="off"/>
Nov 30 12:41:40 user nova-compute[75672]:     </serial>
Nov 30 12:41:40 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:41:40 user nova-compute[75672]:     <video>
Nov 30 12:41:40 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:41:40 user nova-compute[75672]:     </video>
Nov 30 12:41:40 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:41:40 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:41:40 user nova-compute[75672]:     </rng>
Nov 30 12:41:40 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:41:40 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:41:40 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:41:40 user nova-compute[75672]:     </memballoon>
Nov 30 12:41:40 user nova-compute[75672]:   </devices>
Nov 30 12:41:40 user nova-compute[75672]: </domain>
Nov 30 12:41:40 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-961439957',display_name='tempest-ServerActionsTestOtherB-server-961439957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-961439957',id=18,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9gzfXTAlw2XGf9HvtWm3alibDkZBaXqK6wU5D1XQgJAmyQFnvfR/7D9hAZOoFAhfgJYL3hqOw1f+3LmQPn02on/lNVBVazzydax1s8XfXwCPBkyn03q1zhUSD6eiHCpA==',key_name='tempest-keypair-1520780273',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69506305cadd4ab483ce9ee5e8da9625',ramdisk_id='',reservation_id='r-k234blik',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-372668652',owner_user_name='tempest-ServerActionsTestOtherB-372668652-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68b5a0c78cb840038a79b946d02562a6',uuid=8de0a3f4-abcb-4302-90ea-aea9b8b996f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-689822038-network", "vif_mac": "fa:16:3e:f3:03:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converting VIF {"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-689822038-network", "vif_mac": "fa:16:3e:f3:03:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG os_vif [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0f18934-5ac0-5905-b2ef-d84d01513dca', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap955b65e8-9d, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap955b65e8-9d, col_values=(('qos', UUID('e472c27d-5434-435c-ac33-c4b5ac26e29c')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap955b65e8-9d, col_values=(('external_ids', {'iface-id': '955b65e8-9d92-4ba6-a330-7ca8fd6433ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:03:0e', 'vm-uuid': '8de0a3f4-abcb-4302-90ea-aea9b8b996f2'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:40 user nova-compute[75672]: INFO os_vif [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d')
Nov 30 12:41:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] No VIF found with MAC fa:16:3e:f3:03:0e, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:41:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-cf0f8567-811e-4cd5-b3fa-9347fc5e61e1 req-288d4db4-12ba-4d8c-a14a-5bbb027224fc service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cf0f8567-811e-4cd5-b3fa-9347fc5e61e1 req-288d4db4-12ba-4d8c-a14a-5bbb027224fc service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cf0f8567-811e-4cd5-b3fa-9347fc5e61e1 req-288d4db4-12ba-4d8c-a14a-5bbb027224fc service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cf0f8567-811e-4cd5-b3fa-9347fc5e61e1 req-288d4db4-12ba-4d8c-a14a-5bbb027224fc service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-cf0f8567-811e-4cd5-b3fa-9347fc5e61e1 req-288d4db4-12ba-4d8c-a14a-5bbb027224fc service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:45 user nova-compute[75672]: WARNING nova.compute.manager [req-cf0f8567-811e-4cd5-b3fa-9347fc5e61e1 req-288d4db4-12ba-4d8c-a14a-5bbb027224fc service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received unexpected event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with vm_state active and task_state resize_finish.
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-a06c8168-ded3-4e9d-9549-d39f4dbad6dc req-eb04ed27-2954-422a-9819-13e90d8bd8dc service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a06c8168-ded3-4e9d-9549-d39f4dbad6dc req-eb04ed27-2954-422a-9819-13e90d8bd8dc service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a06c8168-ded3-4e9d-9549-d39f4dbad6dc req-eb04ed27-2954-422a-9819-13e90d8bd8dc service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a06c8168-ded3-4e9d-9549-d39f4dbad6dc req-eb04ed27-2954-422a-9819-13e90d8bd8dc service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.manager [req-a06c8168-ded3-4e9d-9549-d39f4dbad6dc req-eb04ed27-2954-422a-9819-13e90d8bd8dc service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:45 user nova-compute[75672]: WARNING nova.compute.manager [req-a06c8168-ded3-4e9d-9549-d39f4dbad6dc req-eb04ed27-2954-422a-9819-13e90d8bd8dc service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received unexpected event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with vm_state active and task_state resize_finish.
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:41:45 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Instance running successfully.
Nov 30 12:41:45 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:41:45 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7431MB free_disk=25.216693878173828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Failed to set time: agent not configured {{(pid=75672) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a68d498f-fd1a-4044-8406-135e556d482e tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] finish_migration finished successfully. {{(pid=75672) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11763}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Applying migration context for instance 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 as it has an incoming, in-progress migration f82dc564-73aa-4395-9cd3-fdcbe2a6e4f3. Migration status is post-migrating {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 12:41:45 user nova-compute[75672]: INFO nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updating resource usage from migration f82dc564-73aa-4395-9cd3-fdcbe2a6e4f3
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 1fba8af1-8074-4ce8-be23-912e9850fc41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 874354b8-bf12-44d6-86f8-0db17ce28faa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance b06bea0f-9186-4ab8-8bad-588beb48a1f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 0a41ad0b-978b-4931-a30c-573e20f166a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Migration f82dc564-73aa-4395-9cd3-fdcbe2a6e4f3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:47 user nova-compute[75672]: INFO nova.compute.manager [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Terminating instance
Nov 30 12:41:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-206dd23e-04a4-4fce-b41f-7cf092293de2 req-58079e5c-6564-4e1f-a2b7-31a6c135afc3 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-unplugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-206dd23e-04a4-4fce-b41f-7cf092293de2 req-58079e5c-6564-4e1f-a2b7-31a6c135afc3 service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-206dd23e-04a4-4fce-b41f-7cf092293de2 req-58079e5c-6564-4e1f-a2b7-31a6c135afc3 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-206dd23e-04a4-4fce-b41f-7cf092293de2 req-58079e5c-6564-4e1f-a2b7-31a6c135afc3 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-206dd23e-04a4-4fce-b41f-7cf092293de2 req-58079e5c-6564-4e1f-a2b7-31a6c135afc3 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-unplugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-206dd23e-04a4-4fce-b41f-7cf092293de2 req-58079e5c-6564-4e1f-a2b7-31a6c135afc3 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-unplugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:48 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Instance destroyed successfully.
Nov 30 12:41:48 user nova-compute[75672]: DEBUG nova.objects.instance [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'resources' on Instance uuid 1fba8af1-8074-4ce8-be23-912e9850fc41 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1561719818',display_name='tempest-AttachVolumeTestJSON-server-1561719818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1561719818',id=4,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdea+lvE9UsOmP6FYZGbGByAYyZUFyR2cvDgR8GqqqfKWiRxkUCGs+K9HROvIA5wapQ0MyZOJSLL3feZaXU9b6HVLyibqADHJmmyyoRAcM/oJWT1i+VE463gQZDjaPsHw==',key_name='tempest-keypair-145731974',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:32:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a0ca8eb58644e058b2019a4faa41a46',ramdisk_id='',reservation_id='r-crpjd40b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2004678694',owner_user_name='tempest-AttachVolumeTestJSON-2004678694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98ee9bd3b604b39a3f6013a40398642',uuid=1fba8af1-8074-4ce8-be23-912e9850fc41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converting VIF {"id": "5bfc6970-5d97-4f13-8603-d508342c282a", "address": "fa:16:3e:99:e9:ab", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc6970-5d", "ovs_interfaceid": "5bfc6970-5d97-4f13-8603-d508342c282a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG os_vif [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bfc6970-5d, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be8f1687-7ca4-449b-8e56-874dbb597182) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:41:48 user nova-compute[75672]: INFO os_vif [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:e9:ab,bridge_name='br-int',has_traffic_filtering=True,id=5bfc6970-5d97-4f13-8603-d508342c282a,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc6970-5d')
Nov 30 12:41:48 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Deleting instance files /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41_del
Nov 30 12:41:48 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Deletion of /opt/stack/data/nova/instances/1fba8af1-8074-4ce8-be23-912e9850fc41_del complete
Nov 30 12:41:48 user nova-compute[75672]: INFO nova.compute.manager [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 30 12:41:48 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:41:49 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Took 1.26 seconds to deallocate network for instance.
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:49 user nova-compute[75672]: WARNING nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state deleted and task_state None.
Nov 30 12:41:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:49 user nova-compute[75672]: WARNING nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state deleted and task_state None.
Nov 30 12:41:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:49 user nova-compute[75672]: WARNING nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state deleted and task_state None.
Nov 30 12:41:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-unplugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-unplugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:49 user nova-compute[75672]: WARNING nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-unplugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state deleted and task_state None.
Nov 30 12:41:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Acquiring lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] No waiting events found dispatching network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:41:49 user nova-compute[75672]: WARNING nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received unexpected event network-vif-plugged-5bfc6970-5d97-4f13-8603-d508342c282a for instance with vm_state deleted and task_state None.
Nov 30 12:41:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-7e679f5b-cb75-43a3-afe8-daf7e405adb5 req-ac06197d-8464-4666-bbd6-4f8c3bc17a99 service nova] [instance: 1fba8af1-8074-4ce8-be23-912e9850fc41] Received event network-vif-deleted-5bfc6970-5d97-4f13-8603-d508342c282a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:41:50 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:41:50 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:41:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:50 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Deleted allocations for instance 1fba8af1-8074-4ce8-be23-912e9850fc41
Nov 30 12:41:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-629cd595-56b9-4a8c-93e2-45cb28150e9a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "1fba8af1-8074-4ce8-be23-912e9850fc41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.794s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:41:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:41:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:41:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:41:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:41:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:41:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:41:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG nova.objects.instance [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'flavor' on Instance uuid 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:06 user nova-compute[75672]: INFO nova.compute.manager [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Attaching volume 90177125-7302-49b4-baa4-5a0256df924d to /dev/vdb
Nov 30 12:42:06 user nova-compute[75672]: DEBUG os_brick.utils [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b988a8-63f7-4984-b513-2c7c5eb2063c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78cb3a0-20a4-4f5b-9a30-93f1b6196c6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d3e62d-79ea-4c6f-b643-bda95b947c67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0a1065-1f8f-4a76-b03d-8355f984440a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:42:06 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:42:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4c788e-1210-4883-9477-a29ff4992325]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG os_brick.utils [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:42:06 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Updating existing volume attachment record: e5d6c5df-f55c-4798-b373-94ca2140782a {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-4a547a73-5718-47c5-b25b-0923b1e3915e req-2000d03b-97fd-468d-86b8-fadc3c392297 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-changed-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-4a547a73-5718-47c5-b25b-0923b1e3915e req-2000d03b-97fd-468d-86b8-fadc3c392297 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Refreshing instance network info cache due to event network-changed-e5d9e2a3-ef19-41bb-b090-13c40c8986ee. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4a547a73-5718-47c5-b25b-0923b1e3915e req-2000d03b-97fd-468d-86b8-fadc3c392297 service nova] Acquiring lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4a547a73-5718-47c5-b25b-0923b1e3915e req-2000d03b-97fd-468d-86b8-fadc3c392297 service nova] Acquired lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG nova.network.neutron [req-4a547a73-5718-47c5-b25b-0923b1e3915e req-2000d03b-97fd-468d-86b8-fadc3c392297 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Refreshing network info cache for port e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG nova.objects.instance [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'flavor' on Instance uuid b06bea0f-9186-4ab8-8bad-588beb48a1f1 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:07 user nova-compute[75672]: INFO nova.compute.manager [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Attaching volume ede70206-ad9f-4e86-9acf-024fe5d639ff to /dev/vdb
Nov 30 12:42:07 user nova-compute[75672]: DEBUG nova.network.neutron [req-4a547a73-5718-47c5-b25b-0923b1e3915e req-2000d03b-97fd-468d-86b8-fadc3c392297 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Updated VIF entry in instance network info cache for port e5d9e2a3-ef19-41bb-b090-13c40c8986ee. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG nova.network.neutron [req-4a547a73-5718-47c5-b25b-0923b1e3915e req-2000d03b-97fd-468d-86b8-fadc3c392297 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Updating instance_info_cache with network_info: [{"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4a547a73-5718-47c5-b25b-0923b1e3915e req-2000d03b-97fd-468d-86b8-fadc3c392297 service nova] Releasing lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG os_brick.utils [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[521dce5c-72a3-4658-8d47-fb7758de4ce2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3a69a6-644b-4831-92cd-9fb5021f19b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2955ff-d635-4836-8f61-d7bb8937a449]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[73024032-61b5-4765-8b88-2aaab459b5e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:42:07 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:42:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[17284de7-7daa-4372-84fb-0f07ff10758f]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG os_brick.utils [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:42:07 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Updating existing volume attachment record: b16f3f7e-7517-414d-bd5c-b22657e321ec {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:42:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "50ef3313-795a-4797-9a3e-5e85f61d7631" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:15 user nova-compute[75672]: DEBUG nova.compute.manager [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:42:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:15 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:42:15 user nova-compute[75672]: INFO nova.compute.claims [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Claim successful on node user
Nov 30 12:42:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.656s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG nova.network.neutron [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:42:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:42:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG nova.policy [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa5b3c989c934220a07aba162e68ea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47874c48ecea456eac7968640910afba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:42:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Creating image(s)
Nov 30 12:42:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "/opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "/opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "/opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.206s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.197s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk 1073741824" returned: 0 in 0.089s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG nova.network.neutron [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Successfully created port: 5b67acff-0692-42c4-982c-b893d2cf4f0d {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Cannot resize image /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Ensure instance console log exists: /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txKrJOse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:42:17 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:42:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:42:17 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:42:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:42:17 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3489a2ab-54d8-49c2-ab83-a74c03bb5896]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:42:17 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7db310-7700-4e4b-b88e-7e2e65aa6ef2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff] added
Nov 30 12:42:18 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[725e9cfb-c00c-48b5-a2d9-86c7457682bf]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[77780487-86c8-4ced-9349-9848ef61f94f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v txKrJOse {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v txKrJOse" returned: 0 in 0.034s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2346bcb-4c30-41e0-982e-4bf9f0a1de91]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'txKrJOse'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.067s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee83e3c-8f2b-4c48-a51a-c5c7d49ceceb]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[07398156-6041-4712-8aff-20049db2d40c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:42:18 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:42:18 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:42:18 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:42:18 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:42:18 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:42:18 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2dfa90-7128-4a09-8e5b-8dadd9f03aee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff, portal: 172.16.0.220,3260]
Nov 30 12:42:18 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff, portal: 172.16.0.220,3260] successful.
Nov 30 12:42:18 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[948989b0-03c4-4e9b-b368-b66ba77c714a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e38a41c-00c8-426c-8f3c-5c8ae0dec419]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:42:18 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:42:18 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:42:18 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:42:18 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:42:18 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:42:18 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:42:18 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:42:18 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cafeff-fee1-4ce6-8827-0ed3faaa2da2]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txKrJOse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.network.neutron [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Successfully updated port: 5b67acff-0692-42c4-982c-b893d2cf4f0d {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquired lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.network.neutron [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.compute.manager [req-707d821a-1467-4556-a04a-15435448f8c6 req-a8c794f6-676f-4849-beca-e77f3d299c6b service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Received event network-changed-5b67acff-0692-42c4-982c-b893d2cf4f0d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.compute.manager [req-707d821a-1467-4556-a04a-15435448f8c6 req-a8c794f6-676f-4849-beca-e77f3d299c6b service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Refreshing instance network info cache due to event network-changed-5b67acff-0692-42c4-982c-b893d2cf4f0d. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-707d821a-1467-4556-a04a-15435448f8c6 req-a8c794f6-676f-4849-beca-e77f3d299c6b service nova] Acquiring lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.network.neutron [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.network.neutron [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Updating instance_info_cache with network_info: [{"id": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "address": "fa:16:3e:ce:b3:ac", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b67acff-06", "ovs_interfaceid": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Releasing lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.compute.manager [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Instance network_info: |[{"id": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "address": "fa:16:3e:ce:b3:ac", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b67acff-06", "ovs_interfaceid": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-707d821a-1467-4556-a04a-15435448f8c6 req-a8c794f6-676f-4849-beca-e77f3d299c6b service nova] Acquired lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.network.neutron [req-707d821a-1467-4556-a04a-15435448f8c6 req-a8c794f6-676f-4849-beca-e77f3d299c6b service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Refreshing network info cache for port 5b67acff-0692-42c4-982c-b893d2cf4f0d {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Start _get_guest_xml network_info=[{"id": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "address": "fa:16:3e:ce:b3:ac", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b67acff-06", "ovs_interfaceid": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:42:18 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:42:18 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:42:18 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1057936103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1057936103',id=27,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47874c48ecea456eac7968640910afba',ramdisk_id='',reservation_id='r-65t0k5tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-547265583',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:42:17Z,user_data=None,user_id='aa5b3c989c934220a07aba162e68ea87',uuid=50ef3313-795a-4797-9a3e-5e85f61d7631,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "address": "fa:16:3e:ce:b3:ac", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b67acff-06", "ovs_interfaceid": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converting VIF {"id": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "address": "fa:16:3e:ce:b3:ac", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b67acff-06", "ovs_interfaceid": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:b3:ac,bridge_name='br-int',has_traffic_filtering=True,id=5b67acff-0692-42c4-982c-b893d2cf4f0d,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b67acff-06') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.objects.instance [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'pci_devices' on Instance uuid 50ef3313-795a-4797-9a3e-5e85f61d7631 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:42:19 user nova-compute[75672]:   <uuid>50ef3313-795a-4797-9a3e-5e85f61d7631</uuid>
Nov 30 12:42:19 user nova-compute[75672]:   <name>instance-0000001b</name>
Nov 30 12:42:19 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:42:19 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:42:19 user nova-compute[75672]:   <metadata>
Nov 30 12:42:19 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:42:19 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:42:19 user nova-compute[75672]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1057936103</nova:name>
Nov 30 12:42:19 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:42:18</nova:creationTime>
Nov 30 12:42:19 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:42:19 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:42:19 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:42:19 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:42:19 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:42:19 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:42:19 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:42:19 user nova-compute[75672]:       <nova:owner>
Nov 30 12:42:19 user nova-compute[75672]:         <nova:user uuid="aa5b3c989c934220a07aba162e68ea87">tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member</nova:user>
Nov 30 12:42:19 user nova-compute[75672]:         <nova:project uuid="47874c48ecea456eac7968640910afba">tempest-ServerBootFromVolumeStableRescueTest-547265583</nova:project>
Nov 30 12:42:19 user nova-compute[75672]:       </nova:owner>
Nov 30 12:42:19 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:42:19 user nova-compute[75672]:       <nova:ports>
Nov 30 12:42:19 user nova-compute[75672]:         <nova:port uuid="5b67acff-0692-42c4-982c-b893d2cf4f0d">
Nov 30 12:42:19 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 12:42:19 user nova-compute[75672]:         </nova:port>
Nov 30 12:42:19 user nova-compute[75672]:       </nova:ports>
Nov 30 12:42:19 user nova-compute[75672]:     </nova:instance>
Nov 30 12:42:19 user nova-compute[75672]:   </metadata>
Nov 30 12:42:19 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:42:19 user nova-compute[75672]:     <system>
Nov 30 12:42:19 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:42:19 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:42:19 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:42:19 user nova-compute[75672]:       <entry name="serial">50ef3313-795a-4797-9a3e-5e85f61d7631</entry>
Nov 30 12:42:19 user nova-compute[75672]:       <entry name="uuid">50ef3313-795a-4797-9a3e-5e85f61d7631</entry>
Nov 30 12:42:19 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:42:19 user nova-compute[75672]:     </system>
Nov 30 12:42:19 user nova-compute[75672]:   </sysinfo>
Nov 30 12:42:19 user nova-compute[75672]:   <os>
Nov 30 12:42:19 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:42:19 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:42:19 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:42:19 user nova-compute[75672]:   </os>
Nov 30 12:42:19 user nova-compute[75672]:   <features>
Nov 30 12:42:19 user nova-compute[75672]:     <acpi/>
Nov 30 12:42:19 user nova-compute[75672]:     <apic/>
Nov 30 12:42:19 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:42:19 user nova-compute[75672]:   </features>
Nov 30 12:42:19 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:42:19 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:42:19 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:42:19 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:42:19 user nova-compute[75672]:   </clock>
Nov 30 12:42:19 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:42:19 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:42:19 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:42:19 user nova-compute[75672]:   </cpu>
Nov 30 12:42:19 user nova-compute[75672]:   <devices>
Nov 30 12:42:19 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:42:19 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:42:19 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk"/>
Nov 30 12:42:19 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:42:19 user nova-compute[75672]:     </disk>
Nov 30 12:42:19 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:42:19 user nova-compute[75672]:       <mac address="fa:16:3e:ce:b3:ac"/>
Nov 30 12:42:19 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:42:19 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:42:19 user nova-compute[75672]:       <target dev="tap5b67acff-06"/>
Nov 30 12:42:19 user nova-compute[75672]:     </interface>
Nov 30 12:42:19 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:42:19 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/console.log" append="off"/>
Nov 30 12:42:19 user nova-compute[75672]:     </serial>
Nov 30 12:42:19 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:42:19 user nova-compute[75672]:     <video>
Nov 30 12:42:19 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:42:19 user nova-compute[75672]:     </video>
Nov 30 12:42:19 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:42:19 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:42:19 user nova-compute[75672]:     </rng>
Nov 30 12:42:19 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:42:19 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:42:19 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:42:19 user nova-compute[75672]:     </memballoon>
Nov 30 12:42:19 user nova-compute[75672]:   </devices>
Nov 30 12:42:19 user nova-compute[75672]: </domain>
Nov 30 12:42:19 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1057936103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1057936103',id=27,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47874c48ecea456eac7968640910afba',ramdisk_id='',reservation_id='r-65t0k5tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-547265583',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:42:17Z,user_data=None,user_id='aa5b3c989c934220a07aba162e68ea87',uuid=50ef3313-795a-4797-9a3e-5e85f61d7631,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "address": "fa:16:3e:ce:b3:ac", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b67acff-06", "ovs_interfaceid": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converting VIF {"id": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "address": "fa:16:3e:ce:b3:ac", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b67acff-06", "ovs_interfaceid": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:b3:ac,bridge_name='br-int',has_traffic_filtering=True,id=5b67acff-0692-42c4-982c-b893d2cf4f0d,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b67acff-06') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_vif [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:b3:ac,bridge_name='br-int',has_traffic_filtering=True,id=5b67acff-0692-42c4-982c-b893d2cf4f0d,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b67acff-06') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7565060-10ff-5427-a6ff-1db884ee4c72', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b67acff-06, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b67acff-06, col_values=(('qos', UUID('a2611929-4057-4028-aae5-15b3cad1aa96')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b67acff-06, col_values=(('external_ids', {'iface-id': '5b67acff-0692-42c4-982c-b893d2cf4f0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:b3:ac', 'vm-uuid': '50ef3313-795a-4797-9a3e-5e85f61d7631'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:19 user nova-compute[75672]: INFO os_vif [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:b3:ac,bridge_name='br-int',has_traffic_filtering=True,id=5b67acff-0692-42c4-982c-b893d2cf4f0d,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b67acff-06')
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] No VIF found with MAC fa:16:3e:ce:b3:ac, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYSeHxMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:42:19 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23266353365373039', 'path': '/dev/sdc'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266353365373039', 'path': '/dev/sdc'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.227s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:42:19 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:42:19 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.objects.instance [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'flavor' on Instance uuid b06bea0f-9186-4ab8-8bad-588beb48a1f1 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e439ed18-abf4-4b2f-bcf3-3636db92291d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:42:19 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:42:19 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:42:19 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 12:42:19 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:42:19 user nova-compute[75672]:   <serial>ede70206-ad9f-4e86-9acf-024fe5d639ff</serial>
Nov 30 12:42:19 user nova-compute[75672]: </disk>
Nov 30 12:42:19 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ed7fa1-8513-45ca-bdeb-9b62b4276a33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d] added
Nov 30 12:42:19 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.network.neutron [req-707d821a-1467-4556-a04a-15435448f8c6 req-a8c794f6-676f-4849-beca-e77f3d299c6b service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Updated VIF entry in instance network info cache for port 5b67acff-0692-42c4-982c-b893d2cf4f0d. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG nova.network.neutron [req-707d821a-1467-4556-a04a-15435448f8c6 req-a8c794f6-676f-4849-beca-e77f3d299c6b service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Updating instance_info_cache with network_info: [{"id": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "address": "fa:16:3e:ce:b3:ac", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b67acff-06", "ovs_interfaceid": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf74f73-6386-4ce3-a37b-4f15cf999d27]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-707d821a-1467-4556-a04a-15435448f8c6 req-a8c794f6-676f-4849-beca-e77f3d299c6b service nova] Releasing lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52493a0-991a-448f-b424-eff239279084]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lYSeHxMO {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lYSeHxMO" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[446ffcb5-f759-45c1-80a5-94d2ec7dedea]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lYSeHxMO'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ab1c55-3c58-4434-9f55-8cdee16767f4]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6d45fd-bdd3-4420-a02d-2db7757aa4df]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:42:19 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:42:19 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:42:19 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:42:19 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:42:19 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:42:19 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:42:19 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:42:19 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4aa2f74-da35-45a4-93a4-96459961e5fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d, portal: 172.16.0.220,3260]
Nov 30 12:42:19 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d, portal: 172.16.0.220,3260] successful.
Nov 30 12:42:19 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d851a889-2124-4e22-862c-5f2244240ebf]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5faaa6-249f-4df5-b0c3-d03a8b3f95ce]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:42:19 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:42:19 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:42:19 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:42:19 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:42:19 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:42:19 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:42:19 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:42:19 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:42:19 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:42:19 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[123ee466-c37d-41ef-84c0-17ed3fde38d3]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:42:19 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYSeHxMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:42:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:42:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:42:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No VIF found with MAC fa:16:3e:64:5c:19, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:42:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a7257468-df8e-4e05-a2e2-e3f1f180765b tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.905s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:42:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] <== connect_volume: return (1617ms) {'type': 'block', 'scsi_wwn': '23364313533303337', 'path': '/dev/sdd'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:42:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364313533303337', 'path': '/dev/sdd'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:42:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:20 user nova-compute[75672]: DEBUG nova.objects.instance [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'flavor' on Instance uuid 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:42:20 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:42:20 user nova-compute[75672]:   <source dev="/dev/sdd"/>
Nov 30 12:42:20 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:42:20 user nova-compute[75672]:   <serial>90177125-7302-49b4-baa4-5a0256df924d</serial>
Nov 30 12:42:20 user nova-compute[75672]: </disk>
Nov 30 12:42:20 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:42:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:21 user nova-compute[75672]: INFO nova.compute.manager [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Rescuing
Nov 30 12:42:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquired lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:21 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:42:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:42:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:42:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] No VIF found with MAC fa:16:3e:bd:1f:55, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:42:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1314cd39-6c20-443a-aa45-6beb26666bb3 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.280s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:21 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Updating instance_info_cache with network_info: [{"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Releasing lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG nova.compute.manager [req-535595d2-f35e-4c1a-bb05-7c69d8e2c64c req-e22cb62a-e8c7-405f-9f0b-809bec1aa33e service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-unplugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-535595d2-f35e-4c1a-bb05-7c69d8e2c64c req-e22cb62a-e8c7-405f-9f0b-809bec1aa33e service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-535595d2-f35e-4c1a-bb05-7c69d8e2c64c req-e22cb62a-e8c7-405f-9f0b-809bec1aa33e service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-535595d2-f35e-4c1a-bb05-7c69d8e2c64c req-e22cb62a-e8c7-405f-9f0b-809bec1aa33e service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG nova.compute.manager [req-535595d2-f35e-4c1a-bb05-7c69d8e2c64c req-e22cb62a-e8c7-405f-9f0b-809bec1aa33e service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-unplugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:22 user nova-compute[75672]: WARNING nova.compute.manager [req-535595d2-f35e-4c1a-bb05-7c69d8e2c64c req-e22cb62a-e8c7-405f-9f0b-809bec1aa33e service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received unexpected event network-vif-unplugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with vm_state active and task_state rescuing.
Nov 30 12:42:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:22 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Instance destroyed successfully.
Nov 30 12:42:22 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Attempting rescue
Nov 30 12:42:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75672) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Instance directory exists: not creating {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Nov 30 12:42:22 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Creating image(s)
Nov 30 12:42:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "/opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "/opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "/opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'trusted_certs' on Instance uuid b06bea0f-9186-4ab8-8bad-588beb48a1f1 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.207s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.rescue {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.compute.manager [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.rescue" returned: 0 in 0.052s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'migration_context' on Instance uuid b06bea0f-9186-4ab8-8bad-588beb48a1f1 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.objects.base [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<b06bea0f-9186-4ab8-8bad-588beb48a1f1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Start _get_guest_xml network_info=[{"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "vif_mac": "fa:16:3e:64:5c:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'resources' on Instance uuid b06bea0f-9186-4ab8-8bad-588beb48a1f1 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.objects.base [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<b06bea0f-9186-4ab8-8bad-588beb48a1f1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'numa_topology' on Instance uuid b06bea0f-9186-4ab8-8bad-588beb48a1f1 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.objects.base [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<b06bea0f-9186-4ab8-8bad-588beb48a1f1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.compute.manager [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:42:23 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:42:23 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'vcpu_model' on Instance uuid b06bea0f-9186-4ab8-8bad-588beb48a1f1 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:42:23 user nova-compute[75672]: INFO nova.compute.claims [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Claim successful on node user
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.objects.base [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<b06bea0f-9186-4ab8-8bad-588beb48a1f1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:40:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1869500337',display_name='tempest-ServerRescueNegativeTestJSON-server-1869500337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1869500337',id=25,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKvX8kREpKHdh7QTeqLrDuWRIr/0HgYYg/g29TAlyvhlnFXG14JSKT5CfnTGyflUqYYfYdN7lRf5nU1oNeKgDqmKR3vKW6jKYX535rLOk8b3qYyPl+hAKXOZnV2LrefZA==',key_name='tempest-keypair-1145147896',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:40:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='601d2f3e56844b68b3a0c71f8a7f5454',ramdisk_id='',reservation_id='r-res9s6m6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-928198583',owner_user_name='tempest-ServerRescueNegativeTestJSON-928198583-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:40:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61c6bf770dfe4eadba28f371b29f1d79',uuid=b06bea0f-9186-4ab8-8bad-588beb48a1f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "vif_mac": "fa:16:3e:64:5c:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converting VIF {"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "vif_mac": "fa:16:3e:64:5c:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e5d9e2a3-ef19-41bb-b090-13c40c8986ee,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5d9e2a3-ef') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'pci_devices' on Instance uuid b06bea0f-9186-4ab8-8bad-588beb48a1f1 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.objects.base [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Object Instance<b06bea0f-9186-4ab8-8bad-588beb48a1f1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:42:23 user nova-compute[75672]:   <uuid>b06bea0f-9186-4ab8-8bad-588beb48a1f1</uuid>
Nov 30 12:42:23 user nova-compute[75672]:   <name>instance-00000019</name>
Nov 30 12:42:23 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:42:23 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:42:23 user nova-compute[75672]:   <metadata>
Nov 30 12:42:23 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:42:23 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:42:23 user nova-compute[75672]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1869500337</nova:name>
Nov 30 12:42:23 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:42:23</nova:creationTime>
Nov 30 12:42:23 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:42:23 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:42:23 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:42:23 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:42:23 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:42:23 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:42:23 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:42:23 user nova-compute[75672]:       <nova:owner>
Nov 30 12:42:23 user nova-compute[75672]:         <nova:user uuid="61c6bf770dfe4eadba28f371b29f1d79">tempest-ServerRescueNegativeTestJSON-928198583-project-member</nova:user>
Nov 30 12:42:23 user nova-compute[75672]:         <nova:project uuid="601d2f3e56844b68b3a0c71f8a7f5454">tempest-ServerRescueNegativeTestJSON-928198583</nova:project>
Nov 30 12:42:23 user nova-compute[75672]:       </nova:owner>
Nov 30 12:42:23 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:42:23 user nova-compute[75672]:       <nova:ports>
Nov 30 12:42:23 user nova-compute[75672]:         <nova:port uuid="e5d9e2a3-ef19-41bb-b090-13c40c8986ee">
Nov 30 12:42:23 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 12:42:23 user nova-compute[75672]:         </nova:port>
Nov 30 12:42:23 user nova-compute[75672]:       </nova:ports>
Nov 30 12:42:23 user nova-compute[75672]:     </nova:instance>
Nov 30 12:42:23 user nova-compute[75672]:   </metadata>
Nov 30 12:42:23 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:42:23 user nova-compute[75672]:     <system>
Nov 30 12:42:23 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:42:23 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:42:23 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:42:23 user nova-compute[75672]:       <entry name="serial">b06bea0f-9186-4ab8-8bad-588beb48a1f1</entry>
Nov 30 12:42:23 user nova-compute[75672]:       <entry name="uuid">b06bea0f-9186-4ab8-8bad-588beb48a1f1</entry>
Nov 30 12:42:23 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:42:23 user nova-compute[75672]:     </system>
Nov 30 12:42:23 user nova-compute[75672]:   </sysinfo>
Nov 30 12:42:23 user nova-compute[75672]:   <os>
Nov 30 12:42:23 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:42:23 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:42:23 user nova-compute[75672]:   </os>
Nov 30 12:42:23 user nova-compute[75672]:   <features>
Nov 30 12:42:23 user nova-compute[75672]:     <acpi/>
Nov 30 12:42:23 user nova-compute[75672]:     <apic/>
Nov 30 12:42:23 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:42:23 user nova-compute[75672]:   </features>
Nov 30 12:42:23 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:42:23 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:42:23 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:42:23 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:42:23 user nova-compute[75672]:   </clock>
Nov 30 12:42:23 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:42:23 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:42:23 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:42:23 user nova-compute[75672]:   </cpu>
Nov 30 12:42:23 user nova-compute[75672]:   <devices>
Nov 30 12:42:23 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:42:23 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:42:23 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.rescue"/>
Nov 30 12:42:23 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:42:23 user nova-compute[75672]:     </disk>
Nov 30 12:42:23 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:42:23 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:42:23 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk"/>
Nov 30 12:42:23 user nova-compute[75672]:       <target dev="vdb" bus="virtio"/>
Nov 30 12:42:23 user nova-compute[75672]:     </disk>
Nov 30 12:42:23 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:42:23 user nova-compute[75672]:       <mac address="fa:16:3e:64:5c:19"/>
Nov 30 12:42:23 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:42:23 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:42:23 user nova-compute[75672]:       <target dev="tape5d9e2a3-ef"/>
Nov 30 12:42:23 user nova-compute[75672]:     </interface>
Nov 30 12:42:23 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:42:23 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/console.log" append="off"/>
Nov 30 12:42:23 user nova-compute[75672]:     </serial>
Nov 30 12:42:23 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:42:23 user nova-compute[75672]:     <video>
Nov 30 12:42:23 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:42:23 user nova-compute[75672]:     </video>
Nov 30 12:42:23 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:42:23 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:42:23 user nova-compute[75672]:     </rng>
Nov 30 12:42:23 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:42:23 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:42:23 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:42:23 user nova-compute[75672]:     </memballoon>
Nov 30 12:42:23 user nova-compute[75672]:   </devices>
Nov 30 12:42:23 user nova-compute[75672]: </domain>
Nov 30 12:42:23 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:23 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Instance destroyed successfully.
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] No VIF found with MAC fa:16:3e:64:5c:19, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.compute.manager [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:42:23 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Instance spawned successfully.
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:23 user nova-compute[75672]: INFO nova.compute.manager [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.compute.manager [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:42:23 user nova-compute[75672]: INFO nova.compute.manager [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Took 7.91 seconds to build instance.
Nov 30 12:42:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6a8bd1a1-81e6-46b2-8fb4-25fab5f69978 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.034s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.compute.manager [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.499s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:42:23 user nova-compute[75672]: INFO nova.compute.claims [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Claim successful on node user
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.compute.manager [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.network.neutron [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:42:23 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:42:23 user nova-compute[75672]: DEBUG nova.compute.manager [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.policy [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abe9ecbcfe7e444c9946400a062e2b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5dfd98cc2e410db49639a642b13975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.compute.manager [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:42:24 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Creating image(s)
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "/opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "/opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "/opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-a4f93f94-e4be-48a9-b0a8-725144a2f34a req-f5589c9b-0c9d-4ec2-8085-ef18bc9be18e service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Received event network-vif-plugged-5b67acff-0692-42c4-982c-b893d2cf4f0d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a4f93f94-e4be-48a9-b0a8-725144a2f34a req-f5589c9b-0c9d-4ec2-8085-ef18bc9be18e service nova] Acquiring lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a4f93f94-e4be-48a9-b0a8-725144a2f34a req-f5589c9b-0c9d-4ec2-8085-ef18bc9be18e service nova] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a4f93f94-e4be-48a9-b0a8-725144a2f34a req-f5589c9b-0c9d-4ec2-8085-ef18bc9be18e service nova] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-a4f93f94-e4be-48a9-b0a8-725144a2f34a req-f5589c9b-0c9d-4ec2-8085-ef18bc9be18e service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] No waiting events found dispatching network-vif-plugged-5b67acff-0692-42c4-982c-b893d2cf4f0d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:24 user nova-compute[75672]: WARNING nova.compute.manager [req-a4f93f94-e4be-48a9-b0a8-725144a2f34a req-f5589c9b-0c9d-4ec2-8085-ef18bc9be18e service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Received unexpected event network-vif-plugged-5b67acff-0692-42c4-982c-b893d2cf4f0d for instance with vm_state active and task_state None.
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.213s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-5151f4db-2926-43c2-8bb7-ee111a82f22a req-6068df7e-5c3a-407e-8e5d-caaefa6e3648 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5151f4db-2926-43c2-8bb7-ee111a82f22a req-6068df7e-5c3a-407e-8e5d-caaefa6e3648 service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5151f4db-2926-43c2-8bb7-ee111a82f22a req-6068df7e-5c3a-407e-8e5d-caaefa6e3648 service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5151f4db-2926-43c2-8bb7-ee111a82f22a req-6068df7e-5c3a-407e-8e5d-caaefa6e3648 service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-5151f4db-2926-43c2-8bb7-ee111a82f22a req-6068df7e-5c3a-407e-8e5d-caaefa6e3648 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:24 user nova-compute[75672]: WARNING nova.compute.manager [req-5151f4db-2926-43c2-8bb7-ee111a82f22a req-6068df7e-5c3a-407e-8e5d-caaefa6e3648 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received unexpected event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with vm_state active and task_state rescuing.
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.228s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.769s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.compute.manager [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk 1073741824" returned: 0 in 0.051s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.compute.manager [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.network.neutron [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:42:24 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:42:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.compute.manager [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.policy [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3166f2b3dee4aa4aa738f1f15ca7d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f07019e3584771af197e865b6877cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.221s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:42:24 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:42:25 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Creating image(s)
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "/opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "/opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Cannot resize image /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Ensure instance console log exists: /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.207s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.226s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG nova.compute.manager [req-9944a581-6fac-4e94-bdcb-31063bd66980 req-d636e206-99ee-4733-885a-5cb0a2e2bb8e service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received event network-changed-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG nova.compute.manager [req-9944a581-6fac-4e94-bdcb-31063bd66980 req-d636e206-99ee-4733-885a-5cb0a2e2bb8e service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Refreshing instance network info cache due to event network-changed-4a57924f-2da2-49db-9db8-3ee51193d52d. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9944a581-6fac-4e94-bdcb-31063bd66980 req-d636e206-99ee-4733-885a-5cb0a2e2bb8e service nova] Acquiring lock "refresh_cache-0a41ad0b-978b-4931-a30c-573e20f166a8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9944a581-6fac-4e94-bdcb-31063bd66980 req-d636e206-99ee-4733-885a-5cb0a2e2bb8e service nova] Acquired lock "refresh_cache-0a41ad0b-978b-4931-a30c-573e20f166a8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG nova.network.neutron [req-9944a581-6fac-4e94-bdcb-31063bd66980 req-d636e206-99ee-4733-885a-5cb0a2e2bb8e service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Refreshing network info cache for port 4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG nova.network.neutron [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Successfully created port: 3bb61b8e-0d6f-41e2-b5d2-047514910e00 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk 1073741824" returned: 0 in 0.072s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.237s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:25 user nova-compute[75672]: DEBUG nova.network.neutron [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Successfully created port: c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Cannot resize image /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Ensure instance console log exists: /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-08fbbd6a-1c57-43b9-9502-19b525c7819f req-fcb10528-a0a8-4126-968a-9c3a17c6cc63 service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Received event network-vif-plugged-5b67acff-0692-42c4-982c-b893d2cf4f0d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-08fbbd6a-1c57-43b9-9502-19b525c7819f req-fcb10528-a0a8-4126-968a-9c3a17c6cc63 service nova] Acquiring lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-08fbbd6a-1c57-43b9-9502-19b525c7819f req-fcb10528-a0a8-4126-968a-9c3a17c6cc63 service nova] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-08fbbd6a-1c57-43b9-9502-19b525c7819f req-fcb10528-a0a8-4126-968a-9c3a17c6cc63 service nova] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-08fbbd6a-1c57-43b9-9502-19b525c7819f req-fcb10528-a0a8-4126-968a-9c3a17c6cc63 service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] No waiting events found dispatching network-vif-plugged-5b67acff-0692-42c4-982c-b893d2cf4f0d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:26 user nova-compute[75672]: WARNING nova.compute.manager [req-08fbbd6a-1c57-43b9-9502-19b525c7819f req-fcb10528-a0a8-4126-968a-9c3a17c6cc63 service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Received unexpected event network-vif-plugged-5b67acff-0692-42c4-982c-b893d2cf4f0d for instance with vm_state active and task_state None.
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-08fbbd6a-1c57-43b9-9502-19b525c7819f req-fcb10528-a0a8-4126-968a-9c3a17c6cc63 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-changed-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-08fbbd6a-1c57-43b9-9502-19b525c7819f req-fcb10528-a0a8-4126-968a-9c3a17c6cc63 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Refreshing instance network info cache due to event network-changed-1a9e56c6-c320-4afe-9ae3-d1ddca150724. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-08fbbd6a-1c57-43b9-9502-19b525c7819f req-fcb10528-a0a8-4126-968a-9c3a17c6cc63 service nova] Acquiring lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-08fbbd6a-1c57-43b9-9502-19b525c7819f req-fcb10528-a0a8-4126-968a-9c3a17c6cc63 service nova] Acquired lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.network.neutron [req-08fbbd6a-1c57-43b9-9502-19b525c7819f req-fcb10528-a0a8-4126-968a-9c3a17c6cc63 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Refreshing network info cache for port 1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-c691b0c9-abd6-4960-b01f-d0548bd089c7 req-2ae67583-a535-4e22-9760-9a810728a075 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c691b0c9-abd6-4960-b01f-d0548bd089c7 req-2ae67583-a535-4e22-9760-9a810728a075 service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c691b0c9-abd6-4960-b01f-d0548bd089c7 req-2ae67583-a535-4e22-9760-9a810728a075 service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c691b0c9-abd6-4960-b01f-d0548bd089c7 req-2ae67583-a535-4e22-9760-9a810728a075 service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-c691b0c9-abd6-4960-b01f-d0548bd089c7 req-2ae67583-a535-4e22-9760-9a810728a075 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:26 user nova-compute[75672]: WARNING nova.compute.manager [req-c691b0c9-abd6-4960-b01f-d0548bd089c7 req-2ae67583-a535-4e22-9760-9a810728a075 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received unexpected event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with vm_state active and task_state rescuing.
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-c691b0c9-abd6-4960-b01f-d0548bd089c7 req-2ae67583-a535-4e22-9760-9a810728a075 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c691b0c9-abd6-4960-b01f-d0548bd089c7 req-2ae67583-a535-4e22-9760-9a810728a075 service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c691b0c9-abd6-4960-b01f-d0548bd089c7 req-2ae67583-a535-4e22-9760-9a810728a075 service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c691b0c9-abd6-4960-b01f-d0548bd089c7 req-2ae67583-a535-4e22-9760-9a810728a075 service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-c691b0c9-abd6-4960-b01f-d0548bd089c7 req-2ae67583-a535-4e22-9760-9a810728a075 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:26 user nova-compute[75672]: WARNING nova.compute.manager [req-c691b0c9-abd6-4960-b01f-d0548bd089c7 req-2ae67583-a535-4e22-9760-9a810728a075 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received unexpected event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with vm_state active and task_state rescuing.
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.network.neutron [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Successfully updated port: c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "refresh_cache-9ae3632c-e9ad-4bef-9ed9-5571d054b06e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquired lock "refresh_cache-9ae3632c-e9ad-4bef-9ed9-5571d054b06e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.network.neutron [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:42:26 user nova-compute[75672]: DEBUG nova.network.neutron [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.network.neutron [req-9944a581-6fac-4e94-bdcb-31063bd66980 req-d636e206-99ee-4733-885a-5cb0a2e2bb8e service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Updated VIF entry in instance network info cache for port 4a57924f-2da2-49db-9db8-3ee51193d52d. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.network.neutron [req-9944a581-6fac-4e94-bdcb-31063bd66980 req-d636e206-99ee-4733-885a-5cb0a2e2bb8e service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Updating instance_info_cache with network_info: [{"id": "4a57924f-2da2-49db-9db8-3ee51193d52d", "address": "fa:16:3e:6d:59:18", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57924f-2d", "ovs_interfaceid": "4a57924f-2da2-49db-9db8-3ee51193d52d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9944a581-6fac-4e94-bdcb-31063bd66980 req-d636e206-99ee-4733-885a-5cb0a2e2bb8e service nova] Releasing lock "refresh_cache-0a41ad0b-978b-4931-a30c-573e20f166a8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.network.neutron [req-08fbbd6a-1c57-43b9-9502-19b525c7819f req-fcb10528-a0a8-4126-968a-9c3a17c6cc63 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Updated VIF entry in instance network info cache for port 1a9e56c6-c320-4afe-9ae3-d1ddca150724. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.network.neutron [req-08fbbd6a-1c57-43b9-9502-19b525c7819f req-fcb10528-a0a8-4126-968a-9c3a17c6cc63 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Updating instance_info_cache with network_info: [{"id": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "address": "fa:16:3e:bd:1f:55", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9e56c6-c3", "ovs_interfaceid": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Updating instance_info_cache with network_info: [{"id": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "address": "fa:16:3e:8a:e2:85", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3804f22-1b", "ovs_interfaceid": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-08fbbd6a-1c57-43b9-9502-19b525c7819f req-fcb10528-a0a8-4126-968a-9c3a17c6cc63 service nova] Releasing lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Releasing lock "refresh_cache-9ae3632c-e9ad-4bef-9ed9-5571d054b06e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Instance network_info: |[{"id": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "address": "fa:16:3e:8a:e2:85", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3804f22-1b", "ovs_interfaceid": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Start _get_guest_xml network_info=[{"id": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "address": "fa:16:3e:8a:e2:85", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3804f22-1b", "ovs_interfaceid": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:42:27 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:42:27 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Successfully updated port: 3bb61b8e-0d6f-41e2-b5d2-047514910e00 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1583209056',display_name='tempest-AttachVolumeNegativeTest-server-1583209056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1583209056',id=29,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE687QuW++RQm8Z9JnDbnSsrn8EPF/pb1f7HuO22CByZWSwGVivxVdLZpTslZkBbIfSx5c/WfotHrlFenhYCyjT87Z/Nn5FoGsFix3lrQA4OGjI0MIjU4f0p3CfZUsAx4w==',key_name='tempest-keypair-1622503333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f07019e3584771af197e865b6877cc',ramdisk_id='',reservation_id='r-51bqemz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1224349538',owner_user_name='tempest-AttachVolumeNegativeTest-1224349538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3166f2b3dee4aa4aa738f1f15ca7d19',uuid=9ae3632c-e9ad-4bef-9ed9-5571d054b06e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "address": "fa:16:3e:8a:e2:85", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3804f22-1b", "ovs_interfaceid": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converting VIF {"id": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "address": "fa:16:3e:8a:e2:85", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3804f22-1b", "ovs_interfaceid": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:e2:85,bridge_name='br-int',has_traffic_filtering=True,id=c3804f22-1bd2-4813-bf7b-dd6d372f199e,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3804f22-1b') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.objects.instance [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ae3632c-e9ad-4bef-9ed9-5571d054b06e {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "refresh_cache-515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquired lock "refresh_cache-515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c9bfcc5b-2433-480a-9db1-e669625e3ab5 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:42:27 user nova-compute[75672]:   <uuid>9ae3632c-e9ad-4bef-9ed9-5571d054b06e</uuid>
Nov 30 12:42:27 user nova-compute[75672]:   <name>instance-0000001d</name>
Nov 30 12:42:27 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:42:27 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:42:27 user nova-compute[75672]:   <metadata>
Nov 30 12:42:27 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:42:27 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:42:27 user nova-compute[75672]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1583209056</nova:name>
Nov 30 12:42:27 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:42:27</nova:creationTime>
Nov 30 12:42:27 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:42:27 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:42:27 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:42:27 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:42:27 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:42:27 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:42:27 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:42:27 user nova-compute[75672]:       <nova:owner>
Nov 30 12:42:27 user nova-compute[75672]:         <nova:user uuid="e3166f2b3dee4aa4aa738f1f15ca7d19">tempest-AttachVolumeNegativeTest-1224349538-project-member</nova:user>
Nov 30 12:42:27 user nova-compute[75672]:         <nova:project uuid="04f07019e3584771af197e865b6877cc">tempest-AttachVolumeNegativeTest-1224349538</nova:project>
Nov 30 12:42:27 user nova-compute[75672]:       </nova:owner>
Nov 30 12:42:27 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:42:27 user nova-compute[75672]:       <nova:ports>
Nov 30 12:42:27 user nova-compute[75672]:         <nova:port uuid="c3804f22-1bd2-4813-bf7b-dd6d372f199e">
Nov 30 12:42:27 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 12:42:27 user nova-compute[75672]:         </nova:port>
Nov 30 12:42:27 user nova-compute[75672]:       </nova:ports>
Nov 30 12:42:27 user nova-compute[75672]:     </nova:instance>
Nov 30 12:42:27 user nova-compute[75672]:   </metadata>
Nov 30 12:42:27 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:42:27 user nova-compute[75672]:     <system>
Nov 30 12:42:27 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:42:27 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:42:27 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:42:27 user nova-compute[75672]:       <entry name="serial">9ae3632c-e9ad-4bef-9ed9-5571d054b06e</entry>
Nov 30 12:42:27 user nova-compute[75672]:       <entry name="uuid">9ae3632c-e9ad-4bef-9ed9-5571d054b06e</entry>
Nov 30 12:42:27 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:42:27 user nova-compute[75672]:     </system>
Nov 30 12:42:27 user nova-compute[75672]:   </sysinfo>
Nov 30 12:42:27 user nova-compute[75672]:   <os>
Nov 30 12:42:27 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:42:27 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:42:27 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:42:27 user nova-compute[75672]:   </os>
Nov 30 12:42:27 user nova-compute[75672]:   <features>
Nov 30 12:42:27 user nova-compute[75672]:     <acpi/>
Nov 30 12:42:27 user nova-compute[75672]:     <apic/>
Nov 30 12:42:27 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:42:27 user nova-compute[75672]:   </features>
Nov 30 12:42:27 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:42:27 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:42:27 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:42:27 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:42:27 user nova-compute[75672]:   </clock>
Nov 30 12:42:27 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:42:27 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:42:27 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:42:27 user nova-compute[75672]:   </cpu>
Nov 30 12:42:27 user nova-compute[75672]:   <devices>
Nov 30 12:42:27 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:42:27 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:42:27 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk"/>
Nov 30 12:42:27 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:42:27 user nova-compute[75672]:     </disk>
Nov 30 12:42:27 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:42:27 user nova-compute[75672]:       <mac address="fa:16:3e:8a:e2:85"/>
Nov 30 12:42:27 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:42:27 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:42:27 user nova-compute[75672]:       <target dev="tapc3804f22-1b"/>
Nov 30 12:42:27 user nova-compute[75672]:     </interface>
Nov 30 12:42:27 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:42:27 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/console.log" append="off"/>
Nov 30 12:42:27 user nova-compute[75672]:     </serial>
Nov 30 12:42:27 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:42:27 user nova-compute[75672]:     <video>
Nov 30 12:42:27 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:42:27 user nova-compute[75672]:     </video>
Nov 30 12:42:27 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:42:27 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:42:27 user nova-compute[75672]:     </rng>
Nov 30 12:42:27 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:42:27 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:42:27 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:42:27 user nova-compute[75672]:     </memballoon>
Nov 30 12:42:27 user nova-compute[75672]:   </devices>
Nov 30 12:42:27 user nova-compute[75672]: </domain>
Nov 30 12:42:27 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1583209056',display_name='tempest-AttachVolumeNegativeTest-server-1583209056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1583209056',id=29,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE687QuW++RQm8Z9JnDbnSsrn8EPF/pb1f7HuO22CByZWSwGVivxVdLZpTslZkBbIfSx5c/WfotHrlFenhYCyjT87Z/Nn5FoGsFix3lrQA4OGjI0MIjU4f0p3CfZUsAx4w==',key_name='tempest-keypair-1622503333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f07019e3584771af197e865b6877cc',ramdisk_id='',reservation_id='r-51bqemz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1224349538',owner_user_name='tempest-AttachVolumeNegativeTest-1224349538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3166f2b3dee4aa4aa738f1f15ca7d19',uuid=9ae3632c-e9ad-4bef-9ed9-5571d054b06e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "address": "fa:16:3e:8a:e2:85", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3804f22-1b", "ovs_interfaceid": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converting VIF {"id": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "address": "fa:16:3e:8a:e2:85", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3804f22-1b", "ovs_interfaceid": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:e2:85,bridge_name='br-int',has_traffic_filtering=True,id=c3804f22-1bd2-4813-bf7b-dd6d372f199e,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3804f22-1b') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG os_vif [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:e2:85,bridge_name='br-int',has_traffic_filtering=True,id=c3804f22-1bd2-4813-bf7b-dd6d372f199e,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3804f22-1b') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-edbad189-e0ce-46b4-bedc-e944cab4c22a req-9c2081b4-6431-4936-8686-4d2b018126a4 service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Received event network-changed-3bb61b8e-0d6f-41e2-b5d2-047514910e00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-edbad189-e0ce-46b4-bedc-e944cab4c22a req-9c2081b4-6431-4936-8686-4d2b018126a4 service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Refreshing instance network info cache due to event network-changed-3bb61b8e-0d6f-41e2-b5d2-047514910e00. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-edbad189-e0ce-46b4-bedc-e944cab4c22a req-9c2081b4-6431-4936-8686-4d2b018126a4 service nova] Acquiring lock "refresh_cache-515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c2a0c79-162c-50a6-b16c-b8ea35df6da5', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3804f22-1b, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3804f22-1b, col_values=(('qos', UUID('a0d7523c-23f0-4937-880c-ce1e4fd8ee3e')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3804f22-1b, col_values=(('external_ids', {'iface-id': 'c3804f22-1bd2-4813-bf7b-dd6d372f199e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:e2:85', 'vm-uuid': '9ae3632c-e9ad-4bef-9ed9-5571d054b06e'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:42:27 user nova-compute[75672]: INFO os_vif [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:e2:85,bridge_name='br-int',has_traffic_filtering=True,id=c3804f22-1bd2-4813-bf7b-dd6d372f199e,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3804f22-1b')
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:42:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No VIF found with MAC fa:16:3e:8a:e2:85, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.network.neutron [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Updating instance_info_cache with network_info: [{"id": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "address": "fa:16:3e:94:ca:0d", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb61b8e-0d", "ovs_interfaceid": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Releasing lock "refresh_cache-515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.compute.manager [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Instance network_info: |[{"id": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "address": "fa:16:3e:94:ca:0d", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb61b8e-0d", "ovs_interfaceid": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-edbad189-e0ce-46b4-bedc-e944cab4c22a req-9c2081b4-6431-4936-8686-4d2b018126a4 service nova] Acquired lock "refresh_cache-515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.network.neutron [req-edbad189-e0ce-46b4-bedc-e944cab4c22a req-9c2081b4-6431-4936-8686-4d2b018126a4 service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Refreshing network info cache for port 3bb61b8e-0d6f-41e2-b5d2-047514910e00 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Start _get_guest_xml network_info=[{"id": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "address": "fa:16:3e:94:ca:0d", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb61b8e-0d", "ovs_interfaceid": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:42:28 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:42:28 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1165295209',display_name='tempest-VolumesActionsTest-instance-1165295209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1165295209',id=28,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa5dfd98cc2e410db49639a642b13975',ramdisk_id='',reservation_id='r-xu61c371',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-364551348',owner_user_name='tempest-VolumesActionsTest-364551348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:42:24Z,user_data=None,user_id='abe9ecbcfe7e444c9946400a062e2b7a',uuid=515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "address": "fa:16:3e:94:ca:0d", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb61b8e-0d", "ovs_interfaceid": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Converting VIF {"id": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "address": "fa:16:3e:94:ca:0d", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb61b8e-0d", "ovs_interfaceid": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:ca:0d,bridge_name='br-int',has_traffic_filtering=True,id=3bb61b8e-0d6f-41e2-b5d2-047514910e00,network=Network(ad88a05e-9702-4570-8363-f905f54e7c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb61b8e-0d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.objects.instance [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lazy-loading 'pci_devices' on Instance uuid 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:42:28 user nova-compute[75672]:   <uuid>515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7</uuid>
Nov 30 12:42:28 user nova-compute[75672]:   <name>instance-0000001c</name>
Nov 30 12:42:28 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:42:28 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:42:28 user nova-compute[75672]:   <metadata>
Nov 30 12:42:28 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:42:28 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:42:28 user nova-compute[75672]:       <nova:name>tempest-VolumesActionsTest-instance-1165295209</nova:name>
Nov 30 12:42:28 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:42:28</nova:creationTime>
Nov 30 12:42:28 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:42:28 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:42:28 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:42:28 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:42:28 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:42:28 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:42:28 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:42:28 user nova-compute[75672]:       <nova:owner>
Nov 30 12:42:28 user nova-compute[75672]:         <nova:user uuid="abe9ecbcfe7e444c9946400a062e2b7a">tempest-VolumesActionsTest-364551348-project-member</nova:user>
Nov 30 12:42:28 user nova-compute[75672]:         <nova:project uuid="aa5dfd98cc2e410db49639a642b13975">tempest-VolumesActionsTest-364551348</nova:project>
Nov 30 12:42:28 user nova-compute[75672]:       </nova:owner>
Nov 30 12:42:28 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:42:28 user nova-compute[75672]:       <nova:ports>
Nov 30 12:42:28 user nova-compute[75672]:         <nova:port uuid="3bb61b8e-0d6f-41e2-b5d2-047514910e00">
Nov 30 12:42:28 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 12:42:28 user nova-compute[75672]:         </nova:port>
Nov 30 12:42:28 user nova-compute[75672]:       </nova:ports>
Nov 30 12:42:28 user nova-compute[75672]:     </nova:instance>
Nov 30 12:42:28 user nova-compute[75672]:   </metadata>
Nov 30 12:42:28 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:42:28 user nova-compute[75672]:     <system>
Nov 30 12:42:28 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:42:28 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:42:28 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:42:28 user nova-compute[75672]:       <entry name="serial">515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7</entry>
Nov 30 12:42:28 user nova-compute[75672]:       <entry name="uuid">515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7</entry>
Nov 30 12:42:28 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:42:28 user nova-compute[75672]:     </system>
Nov 30 12:42:28 user nova-compute[75672]:   </sysinfo>
Nov 30 12:42:28 user nova-compute[75672]:   <os>
Nov 30 12:42:28 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:42:28 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:42:28 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:42:28 user nova-compute[75672]:   </os>
Nov 30 12:42:28 user nova-compute[75672]:   <features>
Nov 30 12:42:28 user nova-compute[75672]:     <acpi/>
Nov 30 12:42:28 user nova-compute[75672]:     <apic/>
Nov 30 12:42:28 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:42:28 user nova-compute[75672]:   </features>
Nov 30 12:42:28 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:42:28 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:42:28 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:42:28 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:42:28 user nova-compute[75672]:   </clock>
Nov 30 12:42:28 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:42:28 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:42:28 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:42:28 user nova-compute[75672]:   </cpu>
Nov 30 12:42:28 user nova-compute[75672]:   <devices>
Nov 30 12:42:28 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:42:28 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:42:28 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk"/>
Nov 30 12:42:28 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:42:28 user nova-compute[75672]:     </disk>
Nov 30 12:42:28 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:42:28 user nova-compute[75672]:       <mac address="fa:16:3e:94:ca:0d"/>
Nov 30 12:42:28 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:42:28 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:42:28 user nova-compute[75672]:       <target dev="tap3bb61b8e-0d"/>
Nov 30 12:42:28 user nova-compute[75672]:     </interface>
Nov 30 12:42:28 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:42:28 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/console.log" append="off"/>
Nov 30 12:42:28 user nova-compute[75672]:     </serial>
Nov 30 12:42:28 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:42:28 user nova-compute[75672]:     <video>
Nov 30 12:42:28 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:42:28 user nova-compute[75672]:     </video>
Nov 30 12:42:28 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:42:28 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:42:28 user nova-compute[75672]:     </rng>
Nov 30 12:42:28 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:42:28 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:42:28 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:42:28 user nova-compute[75672]:     </memballoon>
Nov 30 12:42:28 user nova-compute[75672]:   </devices>
Nov 30 12:42:28 user nova-compute[75672]: </domain>
Nov 30 12:42:28 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1165295209',display_name='tempest-VolumesActionsTest-instance-1165295209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1165295209',id=28,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa5dfd98cc2e410db49639a642b13975',ramdisk_id='',reservation_id='r-xu61c371',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-364551348',owner_user_name='tempest-VolumesActionsTest-364551348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:42:24Z,user_data=None,user_id='abe9ecbcfe7e444c9946400a062e2b7a',uuid=515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "address": "fa:16:3e:94:ca:0d", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb61b8e-0d", "ovs_interfaceid": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Converting VIF {"id": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "address": "fa:16:3e:94:ca:0d", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb61b8e-0d", "ovs_interfaceid": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:ca:0d,bridge_name='br-int',has_traffic_filtering=True,id=3bb61b8e-0d6f-41e2-b5d2-047514910e00,network=Network(ad88a05e-9702-4570-8363-f905f54e7c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb61b8e-0d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG os_vif [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:ca:0d,bridge_name='br-int',has_traffic_filtering=True,id=3bb61b8e-0d6f-41e2-b5d2-047514910e00,network=Network(ad88a05e-9702-4570-8363-f905f54e7c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb61b8e-0d') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12dcaa44-6f7c-5d2e-82f1-13e80fc00223', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bb61b8e-0d, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3bb61b8e-0d, col_values=(('qos', UUID('0d513d04-2df1-4fc9-9e90-7f408f6e1878')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3bb61b8e-0d, col_values=(('external_ids', {'iface-id': '3bb61b8e-0d6f-41e2-b5d2-047514910e00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:ca:0d', 'vm-uuid': '515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:28 user nova-compute[75672]: INFO os_vif [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:ca:0d,bridge_name='br-int',has_traffic_filtering=True,id=3bb61b8e-0d6f-41e2-b5d2-047514910e00,network=Network(ad88a05e-9702-4570-8363-f905f54e7c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb61b8e-0d')
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] No VIF found with MAC fa:16:3e:94:ca:0d, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.compute.manager [req-e9150ba2-7ea0-4726-848d-690ff9b0ffb3 req-4eca0f55-78f2-4ea8-9244-0579c553e2e4 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Received event network-changed-c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.compute.manager [req-e9150ba2-7ea0-4726-848d-690ff9b0ffb3 req-4eca0f55-78f2-4ea8-9244-0579c553e2e4 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Refreshing instance network info cache due to event network-changed-c3804f22-1bd2-4813-bf7b-dd6d372f199e. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e9150ba2-7ea0-4726-848d-690ff9b0ffb3 req-4eca0f55-78f2-4ea8-9244-0579c553e2e4 service nova] Acquiring lock "refresh_cache-9ae3632c-e9ad-4bef-9ed9-5571d054b06e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e9150ba2-7ea0-4726-848d-690ff9b0ffb3 req-4eca0f55-78f2-4ea8-9244-0579c553e2e4 service nova] Acquired lock "refresh_cache-9ae3632c-e9ad-4bef-9ed9-5571d054b06e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.network.neutron [req-e9150ba2-7ea0-4726-848d-690ff9b0ffb3 req-4eca0f55-78f2-4ea8-9244-0579c553e2e4 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Refreshing network info cache for port c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.network.neutron [req-edbad189-e0ce-46b4-bedc-e944cab4c22a req-9c2081b4-6431-4936-8686-4d2b018126a4 service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Updated VIF entry in instance network info cache for port 3bb61b8e-0d6f-41e2-b5d2-047514910e00. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG nova.network.neutron [req-edbad189-e0ce-46b4-bedc-e944cab4c22a req-9c2081b4-6431-4936-8686-4d2b018126a4 service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Updating instance_info_cache with network_info: [{"id": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "address": "fa:16:3e:94:ca:0d", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb61b8e-0d", "ovs_interfaceid": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-edbad189-e0ce-46b4-bedc-e944cab4c22a req-9c2081b4-6431-4936-8686-4d2b018126a4 service nova] Releasing lock "refresh_cache-515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:29 user nova-compute[75672]: DEBUG nova.network.neutron [req-e9150ba2-7ea0-4726-848d-690ff9b0ffb3 req-4eca0f55-78f2-4ea8-9244-0579c553e2e4 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Updated VIF entry in instance network info cache for port c3804f22-1bd2-4813-bf7b-dd6d372f199e. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:42:29 user nova-compute[75672]: DEBUG nova.network.neutron [req-e9150ba2-7ea0-4726-848d-690ff9b0ffb3 req-4eca0f55-78f2-4ea8-9244-0579c553e2e4 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Updating instance_info_cache with network_info: [{"id": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "address": "fa:16:3e:8a:e2:85", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3804f22-1b", "ovs_interfaceid": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e9150ba2-7ea0-4726-848d-690ff9b0ffb3 req-4eca0f55-78f2-4ea8-9244-0579c553e2e4 service nova] Releasing lock "refresh_cache-9ae3632c-e9ad-4bef-9ed9-5571d054b06e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-1bc33185-a613-41eb-b299-576e9df947e0 req-9d1d8401-ea51-4a2b-ba6a-1e56ebadcc5e service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-changed-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-1bc33185-a613-41eb-b299-576e9df947e0 req-9d1d8401-ea51-4a2b-ba6a-1e56ebadcc5e service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Refreshing instance network info cache due to event network-changed-1a9e56c6-c320-4afe-9ae3-d1ddca150724. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:42:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1bc33185-a613-41eb-b299-576e9df947e0 req-9d1d8401-ea51-4a2b-ba6a-1e56ebadcc5e service nova] Acquiring lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1bc33185-a613-41eb-b299-576e9df947e0 req-9d1d8401-ea51-4a2b-ba6a-1e56ebadcc5e service nova] Acquired lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:29 user nova-compute[75672]: DEBUG nova.network.neutron [req-1bc33185-a613-41eb-b299-576e9df947e0 req-9d1d8401-ea51-4a2b-ba6a-1e56ebadcc5e service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Refreshing network info cache for port 1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG nova.network.neutron [req-1bc33185-a613-41eb-b299-576e9df947e0 req-9d1d8401-ea51-4a2b-ba6a-1e56ebadcc5e service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Updated VIF entry in instance network info cache for port 1a9e56c6-c320-4afe-9ae3-d1ddca150724. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG nova.network.neutron [req-1bc33185-a613-41eb-b299-576e9df947e0 req-9d1d8401-ea51-4a2b-ba6a-1e56ebadcc5e service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Updating instance_info_cache with network_info: [{"id": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "address": "fa:16:3e:bd:1f:55", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9e56c6-c3", "ovs_interfaceid": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1bc33185-a613-41eb-b299-576e9df947e0 req-9d1d8401-ea51-4a2b-ba6a-1e56ebadcc5e service nova] Releasing lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d190f539-3717-4e54-97c0-376d311fd7b6 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d190f539-3717-4e54-97c0-376d311fd7b6 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:30 user nova-compute[75672]: INFO nova.compute.manager [None req-d190f539-3717-4e54-97c0-376d311fd7b6 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Rebooting instance
Nov 30 12:42:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d190f539-3717-4e54-97c0-376d311fd7b6 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d190f539-3717-4e54-97c0-376d311fd7b6 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquired lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG nova.network.neutron [None req-d190f539-3717-4e54-97c0-376d311fd7b6 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG nova.compute.manager [req-0a5a6e51-fca3-41e1-9b73-c8d3e93d0709 req-3ce6ed6b-ee3e-4bef-891d-2efb509c8860 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Received event network-vif-plugged-c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0a5a6e51-fca3-41e1-9b73-c8d3e93d0709 req-3ce6ed6b-ee3e-4bef-891d-2efb509c8860 service nova] Acquiring lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0a5a6e51-fca3-41e1-9b73-c8d3e93d0709 req-3ce6ed6b-ee3e-4bef-891d-2efb509c8860 service nova] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0a5a6e51-fca3-41e1-9b73-c8d3e93d0709 req-3ce6ed6b-ee3e-4bef-891d-2efb509c8860 service nova] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:30 user nova-compute[75672]: DEBUG nova.compute.manager [req-0a5a6e51-fca3-41e1-9b73-c8d3e93d0709 req-3ce6ed6b-ee3e-4bef-891d-2efb509c8860 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] No waiting events found dispatching network-vif-plugged-c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:30 user nova-compute[75672]: WARNING nova.compute.manager [req-0a5a6e51-fca3-41e1-9b73-c8d3e93d0709 req-3ce6ed6b-ee3e-4bef-891d-2efb509c8860 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Received unexpected event network-vif-plugged-c3804f22-1bd2-4813-bf7b-dd6d372f199e for instance with vm_state building and task_state spawning.
Nov 30 12:42:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:31 user nova-compute[75672]: DEBUG nova.network.neutron [None req-d190f539-3717-4e54-97c0-376d311fd7b6 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Updating instance_info_cache with network_info: [{"id": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "address": "fa:16:3e:bd:1f:55", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9e56c6-c3", "ovs_interfaceid": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d190f539-3717-4e54-97c0-376d311fd7b6 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Releasing lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:31 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d190f539-3717-4e54-97c0-376d311fd7b6 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:42:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-46a7ec3f-3735-46b2-8fc4-5f3ff1d12d12 req-78fac042-f65a-4d97-82f8-137fdc037e5c service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Received event network-vif-plugged-3bb61b8e-0d6f-41e2-b5d2-047514910e00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-46a7ec3f-3735-46b2-8fc4-5f3ff1d12d12 req-78fac042-f65a-4d97-82f8-137fdc037e5c service nova] Acquiring lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-46a7ec3f-3735-46b2-8fc4-5f3ff1d12d12 req-78fac042-f65a-4d97-82f8-137fdc037e5c service nova] Lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-46a7ec3f-3735-46b2-8fc4-5f3ff1d12d12 req-78fac042-f65a-4d97-82f8-137fdc037e5c service nova] Lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-46a7ec3f-3735-46b2-8fc4-5f3ff1d12d12 req-78fac042-f65a-4d97-82f8-137fdc037e5c service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] No waiting events found dispatching network-vif-plugged-3bb61b8e-0d6f-41e2-b5d2-047514910e00 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:31 user nova-compute[75672]: WARNING nova.compute.manager [req-46a7ec3f-3735-46b2-8fc4-5f3ff1d12d12 req-78fac042-f65a-4d97-82f8-137fdc037e5c service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Received unexpected event network-vif-plugged-3bb61b8e-0d6f-41e2-b5d2-047514910e00 for instance with vm_state building and task_state spawning.
Nov 30 12:42:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-46a7ec3f-3735-46b2-8fc4-5f3ff1d12d12 req-78fac042-f65a-4d97-82f8-137fdc037e5c service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Received event network-vif-plugged-3bb61b8e-0d6f-41e2-b5d2-047514910e00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-46a7ec3f-3735-46b2-8fc4-5f3ff1d12d12 req-78fac042-f65a-4d97-82f8-137fdc037e5c service nova] Acquiring lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-46a7ec3f-3735-46b2-8fc4-5f3ff1d12d12 req-78fac042-f65a-4d97-82f8-137fdc037e5c service nova] Lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-46a7ec3f-3735-46b2-8fc4-5f3ff1d12d12 req-78fac042-f65a-4d97-82f8-137fdc037e5c service nova] Lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:31 user nova-compute[75672]: DEBUG nova.compute.manager [req-46a7ec3f-3735-46b2-8fc4-5f3ff1d12d12 req-78fac042-f65a-4d97-82f8-137fdc037e5c service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] No waiting events found dispatching network-vif-plugged-3bb61b8e-0d6f-41e2-b5d2-047514910e00 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:31 user nova-compute[75672]: WARNING nova.compute.manager [req-46a7ec3f-3735-46b2-8fc4-5f3ff1d12d12 req-78fac042-f65a-4d97-82f8-137fdc037e5c service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Received unexpected event network-vif-plugged-3bb61b8e-0d6f-41e2-b5d2-047514910e00 for instance with vm_state building and task_state spawning.
Nov 30 12:42:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-91a0b692-00c0-4c5a-a3c6-edf7ecbae506 req-e2fdd9ab-be06-4e1e-a23b-fc78feb6e875 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Received event network-vif-plugged-c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-91a0b692-00c0-4c5a-a3c6-edf7ecbae506 req-e2fdd9ab-be06-4e1e-a23b-fc78feb6e875 service nova] Acquiring lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-91a0b692-00c0-4c5a-a3c6-edf7ecbae506 req-e2fdd9ab-be06-4e1e-a23b-fc78feb6e875 service nova] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-91a0b692-00c0-4c5a-a3c6-edf7ecbae506 req-e2fdd9ab-be06-4e1e-a23b-fc78feb6e875 service nova] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-91a0b692-00c0-4c5a-a3c6-edf7ecbae506 req-e2fdd9ab-be06-4e1e-a23b-fc78feb6e875 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] No waiting events found dispatching network-vif-plugged-c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:32 user nova-compute[75672]: WARNING nova.compute.manager [req-91a0b692-00c0-4c5a-a3c6-edf7ecbae506 req-e2fdd9ab-be06-4e1e-a23b-fc78feb6e875 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Received unexpected event network-vif-plugged-c3804f22-1bd2-4813-bf7b-dd6d372f199e for instance with vm_state building and task_state spawning.
Nov 30 12:42:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.compute.manager [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:42:33 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Instance spawned successfully.
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.compute.manager [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:42:33 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Instance spawned successfully.
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:33 user nova-compute[75672]: INFO nova.compute.manager [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Took 9.60 seconds to spawn the instance on the hypervisor.
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.compute.manager [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:42:33 user nova-compute[75672]: INFO nova.compute.manager [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Took 8.71 seconds to spawn the instance on the hypervisor.
Nov 30 12:42:33 user nova-compute[75672]: DEBUG nova.compute.manager [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:42:33 user nova-compute[75672]: INFO nova.compute.manager [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Took 10.62 seconds to build instance.
Nov 30 12:42:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-67393515-c83c-4896-b607-f7326d9b2059 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.772s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:33 user nova-compute[75672]: INFO nova.compute.manager [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Took 10.60 seconds to build instance.
Nov 30 12:42:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-951e18db-3485-4581-8bde-f23fec4cb4b0 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.735s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:42:34 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d190f539-3717-4e54-97c0-376d311fd7b6 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Instance shutdown successfully.
Nov 30 12:42:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:42:34 user nova-compute[75672]: INFO nova.compute.claims [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Claim successful on node user
Nov 30 12:42:34 user nova-compute[75672]: DEBUG nova.compute.manager [req-53660ef7-60f3-465c-b93b-a3aeccdc5d52 req-41a602b8-c04e-4383-ad37-4cb9a73c00dc service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-vif-unplugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-53660ef7-60f3-465c-b93b-a3aeccdc5d52 req-41a602b8-c04e-4383-ad37-4cb9a73c00dc service nova] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-53660ef7-60f3-465c-b93b-a3aeccdc5d52 req-41a602b8-c04e-4383-ad37-4cb9a73c00dc service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-53660ef7-60f3-465c-b93b-a3aeccdc5d52 req-41a602b8-c04e-4383-ad37-4cb9a73c00dc service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG nova.compute.manager [req-53660ef7-60f3-465c-b93b-a3aeccdc5d52 req-41a602b8-c04e-4383-ad37-4cb9a73c00dc service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] No waiting events found dispatching network-vif-unplugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:34 user nova-compute[75672]: WARNING nova.compute.manager [req-53660ef7-60f3-465c-b93b-a3aeccdc5d52 req-41a602b8-c04e-4383-ad37-4cb9a73c00dc service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received unexpected event network-vif-unplugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 for instance with vm_state active and task_state reboot_started.
Nov 30 12:42:34 user nova-compute[75672]: DEBUG nova.compute.manager [req-53660ef7-60f3-465c-b93b-a3aeccdc5d52 req-41a602b8-c04e-4383-ad37-4cb9a73c00dc service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-53660ef7-60f3-465c-b93b-a3aeccdc5d52 req-41a602b8-c04e-4383-ad37-4cb9a73c00dc service nova] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-53660ef7-60f3-465c-b93b-a3aeccdc5d52 req-41a602b8-c04e-4383-ad37-4cb9a73c00dc service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-53660ef7-60f3-465c-b93b-a3aeccdc5d52 req-41a602b8-c04e-4383-ad37-4cb9a73c00dc service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:34 user nova-compute[75672]: DEBUG nova.compute.manager [req-53660ef7-60f3-465c-b93b-a3aeccdc5d52 req-41a602b8-c04e-4383-ad37-4cb9a73c00dc service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] No waiting events found dispatching network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:34 user nova-compute[75672]: WARNING nova.compute.manager [req-53660ef7-60f3-465c-b93b-a3aeccdc5d52 req-41a602b8-c04e-4383-ad37-4cb9a73c00dc service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received unexpected event network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 for instance with vm_state active and task_state reboot_started.
Nov 30 12:42:35 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updating instance_info_cache with network_info: [{"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:35 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:42:35 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:42:35 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:42:35 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:42:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:35 user nova-compute[75672]: DEBUG nova.compute.manager [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:42:35 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:42:35 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:42:35 user nova-compute[75672]: DEBUG nova.compute.manager [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:42:35 user nova-compute[75672]: DEBUG nova.network.neutron [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:42:35 user nova-compute[75672]: DEBUG nova.compute.manager [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:42:35 user nova-compute[75672]: INFO nova.virt.block_device [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Booting with volume snapshot f0ce5724-55b5-4e3e-8e53-754354e179e1 at /dev/vda
Nov 30 12:42:35 user nova-compute[75672]: DEBUG nova.policy [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '924cf8ff73154f8fadb371175a0d8fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513644b3a140400dbdf6b07e8e727dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:42:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:36 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:42:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:36 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-380d8654-5a5b-473f-9269-d5f16c40018b req-7c416852-f1f3-40f3-8029-956f2ba5edf2 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-380d8654-5a5b-473f-9269-d5f16c40018b req-7c416852-f1f3-40f3-8029-956f2ba5edf2 service nova] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-380d8654-5a5b-473f-9269-d5f16c40018b req-7c416852-f1f3-40f3-8029-956f2ba5edf2 service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-380d8654-5a5b-473f-9269-d5f16c40018b req-7c416852-f1f3-40f3-8029-956f2ba5edf2 service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-380d8654-5a5b-473f-9269-d5f16c40018b req-7c416852-f1f3-40f3-8029-956f2ba5edf2 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] No waiting events found dispatching network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:37 user nova-compute[75672]: WARNING nova.compute.manager [req-380d8654-5a5b-473f-9269-d5f16c40018b req-7c416852-f1f3-40f3-8029-956f2ba5edf2 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received unexpected event network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 for instance with vm_state active and task_state reboot_started.
Nov 30 12:42:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG nova.network.neutron [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Successfully created port: 8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Successfully updated port: 8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "refresh_cache-e60dffb1-a1b9-48cd-85a0-edccc97ea849" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquired lock "refresh_cache-e60dffb1-a1b9-48cd-85a0-edccc97ea849" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.285s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Updating instance_info_cache with network_info: [{"id": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "address": "fa:16:3e:9c:77:f9", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0b2d72-14", "ovs_interfaceid": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Releasing lock "refresh_cache-e60dffb1-a1b9-48cd-85a0-edccc97ea849" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:38 user nova-compute[75672]: DEBUG nova.compute.manager [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Instance network_info: |[{"id": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "address": "fa:16:3e:9c:77:f9", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0b2d72-14", "ovs_interfaceid": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-84b383ba-b8d1-4794-a395-5a406bc1035e req-84c8f7fd-1887-481a-a0fe-1642a1cf37a0 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84b383ba-b8d1-4794-a395-5a406bc1035e req-84c8f7fd-1887-481a-a0fe-1642a1cf37a0 service nova] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84b383ba-b8d1-4794-a395-5a406bc1035e req-84c8f7fd-1887-481a-a0fe-1642a1cf37a0 service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84b383ba-b8d1-4794-a395-5a406bc1035e req-84c8f7fd-1887-481a-a0fe-1642a1cf37a0 service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-84b383ba-b8d1-4794-a395-5a406bc1035e req-84c8f7fd-1887-481a-a0fe-1642a1cf37a0 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] No waiting events found dispatching network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:39 user nova-compute[75672]: WARNING nova.compute.manager [req-84b383ba-b8d1-4794-a395-5a406bc1035e req-84c8f7fd-1887-481a-a0fe-1642a1cf37a0 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received unexpected event network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 for instance with vm_state active and task_state reboot_started.
Nov 30 12:42:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-84b383ba-b8d1-4794-a395-5a406bc1035e req-84c8f7fd-1887-481a-a0fe-1642a1cf37a0 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Received event network-changed-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-84b383ba-b8d1-4794-a395-5a406bc1035e req-84c8f7fd-1887-481a-a0fe-1642a1cf37a0 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Refreshing instance network info cache due to event network-changed-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84b383ba-b8d1-4794-a395-5a406bc1035e req-84c8f7fd-1887-481a-a0fe-1642a1cf37a0 service nova] Acquiring lock "refresh_cache-e60dffb1-a1b9-48cd-85a0-edccc97ea849" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84b383ba-b8d1-4794-a395-5a406bc1035e req-84c8f7fd-1887-481a-a0fe-1642a1cf37a0 service nova] Acquired lock "refresh_cache-e60dffb1-a1b9-48cd-85a0-edccc97ea849" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG nova.network.neutron [req-84b383ba-b8d1-4794-a395-5a406bc1035e req-84c8f7fd-1887-481a-a0fe-1642a1cf37a0 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Refreshing network info cache for port 8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:42:39 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Instance running successfully.
Nov 30 12:42:39 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d190f539-3717-4e54-97c0-376d311fd7b6 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Instance soft rebooted successfully.
Nov 30 12:42:39 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d190f539-3717-4e54-97c0-376d311fd7b6 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d190f539-3717-4e54-97c0-376d311fd7b6 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.958s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:40 user nova-compute[75672]: DEBUG nova.network.neutron [req-84b383ba-b8d1-4794-a395-5a406bc1035e req-84c8f7fd-1887-481a-a0fe-1642a1cf37a0 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Updated VIF entry in instance network info cache for port 8e0b2d72-1412-47d0-b759-4cdb0dadc5e9. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:42:40 user nova-compute[75672]: DEBUG nova.network.neutron [req-84b383ba-b8d1-4794-a395-5a406bc1035e req-84c8f7fd-1887-481a-a0fe-1642a1cf37a0 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Updating instance_info_cache with network_info: [{"id": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "address": "fa:16:3e:9c:77:f9", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0b2d72-14", "ovs_interfaceid": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-84b383ba-b8d1-4794-a395-5a406bc1035e req-84c8f7fd-1887-481a-a0fe-1642a1cf37a0 service nova] Releasing lock "refresh_cache-e60dffb1-a1b9-48cd-85a0-edccc97ea849" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:42:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG os_brick.utils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[806a9b2a-170f-4273-88aa-331451fa3838]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef9cbf7-70c0-4090-ba65-2bb5bbd67e7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d15a956-1bb9-4369-98fc-89534427e2a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[61be8948-fdb2-437d-910d-92fe78f7448b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:42:41 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:42:41 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c900b31a-4ce3-4fe1-96db-15a2b194d9ef]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG os_brick.utils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== get_connector_properties: return (209ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:42:41 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Updating existing volume attachment record: d748ad1b-884c-4099-ab08-9c81be51995d {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:42:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "044e4031-8381-4e7f-a5ac-1a074e00497e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:43 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:42:43 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7444MB free_disk=25.225704193115234GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Applying migration context for instance 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 as it has an incoming, in-progress migration f82dc564-73aa-4395-9cd3-fdcbe2a6e4f3. Migration status is finished {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 12:42:43 user nova-compute[75672]: INFO nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updating resource usage from migration f82dc564-73aa-4395-9cd3-fdcbe2a6e4f3
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 874354b8-bf12-44d6-86f8-0db17ce28faa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance b06bea0f-9186-4ab8-8bad-588beb48a1f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 0a41ad0b-978b-4931-a30c-573e20f166a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Migration f82dc564-73aa-4395-9cd3-fdcbe2a6e4f3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 9ae3632c-e9ad-4bef-9ed9-5571d054b06e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:42:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance e60dffb1-a1b9-48cd-85a0-edccc97ea849 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 044e4031-8381-4e7f-a5ac-1a074e00497e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing inventories for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating ProviderTree inventory for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating inventory in ProviderTree for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing aggregate associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, aggregates: None {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing trait associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.985s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.885s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:42:44 user nova-compute[75672]: INFO nova.compute.claims [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Claim successful on node user
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] There are 0 instances to clean {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:42:44 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75672) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG nova.compute.manager [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG nova.compute.manager [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG nova.network.neutron [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:42:45 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:42:45 user nova-compute[75672]: DEBUG nova.policy [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e98ee9bd3b604b39a3f6013a40398642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0ca8eb58644e058b2019a4faa41a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG nova.compute.manager [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG nova.compute.manager [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:42:45 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Creating image(s)
Nov 30 12:42:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "/opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "/opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "/opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.256s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Successfully created port: 19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.242s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk 1073741824" returned: 0 in 0.055s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.227s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Cannot resize image /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Ensure instance console log exists: /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.network.neutron [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Successfully updated port: 19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "refresh_cache-044e4031-8381-4e7f-a5ac-1a074e00497e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquired lock "refresh_cache-044e4031-8381-4e7f-a5ac-1a074e00497e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.network.neutron [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-aea78b12-65cf-47e3-b6ab-7febfae7793d req-616277f9-3264-4132-ab17-47f701524d6f service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Received event network-changed-19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-aea78b12-65cf-47e3-b6ab-7febfae7793d req-616277f9-3264-4132-ab17-47f701524d6f service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Refreshing instance network info cache due to event network-changed-19ff09c5-922f-48bf-a8d2-16f60aa9780f. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-aea78b12-65cf-47e3-b6ab-7febfae7793d req-616277f9-3264-4132-ab17-47f701524d6f service nova] Acquiring lock "refresh_cache-044e4031-8381-4e7f-a5ac-1a074e00497e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.network.neutron [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.network.neutron [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Updating instance_info_cache with network_info: [{"id": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "address": "fa:16:3e:0a:af:87", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ff09c5-92", "ovs_interfaceid": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Releasing lock "refresh_cache-044e4031-8381-4e7f-a5ac-1a074e00497e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Instance network_info: |[{"id": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "address": "fa:16:3e:0a:af:87", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ff09c5-92", "ovs_interfaceid": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-aea78b12-65cf-47e3-b6ab-7febfae7793d req-616277f9-3264-4132-ab17-47f701524d6f service nova] Acquired lock "refresh_cache-044e4031-8381-4e7f-a5ac-1a074e00497e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.network.neutron [req-aea78b12-65cf-47e3-b6ab-7febfae7793d req-616277f9-3264-4132-ab17-47f701524d6f service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Refreshing network info cache for port 19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Start _get_guest_xml network_info=[{"id": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "address": "fa:16:3e:0a:af:87", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ff09c5-92", "ovs_interfaceid": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:42:47 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:42:47 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1638881149',display_name='tempest-AttachVolumeTestJSON-server-1638881149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1638881149',id=31,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9vdovZQPOEjNzeCnnWz+GhaHsq8urPdGpsEcNLsf39j/emMV+n/4wUOFOewsBXR/WZMO1qPgagjHOBw1F9a1GgtrgvdD8i+OZsciZp0+H9SvqPDzr10p3WRdDc5EYAAw==',key_name='tempest-keypair-1075059070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a0ca8eb58644e058b2019a4faa41a46',ramdisk_id='',reservation_id='r-fni6hndl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2004678694',owner_user_name='tempest-AttachVolumeTestJSON-2004678694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:42:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98ee9bd3b604b39a3f6013a40398642',uuid=044e4031-8381-4e7f-a5ac-1a074e00497e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "address": "fa:16:3e:0a:af:87", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ff09c5-92", "ovs_interfaceid": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converting VIF {"id": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "address": "fa:16:3e:0a:af:87", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ff09c5-92", "ovs_interfaceid": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:af:87,bridge_name='br-int',has_traffic_filtering=True,id=19ff09c5-922f-48bf-a8d2-16f60aa9780f,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ff09c5-92') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.objects.instance [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'pci_devices' on Instance uuid 044e4031-8381-4e7f-a5ac-1a074e00497e {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:42:47 user nova-compute[75672]:   <uuid>044e4031-8381-4e7f-a5ac-1a074e00497e</uuid>
Nov 30 12:42:47 user nova-compute[75672]:   <name>instance-0000001f</name>
Nov 30 12:42:47 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:42:47 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:42:47 user nova-compute[75672]:   <metadata>
Nov 30 12:42:47 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:42:47 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:42:47 user nova-compute[75672]:       <nova:name>tempest-AttachVolumeTestJSON-server-1638881149</nova:name>
Nov 30 12:42:47 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:42:47</nova:creationTime>
Nov 30 12:42:47 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:42:47 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:42:47 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:42:47 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:42:47 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:42:47 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:42:47 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:42:47 user nova-compute[75672]:       <nova:owner>
Nov 30 12:42:47 user nova-compute[75672]:         <nova:user uuid="e98ee9bd3b604b39a3f6013a40398642">tempest-AttachVolumeTestJSON-2004678694-project-member</nova:user>
Nov 30 12:42:47 user nova-compute[75672]:         <nova:project uuid="7a0ca8eb58644e058b2019a4faa41a46">tempest-AttachVolumeTestJSON-2004678694</nova:project>
Nov 30 12:42:47 user nova-compute[75672]:       </nova:owner>
Nov 30 12:42:47 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:42:47 user nova-compute[75672]:       <nova:ports>
Nov 30 12:42:47 user nova-compute[75672]:         <nova:port uuid="19ff09c5-922f-48bf-a8d2-16f60aa9780f">
Nov 30 12:42:47 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 12:42:47 user nova-compute[75672]:         </nova:port>
Nov 30 12:42:47 user nova-compute[75672]:       </nova:ports>
Nov 30 12:42:47 user nova-compute[75672]:     </nova:instance>
Nov 30 12:42:47 user nova-compute[75672]:   </metadata>
Nov 30 12:42:47 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:42:47 user nova-compute[75672]:     <system>
Nov 30 12:42:47 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:42:47 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:42:47 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:42:47 user nova-compute[75672]:       <entry name="serial">044e4031-8381-4e7f-a5ac-1a074e00497e</entry>
Nov 30 12:42:47 user nova-compute[75672]:       <entry name="uuid">044e4031-8381-4e7f-a5ac-1a074e00497e</entry>
Nov 30 12:42:47 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:42:47 user nova-compute[75672]:     </system>
Nov 30 12:42:47 user nova-compute[75672]:   </sysinfo>
Nov 30 12:42:47 user nova-compute[75672]:   <os>
Nov 30 12:42:47 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:42:47 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:42:47 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:42:47 user nova-compute[75672]:   </os>
Nov 30 12:42:47 user nova-compute[75672]:   <features>
Nov 30 12:42:47 user nova-compute[75672]:     <acpi/>
Nov 30 12:42:47 user nova-compute[75672]:     <apic/>
Nov 30 12:42:47 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:42:47 user nova-compute[75672]:   </features>
Nov 30 12:42:47 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:42:47 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:42:47 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:42:47 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:42:47 user nova-compute[75672]:   </clock>
Nov 30 12:42:47 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:42:47 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:42:47 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:42:47 user nova-compute[75672]:   </cpu>
Nov 30 12:42:47 user nova-compute[75672]:   <devices>
Nov 30 12:42:47 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:42:47 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:42:47 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk"/>
Nov 30 12:42:47 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:42:47 user nova-compute[75672]:     </disk>
Nov 30 12:42:47 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:42:47 user nova-compute[75672]:       <mac address="fa:16:3e:0a:af:87"/>
Nov 30 12:42:47 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:42:47 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:42:47 user nova-compute[75672]:       <target dev="tap19ff09c5-92"/>
Nov 30 12:42:47 user nova-compute[75672]:     </interface>
Nov 30 12:42:47 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:42:47 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/console.log" append="off"/>
Nov 30 12:42:47 user nova-compute[75672]:     </serial>
Nov 30 12:42:47 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:42:47 user nova-compute[75672]:     <video>
Nov 30 12:42:47 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:42:47 user nova-compute[75672]:     </video>
Nov 30 12:42:47 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:42:47 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:42:47 user nova-compute[75672]:     </rng>
Nov 30 12:42:47 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:42:47 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:42:47 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:42:47 user nova-compute[75672]:     </memballoon>
Nov 30 12:42:47 user nova-compute[75672]:   </devices>
Nov 30 12:42:47 user nova-compute[75672]: </domain>
Nov 30 12:42:47 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1638881149',display_name='tempest-AttachVolumeTestJSON-server-1638881149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1638881149',id=31,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9vdovZQPOEjNzeCnnWz+GhaHsq8urPdGpsEcNLsf39j/emMV+n/4wUOFOewsBXR/WZMO1qPgagjHOBw1F9a1GgtrgvdD8i+OZsciZp0+H9SvqPDzr10p3WRdDc5EYAAw==',key_name='tempest-keypair-1075059070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a0ca8eb58644e058b2019a4faa41a46',ramdisk_id='',reservation_id='r-fni6hndl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2004678694',owner_user_name='tempest-AttachVolumeTestJSON-2004678694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:42:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98ee9bd3b604b39a3f6013a40398642',uuid=044e4031-8381-4e7f-a5ac-1a074e00497e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "address": "fa:16:3e:0a:af:87", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ff09c5-92", "ovs_interfaceid": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converting VIF {"id": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "address": "fa:16:3e:0a:af:87", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ff09c5-92", "ovs_interfaceid": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:af:87,bridge_name='br-int',has_traffic_filtering=True,id=19ff09c5-922f-48bf-a8d2-16f60aa9780f,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ff09c5-92') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG os_vif [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:af:87,bridge_name='br-int',has_traffic_filtering=True,id=19ff09c5-922f-48bf-a8d2-16f60aa9780f,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ff09c5-92') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a8e9b13-ef9a-545c-932b-c24941386840', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19ff09c5-92, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19ff09c5-92, col_values=(('qos', UUID('929d3bf3-b8be-490d-abcb-21ab34f3d707')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19ff09c5-92, col_values=(('external_ids', {'iface-id': '19ff09c5-922f-48bf-a8d2-16f60aa9780f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:af:87', 'vm-uuid': '044e4031-8381-4e7f-a5ac-1a074e00497e'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:47 user nova-compute[75672]: INFO os_vif [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:af:87,bridge_name='br-int',has_traffic_filtering=True,id=19ff09c5-922f-48bf-a8d2-16f60aa9780f,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ff09c5-92')
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:42:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] No VIF found with MAC fa:16:3e:0a:af:87, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:42:48 user nova-compute[75672]: DEBUG nova.network.neutron [req-aea78b12-65cf-47e3-b6ab-7febfae7793d req-616277f9-3264-4132-ab17-47f701524d6f service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Updated VIF entry in instance network info cache for port 19ff09c5-922f-48bf-a8d2-16f60aa9780f. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:42:48 user nova-compute[75672]: DEBUG nova.network.neutron [req-aea78b12-65cf-47e3-b6ab-7febfae7793d req-616277f9-3264-4132-ab17-47f701524d6f service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Updating instance_info_cache with network_info: [{"id": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "address": "fa:16:3e:0a:af:87", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ff09c5-92", "ovs_interfaceid": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:42:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-aea78b12-65cf-47e3-b6ab-7febfae7793d req-616277f9-3264-4132-ab17-47f701524d6f service nova] Releasing lock "refresh_cache-044e4031-8381-4e7f-a5ac-1a074e00497e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:42:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-68567585-a8f1-4f61-946a-ff0be0f1e4da req-7d5d1750-04d6-4740-be04-d95aebc06ecd service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Received event network-vif-plugged-19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-68567585-a8f1-4f61-946a-ff0be0f1e4da req-7d5d1750-04d6-4740-be04-d95aebc06ecd service nova] Acquiring lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-68567585-a8f1-4f61-946a-ff0be0f1e4da req-7d5d1750-04d6-4740-be04-d95aebc06ecd service nova] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-68567585-a8f1-4f61-946a-ff0be0f1e4da req-7d5d1750-04d6-4740-be04-d95aebc06ecd service nova] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-68567585-a8f1-4f61-946a-ff0be0f1e4da req-7d5d1750-04d6-4740-be04-d95aebc06ecd service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] No waiting events found dispatching network-vif-plugged-19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:49 user nova-compute[75672]: WARNING nova.compute.manager [req-68567585-a8f1-4f61-946a-ff0be0f1e4da req-7d5d1750-04d6-4740-be04-d95aebc06ecd service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Received unexpected event network-vif-plugged-19ff09c5-922f-48bf-a8d2-16f60aa9780f for instance with vm_state building and task_state spawning.
Nov 30 12:42:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:42:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:42:51 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Instance spawned successfully.
Nov 30 12:42:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:42:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:51 user nova-compute[75672]: INFO nova.compute.manager [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 30 12:42:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:42:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-6bb898ad-391d-41a1-ba1c-208f0decc306 req-65b92e2e-0f34-4d7a-8a82-dc86f7636640 service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Received event network-vif-plugged-19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6bb898ad-391d-41a1-ba1c-208f0decc306 req-65b92e2e-0f34-4d7a-8a82-dc86f7636640 service nova] Acquiring lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6bb898ad-391d-41a1-ba1c-208f0decc306 req-65b92e2e-0f34-4d7a-8a82-dc86f7636640 service nova] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6bb898ad-391d-41a1-ba1c-208f0decc306 req-65b92e2e-0f34-4d7a-8a82-dc86f7636640 service nova] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-6bb898ad-391d-41a1-ba1c-208f0decc306 req-65b92e2e-0f34-4d7a-8a82-dc86f7636640 service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] No waiting events found dispatching network-vif-plugged-19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:51 user nova-compute[75672]: WARNING nova.compute.manager [req-6bb898ad-391d-41a1-ba1c-208f0decc306 req-65b92e2e-0f34-4d7a-8a82-dc86f7636640 service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Received unexpected event network-vif-plugged-19ff09c5-922f-48bf-a8d2-16f60aa9780f for instance with vm_state building and task_state spawning.
Nov 30 12:42:51 user nova-compute[75672]: INFO nova.compute.manager [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Took 8.15 seconds to build instance.
Nov 30 12:42:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-01fa8e73-0b6f-4b41-9452-77037e2437bf tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.754s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.compute.manager [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:42:53 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Creating image(s)
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Ensure instance console log exists: /opt/stack/data/nova/instances/e60dffb1-a1b9-48cd-85a0-edccc97ea849/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Start _get_guest_xml network_info=[{"id": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "address": "fa:16:3e:9c:77:f9", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0b2d72-14", "ovs_interfaceid": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-30T12:42:28Z,direct_url=<?>,disk_format='qcow2',id=1f536f0f-2a43-43ff-95cc-6885eefb7490,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-23284228',owner='513644b3a140400dbdf6b07e8e727dd4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-30T12:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd748ad1b-884c-4099-ab08-9c81be51995d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcVKAuiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e60dffb1-a1b9-48cd-85a0-edccc97ea849', 'attached_at': '', 'detached_at': '', 'volume_id': 'd53d17f4-532f-4592-a468-464f9dc8f1a7', 'serial': 'd53d17f4-532f-4592-a468-464f9dc8f1a7'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:42:53 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:42:53 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-30T12:42:28Z,direct_url=<?>,disk_format='qcow2',id=1f536f0f-2a43-43ff-95cc-6885eefb7490,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-23284228',owner='513644b3a140400dbdf6b07e8e727dd4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-30T12:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcVKAuiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:42:53 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:42:53 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:42:53 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[756b3f70-633b-41a1-bd0e-26448f3c7664]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:42:53 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f94bbb7-3b5d-4083-a0c5-43bb0fb309f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7] added
Nov 30 12:42:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb8b30c-e0e7-4d78-8ebf-96d47e5d2b6d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc453f7d-1524-427e-bdd4-9b0a9641b826]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XcVKAuiy {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XcVKAuiy" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edb1998-62b3-4029-bd15-f4661f3251f7]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XcVKAuiy'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b70b250-1d1d-4554-839d-82e1bf108500]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[901f6073-eba9-4fe5-b4a0-62011778e330]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:42:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:42:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[176e4f44-d7f1-4318-b8ec-0bada8572d31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7, portal: 172.16.0.220,3260]
Nov 30 12:42:53 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7, portal: 172.16.0.220,3260] successful.
Nov 30 12:42:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3115e1a-36bc-4bfc-bae3-81b995428a96]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd3d528-5ddb-4c67-a9f8-30a41571d58f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)
Nov 30 12:42:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:42:53 user nova-compute[75672]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)
Nov 30 12:42:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[367655a2-fa4a-482f-8164-da321b97411c]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:42:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcVKAuiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23033313438636233', 'path': '/dev/sdg'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033313438636233', 'path': '/dev/sdg'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1997438324',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1997438324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1997438324',id=30,image_ref='1f536f0f-2a43-43ff-95cc-6885eefb7490',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGIcArp84sKTUfIrgeplVoG2KmejLU7s1CUHPvNNJOEqhqmTneNwd5fvUkqUYQ95JEJxl8ib7cHcfnTR7zFAJdT6VoIhfZg7KC+QgJ1nTuhrR+9OGoCN5Xur0oovlMsqw==',key_name='tempest-keypair-2088837571',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-36n02407',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1743139468',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:42:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=e60dffb1-a1b9-48cd-85a0-edccc97ea849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "address": "fa:16:3e:9c:77:f9", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0b2d72-14", "ovs_interfaceid": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "address": "fa:16:3e:9c:77:f9", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0b2d72-14", "ovs_interfaceid": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:77:f9,bridge_name='br-int',has_traffic_filtering=True,id=8e0b2d72-1412-47d0-b759-4cdb0dadc5e9,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0b2d72-14') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG nova.objects.instance [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lazy-loading 'pci_devices' on Instance uuid e60dffb1-a1b9-48cd-85a0-edccc97ea849 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:42:54 user nova-compute[75672]:   <uuid>e60dffb1-a1b9-48cd-85a0-edccc97ea849</uuid>
Nov 30 12:42:54 user nova-compute[75672]:   <name>instance-0000001e</name>
Nov 30 12:42:54 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:42:54 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:42:54 user nova-compute[75672]:   <metadata>
Nov 30 12:42:54 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:42:54 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:42:54 user nova-compute[75672]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1997438324</nova:name>
Nov 30 12:42:54 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:42:53</nova:creationTime>
Nov 30 12:42:54 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:42:54 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:42:54 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:42:54 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:42:54 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:42:54 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:42:54 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:42:54 user nova-compute[75672]:       <nova:owner>
Nov 30 12:42:54 user nova-compute[75672]:         <nova:user uuid="924cf8ff73154f8fadb371175a0d8fc4">tempest-TestVolumeBootPattern-1743139468-project-member</nova:user>
Nov 30 12:42:54 user nova-compute[75672]:         <nova:project uuid="513644b3a140400dbdf6b07e8e727dd4">tempest-TestVolumeBootPattern-1743139468</nova:project>
Nov 30 12:42:54 user nova-compute[75672]:       </nova:owner>
Nov 30 12:42:54 user nova-compute[75672]:       <nova:root type="image" uuid="1f536f0f-2a43-43ff-95cc-6885eefb7490"/>
Nov 30 12:42:54 user nova-compute[75672]:       <nova:ports>
Nov 30 12:42:54 user nova-compute[75672]:         <nova:port uuid="8e0b2d72-1412-47d0-b759-4cdb0dadc5e9">
Nov 30 12:42:54 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 12:42:54 user nova-compute[75672]:         </nova:port>
Nov 30 12:42:54 user nova-compute[75672]:       </nova:ports>
Nov 30 12:42:54 user nova-compute[75672]:     </nova:instance>
Nov 30 12:42:54 user nova-compute[75672]:   </metadata>
Nov 30 12:42:54 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:42:54 user nova-compute[75672]:     <system>
Nov 30 12:42:54 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:42:54 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:42:54 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:42:54 user nova-compute[75672]:       <entry name="serial">e60dffb1-a1b9-48cd-85a0-edccc97ea849</entry>
Nov 30 12:42:54 user nova-compute[75672]:       <entry name="uuid">e60dffb1-a1b9-48cd-85a0-edccc97ea849</entry>
Nov 30 12:42:54 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:42:54 user nova-compute[75672]:     </system>
Nov 30 12:42:54 user nova-compute[75672]:   </sysinfo>
Nov 30 12:42:54 user nova-compute[75672]:   <os>
Nov 30 12:42:54 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:42:54 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:42:54 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:42:54 user nova-compute[75672]:   </os>
Nov 30 12:42:54 user nova-compute[75672]:   <features>
Nov 30 12:42:54 user nova-compute[75672]:     <acpi/>
Nov 30 12:42:54 user nova-compute[75672]:     <apic/>
Nov 30 12:42:54 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:42:54 user nova-compute[75672]:   </features>
Nov 30 12:42:54 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:42:54 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:42:54 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:42:54 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:42:54 user nova-compute[75672]:   </clock>
Nov 30 12:42:54 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:42:54 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:42:54 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:42:54 user nova-compute[75672]:   </cpu>
Nov 30 12:42:54 user nova-compute[75672]:   <devices>
Nov 30 12:42:54 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:42:54 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:42:54 user nova-compute[75672]:       <source dev="/dev/sdg"/>
Nov 30 12:42:54 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:42:54 user nova-compute[75672]:       <serial>d53d17f4-532f-4592-a468-464f9dc8f1a7</serial>
Nov 30 12:42:54 user nova-compute[75672]:     </disk>
Nov 30 12:42:54 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:42:54 user nova-compute[75672]:       <mac address="fa:16:3e:9c:77:f9"/>
Nov 30 12:42:54 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:42:54 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:42:54 user nova-compute[75672]:       <target dev="tap8e0b2d72-14"/>
Nov 30 12:42:54 user nova-compute[75672]:     </interface>
Nov 30 12:42:54 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:42:54 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/e60dffb1-a1b9-48cd-85a0-edccc97ea849/console.log" append="off"/>
Nov 30 12:42:54 user nova-compute[75672]:     </serial>
Nov 30 12:42:54 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:42:54 user nova-compute[75672]:     <video>
Nov 30 12:42:54 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:42:54 user nova-compute[75672]:     </video>
Nov 30 12:42:54 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:42:54 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:42:54 user nova-compute[75672]:     </rng>
Nov 30 12:42:54 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:42:54 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:42:54 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:42:54 user nova-compute[75672]:     </memballoon>
Nov 30 12:42:54 user nova-compute[75672]:   </devices>
Nov 30 12:42:54 user nova-compute[75672]: </domain>
Nov 30 12:42:54 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1997438324',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1997438324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1997438324',id=30,image_ref='1f536f0f-2a43-43ff-95cc-6885eefb7490',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGIcArp84sKTUfIrgeplVoG2KmejLU7s1CUHPvNNJOEqhqmTneNwd5fvUkqUYQ95JEJxl8ib7cHcfnTR7zFAJdT6VoIhfZg7KC+QgJ1nTuhrR+9OGoCN5Xur0oovlMsqw==',key_name='tempest-keypair-2088837571',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-36n02407',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1743139468',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:42:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=e60dffb1-a1b9-48cd-85a0-edccc97ea849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "address": "fa:16:3e:9c:77:f9", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0b2d72-14", "ovs_interfaceid": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "address": "fa:16:3e:9c:77:f9", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0b2d72-14", "ovs_interfaceid": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:77:f9,bridge_name='br-int',has_traffic_filtering=True,id=8e0b2d72-1412-47d0-b759-4cdb0dadc5e9,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0b2d72-14') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG os_vif [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:77:f9,bridge_name='br-int',has_traffic_filtering=True,id=8e0b2d72-1412-47d0-b759-4cdb0dadc5e9,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0b2d72-14') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '421b56d6-af2c-5328-8c91-b979a8276fb0', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e0b2d72-14, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e0b2d72-14, col_values=(('qos', UUID('a40b7828-7605-4028-9b8b-3b217b97c94d')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e0b2d72-14, col_values=(('external_ids', {'iface-id': '8e0b2d72-1412-47d0-b759-4cdb0dadc5e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:77:f9', 'vm-uuid': 'e60dffb1-a1b9-48cd-85a0-edccc97ea849'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:54 user nova-compute[75672]: INFO os_vif [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:77:f9,bridge_name='br-int',has_traffic_filtering=True,id=8e0b2d72-1412-47d0-b759-4cdb0dadc5e9,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0b2d72-14')
Nov 30 12:42:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:42:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] No VIF found with MAC fa:16:3e:9c:77:f9, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:42:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:42:56 user nova-compute[75672]: DEBUG nova.compute.manager [req-8c129a38-33f8-4641-93f4-196b4898a893 req-cbb71824-601b-4c94-8a60-be01299bbcd0 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Received event network-vif-plugged-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8c129a38-33f8-4641-93f4-196b4898a893 req-cbb71824-601b-4c94-8a60-be01299bbcd0 service nova] Acquiring lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8c129a38-33f8-4641-93f4-196b4898a893 req-cbb71824-601b-4c94-8a60-be01299bbcd0 service nova] Lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8c129a38-33f8-4641-93f4-196b4898a893 req-cbb71824-601b-4c94-8a60-be01299bbcd0 service nova] Lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:56 user nova-compute[75672]: DEBUG nova.compute.manager [req-8c129a38-33f8-4641-93f4-196b4898a893 req-cbb71824-601b-4c94-8a60-be01299bbcd0 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] No waiting events found dispatching network-vif-plugged-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:56 user nova-compute[75672]: WARNING nova.compute.manager [req-8c129a38-33f8-4641-93f4-196b4898a893 req-cbb71824-601b-4c94-8a60-be01299bbcd0 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Received unexpected event network-vif-plugged-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 for instance with vm_state building and task_state spawning.
Nov 30 12:42:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:42:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:42:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Instance spawned successfully.
Nov 30 12:42:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:42:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:42:58 user nova-compute[75672]: INFO nova.compute.manager [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 30 12:42:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:42:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-b97c6133-2bdb-46f1-9688-d609dccc01ca req-32653638-f786-4cb3-8536-6e0c135ec711 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Received event network-vif-plugged-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:42:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b97c6133-2bdb-46f1-9688-d609dccc01ca req-32653638-f786-4cb3-8536-6e0c135ec711 service nova] Acquiring lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:42:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b97c6133-2bdb-46f1-9688-d609dccc01ca req-32653638-f786-4cb3-8536-6e0c135ec711 service nova] Lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:42:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b97c6133-2bdb-46f1-9688-d609dccc01ca req-32653638-f786-4cb3-8536-6e0c135ec711 service nova] Lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-b97c6133-2bdb-46f1-9688-d609dccc01ca req-32653638-f786-4cb3-8536-6e0c135ec711 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] No waiting events found dispatching network-vif-plugged-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:42:58 user nova-compute[75672]: WARNING nova.compute.manager [req-b97c6133-2bdb-46f1-9688-d609dccc01ca req-32653638-f786-4cb3-8536-6e0c135ec711 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Received unexpected event network-vif-plugged-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 for instance with vm_state building and task_state spawning.
Nov 30 12:42:58 user nova-compute[75672]: INFO nova.compute.manager [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Took 23.67 seconds to build instance.
Nov 30 12:42:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-041dc35e-2eac-4de3-83ac-ae33e3465a15 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.854s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:42:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:13 user nova-compute[75672]: DEBUG nova.network.neutron [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Port 955b65e8-9d92-4ba6-a330-7ca8fd6433ca binding to destination host user is already ACTIVE {{(pid=75672) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 30 12:43:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:43:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquired lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:43:13 user nova-compute[75672]: DEBUG nova.network.neutron [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG nova.network.neutron [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updating instance_info_cache with network_info: [{"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Releasing lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Creating tmpfile /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/tmpbvq05ylu to verify with other compute node that the instance is on the same shared storage. {{(pid=75672) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-4909ff22-c450-40bc-ac41-8f91d9712dd6 req-c6457588-c931-4fd4-9eea-95304b2349aa service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-unplugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4909ff22-c450-40bc-ac41-8f91d9712dd6 req-c6457588-c931-4fd4-9eea-95304b2349aa service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4909ff22-c450-40bc-ac41-8f91d9712dd6 req-c6457588-c931-4fd4-9eea-95304b2349aa service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4909ff22-c450-40bc-ac41-8f91d9712dd6 req-c6457588-c931-4fd4-9eea-95304b2349aa service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-4909ff22-c450-40bc-ac41-8f91d9712dd6 req-c6457588-c931-4fd4-9eea-95304b2349aa service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-unplugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:43:14 user nova-compute[75672]: WARNING nova.compute.manager [req-4909ff22-c450-40bc-ac41-8f91d9712dd6 req-c6457588-c931-4fd4-9eea-95304b2349aa service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received unexpected event network-vif-unplugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with vm_state resized and task_state resize_reverting.
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:14 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Instance destroyed successfully.
Nov 30 12:43:14 user nova-compute[75672]: DEBUG nova.objects.instance [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lazy-loading 'resources' on Instance uuid 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-961439957',display_name='tempest-ServerActionsTestOtherB-server-961439957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-961439957',id=18,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9gzfXTAlw2XGf9HvtWm3alibDkZBaXqK6wU5D1XQgJAmyQFnvfR/7D9hAZOoFAhfgJYL3hqOw1f+3LmQPn02on/lNVBVazzydax1s8XfXwCPBkyn03q1zhUSD6eiHCpA==',key_name='tempest-keypair-1520780273',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:41:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69506305cadd4ab483ce9ee5e8da9625',ramdisk_id='',reservation_id='r-k234blik',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-372668652',owner_user_name='tempest-ServerActionsTestOtherB-372668652-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:41:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68b5a0c78cb840038a79b946d02562a6',uuid=8de0a3f4-abcb-4302-90ea-aea9b8b996f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converting VIF {"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG os_vif [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap955b65e8-9d, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e472c27d-5434-435c-ac33-c4b5ac26e29c) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:14 user nova-compute[75672]: INFO os_vif [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d')
Nov 30 12:43:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpPaXMlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:43:14 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:43:14 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f144e5f8-c45d-4e54-b325-53afd7b03d5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:43:14 user nova-compute[75672]: No targets found.
Nov 30 12:43:14 user nova-compute[75672]: iSNS:
Nov 30 12:43:14 user nova-compute[75672]: No targets found.
Nov 30 12:43:14 user nova-compute[75672]: STATIC:
Nov 30 12:43:14 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907
Nov 30 12:43:14 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:43:14 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:43:14 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b
Nov 30 12:43:14 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:43:14 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:43:14 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480
Nov 30 12:43:14 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:43:14 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:43:14 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d
Nov 30 12:43:14 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:43:14 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:43:14 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7
Nov 30 12:43:14 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:43:14 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:43:14 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff
Nov 30 12:43:14 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:43:14 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:43:14 user nova-compute[75672]: FIRMWARE:
Nov 30 12:43:14 user nova-compute[75672]: No targets found.
Nov 30 12:43:14 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:43:14 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:43:14 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1d95fb-863f-464c-8620-e9e66ee76aa5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:14 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b918d42-ada6-47bd-8079-d189e282da9b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:43:15 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:43:15 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:43:15 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:43:15 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:43:15 user nova-compute[75672]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)
Nov 30 12:43:15 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:43:15 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:43:15 user nova-compute[75672]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:43:15 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:43:15 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:43:15 user nova-compute[75672]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)
Nov 30 12:43:15 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcb4665b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2251477-08c8-47d8-94e0-e57cabcd8566]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28a1e75-5ad4-4a3f-b650-f05e58caa3b4]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[72503f01-a709-4cb2-adcd-39c5b4cc7fad]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[067aa792-2374-4bc8-8ca5-2a366b7d4bac]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb3ebf0-6d58-4550-a3bb-18818454d1d0]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc2be97-25e3-4fb9-a218-f1e501254f63]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260]
Nov 30 12:43:15 user nova-compute[75672]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260] successful.
Nov 30 12:43:15 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[de958819-03c8-4241-883f-d61613d648bd]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] <== disconnect_volume: return (309ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:43:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:43:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:43:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:43:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:16 user nova-compute[75672]: DEBUG nova.objects.instance [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lazy-loading 'migration_context' on Instance uuid 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:43:16 user nova-compute[75672]: DEBUG nova.objects.base [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Object Instance<8de0a3f4-abcb-4302-90ea-aea9b8b996f2> lazy-loaded attributes: resources,migration_context {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:43:16 user nova-compute[75672]: DEBUG nova.compute.manager [req-98103670-46ee-4428-a814-75a16fb77b21 req-31f199a7-ac6c-45d1-b1d4-d94df9a5dc3d service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:43:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-98103670-46ee-4428-a814-75a16fb77b21 req-31f199a7-ac6c-45d1-b1d4-d94df9a5dc3d service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:43:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-98103670-46ee-4428-a814-75a16fb77b21 req-31f199a7-ac6c-45d1-b1d4-d94df9a5dc3d service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:43:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-98103670-46ee-4428-a814-75a16fb77b21 req-31f199a7-ac6c-45d1-b1d4-d94df9a5dc3d service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:43:16 user nova-compute[75672]: DEBUG nova.compute.manager [req-98103670-46ee-4428-a814-75a16fb77b21 req-31f199a7-ac6c-45d1-b1d4-d94df9a5dc3d service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:43:16 user nova-compute[75672]: WARNING nova.compute.manager [req-98103670-46ee-4428-a814-75a16fb77b21 req-31f199a7-ac6c-45d1-b1d4-d94df9a5dc3d service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received unexpected event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with vm_state resized and task_state resize_reverting.
Nov 30 12:43:16 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:43:16 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:43:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.474s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:43:16 user nova-compute[75672]: INFO nova.compute.manager [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Swapping old allocation on dict_keys(['9d360ecf-be43-4c84-93ca-abc6f9902098']) held by migration f82dc564-73aa-4395-9cd3-fdcbe2a6e4f3 for instance
Nov 30 12:43:16 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Overwriting current allocation {'allocations': {'9d360ecf-be43-4c84-93ca-abc6f9902098': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 35}}, 'project_id': '69506305cadd4ab483ce9ee5e8da9625', 'user_id': '68b5a0c78cb840038a79b946d02562a6', 'consumer_generation': 1} on consumer 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 {{(pid=75672) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquired lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG nova.network.neutron [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG nova.network.neutron [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updating instance_info_cache with network_info: [{"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Releasing lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG os_brick.utils [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[780ed895-4d90-447a-99f8-366ebf86b73e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a48cea6-8f68-49fa-a664-2a613a78c39c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ebd798-b9c3-4c71-8184-12c3d003ee46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[292dfdcd-5c9a-4339-8cd6-b5054191ce08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:43:17 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:43:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[464144fd-48aa-4ca2-855e-b9dbfc02ff52]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:43:17 user nova-compute[75672]: DEBUG os_brick.utils [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:43:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Starting finish_revert_migration {{(pid=75672) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11813}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Start _get_guest_xml network_info=[{"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'f70efbda-dc86-4be4-818b-7ef12772225b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpPaXMlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8de0a3f4-abcb-4302-90ea-aea9b8b996f2', 'attached_at': '2023-11-30T12:43:27.000000', 'detached_at': '', 'volume_id': 'dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 'serial': 'dcc0c9fa-b1e3-4af4-bdda-830f8899be4b'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:43:27 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:43:27 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.objects.instance [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpPaXMlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:43:27 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:43:27 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:43:27 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec04d89-f159-4036-b55a-7a38f062a99d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:43:27 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9149fc7-56ed-4bb8-b9c0-81d70f3cdc21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b] added
Nov 30 12:43:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[488a5538-5100-430a-9deb-a04dddbee47d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[460febcf-083d-4ac6-ab95-58346e7c6791]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GpPaXMlx {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GpPaXMlx" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b47a5b-054a-46ea-859f-18937dccc5dc]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GpPaXMlx'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a56e58-a96d-4c53-afaf-1ef364774211]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c531b3-5b0f-42b8-8779-de2768e740d9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)
Nov 30 12:43:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)
Nov 30 12:43:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f477db-b9e0-4d75-92ba-ffb2d93151e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260]
Nov 30 12:43:27 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260] successful.
Nov 30 12:43:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bdedea-8a53-429d-afc4-b32a5b579036]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7616a0-94b0-4ec7-ba25-f74b954f6751]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:43:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)
Nov 30 12:43:27 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:43:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:43:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:43:28 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:43:28 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:43:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[39091f15-b8b3-4ae6-b2e5-6415af34a641]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:28 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:43:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpPaXMlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23335373663623661', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335373663623661', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-961439957',display_name='tempest-ServerActionsTestOtherB-server-961439957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-961439957',id=18,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9gzfXTAlw2XGf9HvtWm3alibDkZBaXqK6wU5D1XQgJAmyQFnvfR/7D9hAZOoFAhfgJYL3hqOw1f+3LmQPn02on/lNVBVazzydax1s8XfXwCPBkyn03q1zhUSD6eiHCpA==',key_name='tempest-keypair-1520780273',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:41:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69506305cadd4ab483ce9ee5e8da9625',ramdisk_id='',reservation_id='r-k234blik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-372668652',owner_user_name='tempest-ServerActionsTestOtherB-372668652-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68b5a0c78cb840038a79b946d02562a6',uuid=8de0a3f4-abcb-4302-90ea-aea9b8b996f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converting VIF {"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:43:29 user nova-compute[75672]:   <uuid>8de0a3f4-abcb-4302-90ea-aea9b8b996f2</uuid>
Nov 30 12:43:29 user nova-compute[75672]:   <name>instance-00000012</name>
Nov 30 12:43:29 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:43:29 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:43:29 user nova-compute[75672]:   <metadata>
Nov 30 12:43:29 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:43:29 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:43:29 user nova-compute[75672]:       <nova:name>tempest-ServerActionsTestOtherB-server-961439957</nova:name>
Nov 30 12:43:29 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:43:27</nova:creationTime>
Nov 30 12:43:29 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:43:29 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:43:29 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:43:29 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:43:29 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:43:29 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:43:29 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:43:29 user nova-compute[75672]:       <nova:owner>
Nov 30 12:43:29 user nova-compute[75672]:         <nova:user uuid="68b5a0c78cb840038a79b946d02562a6">tempest-ServerActionsTestOtherB-372668652-project-member</nova:user>
Nov 30 12:43:29 user nova-compute[75672]:         <nova:project uuid="69506305cadd4ab483ce9ee5e8da9625">tempest-ServerActionsTestOtherB-372668652</nova:project>
Nov 30 12:43:29 user nova-compute[75672]:       </nova:owner>
Nov 30 12:43:29 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:43:29 user nova-compute[75672]:       <nova:ports>
Nov 30 12:43:29 user nova-compute[75672]:         <nova:port uuid="955b65e8-9d92-4ba6-a330-7ca8fd6433ca">
Nov 30 12:43:29 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 12:43:29 user nova-compute[75672]:         </nova:port>
Nov 30 12:43:29 user nova-compute[75672]:       </nova:ports>
Nov 30 12:43:29 user nova-compute[75672]:     </nova:instance>
Nov 30 12:43:29 user nova-compute[75672]:   </metadata>
Nov 30 12:43:29 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:43:29 user nova-compute[75672]:     <system>
Nov 30 12:43:29 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:43:29 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:43:29 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:43:29 user nova-compute[75672]:       <entry name="serial">8de0a3f4-abcb-4302-90ea-aea9b8b996f2</entry>
Nov 30 12:43:29 user nova-compute[75672]:       <entry name="uuid">8de0a3f4-abcb-4302-90ea-aea9b8b996f2</entry>
Nov 30 12:43:29 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:43:29 user nova-compute[75672]:     </system>
Nov 30 12:43:29 user nova-compute[75672]:   </sysinfo>
Nov 30 12:43:29 user nova-compute[75672]:   <os>
Nov 30 12:43:29 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:43:29 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:43:29 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:43:29 user nova-compute[75672]:   </os>
Nov 30 12:43:29 user nova-compute[75672]:   <features>
Nov 30 12:43:29 user nova-compute[75672]:     <acpi/>
Nov 30 12:43:29 user nova-compute[75672]:     <apic/>
Nov 30 12:43:29 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:43:29 user nova-compute[75672]:   </features>
Nov 30 12:43:29 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:43:29 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:43:29 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:43:29 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:43:29 user nova-compute[75672]:   </clock>
Nov 30 12:43:29 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:43:29 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:43:29 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:43:29 user nova-compute[75672]:   </cpu>
Nov 30 12:43:29 user nova-compute[75672]:   <devices>
Nov 30 12:43:29 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:43:29 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:43:29 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk"/>
Nov 30 12:43:29 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:43:29 user nova-compute[75672]:     </disk>
Nov 30 12:43:29 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:43:29 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:43:29 user nova-compute[75672]:       <source dev="/dev/sdb"/>
Nov 30 12:43:29 user nova-compute[75672]:       <target dev="vdb" bus="virtio"/>
Nov 30 12:43:29 user nova-compute[75672]:       <serial>dcc0c9fa-b1e3-4af4-bdda-830f8899be4b</serial>
Nov 30 12:43:29 user nova-compute[75672]:     </disk>
Nov 30 12:43:29 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:43:29 user nova-compute[75672]:       <mac address="fa:16:3e:f3:03:0e"/>
Nov 30 12:43:29 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:43:29 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:43:29 user nova-compute[75672]:       <target dev="tap955b65e8-9d"/>
Nov 30 12:43:29 user nova-compute[75672]:     </interface>
Nov 30 12:43:29 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:43:29 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/console.log" append="off"/>
Nov 30 12:43:29 user nova-compute[75672]:     </serial>
Nov 30 12:43:29 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:43:29 user nova-compute[75672]:     <video>
Nov 30 12:43:29 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:43:29 user nova-compute[75672]:     </video>
Nov 30 12:43:29 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:43:29 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:43:29 user nova-compute[75672]:     </rng>
Nov 30 12:43:29 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:43:29 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:43:29 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:43:29 user nova-compute[75672]:     </memballoon>
Nov 30 12:43:29 user nova-compute[75672]:   </devices>
Nov 30 12:43:29 user nova-compute[75672]: </domain>
Nov 30 12:43:29 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-961439957',display_name='tempest-ServerActionsTestOtherB-server-961439957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-961439957',id=18,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9gzfXTAlw2XGf9HvtWm3alibDkZBaXqK6wU5D1XQgJAmyQFnvfR/7D9hAZOoFAhfgJYL3hqOw1f+3LmQPn02on/lNVBVazzydax1s8XfXwCPBkyn03q1zhUSD6eiHCpA==',key_name='tempest-keypair-1520780273',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:41:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69506305cadd4ab483ce9ee5e8da9625',ramdisk_id='',reservation_id='r-k234blik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-372668652',owner_user_name='tempest-ServerActionsTestOtherB-372668652-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68b5a0c78cb840038a79b946d02562a6',uuid=8de0a3f4-abcb-4302-90ea-aea9b8b996f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converting VIF {"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG os_vif [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0f18934-5ac0-5905-b2ef-d84d01513dca', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap955b65e8-9d, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap955b65e8-9d, col_values=(('qos', UUID('f62005ad-c546-4626-bfe0-1dad03832646')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap955b65e8-9d, col_values=(('external_ids', {'iface-id': '955b65e8-9d92-4ba6-a330-7ca8fd6433ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:03:0e', 'vm-uuid': '8de0a3f4-abcb-4302-90ea-aea9b8b996f2'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:43:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:29 user nova-compute[75672]: INFO os_vif [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d')
Nov 30 12:43:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:30 user nova-compute[75672]: DEBUG nova.compute.manager [req-8094305c-9a28-47c9-95fc-c2b6c34a3007 req-a935e445-9293-4034-a4e3-1d7d81fa5b9e service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:43:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8094305c-9a28-47c9-95fc-c2b6c34a3007 req-a935e445-9293-4034-a4e3-1d7d81fa5b9e service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:43:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8094305c-9a28-47c9-95fc-c2b6c34a3007 req-a935e445-9293-4034-a4e3-1d7d81fa5b9e service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:43:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8094305c-9a28-47c9-95fc-c2b6c34a3007 req-a935e445-9293-4034-a4e3-1d7d81fa5b9e service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:43:30 user nova-compute[75672]: DEBUG nova.compute.manager [req-8094305c-9a28-47c9-95fc-c2b6c34a3007 req-a935e445-9293-4034-a4e3-1d7d81fa5b9e service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:43:30 user nova-compute[75672]: WARNING nova.compute.manager [req-8094305c-9a28-47c9-95fc-c2b6c34a3007 req-a935e445-9293-4034-a4e3-1d7d81fa5b9e service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received unexpected event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with vm_state resized and task_state resize_reverting.
Nov 30 12:43:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:32 user nova-compute[75672]: DEBUG nova.compute.manager [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:43:32 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Instance running successfully.
Nov 30 12:43:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] finish_revert_migration finished successfully. {{(pid=75672) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11857}}
Nov 30 12:43:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-2ae7f580-d5ae-4693-bb64-6d58ccd5babf req-68b1b65a-183c-4c32-bd08-2d64710d509c service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:43:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2ae7f580-d5ae-4693-bb64-6d58ccd5babf req-68b1b65a-183c-4c32-bd08-2d64710d509c service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:43:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2ae7f580-d5ae-4693-bb64-6d58ccd5babf req-68b1b65a-183c-4c32-bd08-2d64710d509c service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:43:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2ae7f580-d5ae-4693-bb64-6d58ccd5babf req-68b1b65a-183c-4c32-bd08-2d64710d509c service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:43:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-2ae7f580-d5ae-4693-bb64-6d58ccd5babf req-68b1b65a-183c-4c32-bd08-2d64710d509c service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:43:32 user nova-compute[75672]: WARNING nova.compute.manager [req-2ae7f580-d5ae-4693-bb64-6d58ccd5babf req-68b1b65a-183c-4c32-bd08-2d64710d509c service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received unexpected event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with vm_state resized and task_state resize_reverting.
Nov 30 12:43:32 user nova-compute[75672]: INFO nova.compute.manager [None req-52e0192a-3a3c-46bf-98d1-c6614ab9a51b tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updating instance to original state: 'active'
Nov 30 12:43:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "f5851479-d09b-4d84-9553-2b09646f2b4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:43:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:43:35 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:43:35 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:43:35 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:43:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:43:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:43:35 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:43:35 user nova-compute[75672]: INFO nova.compute.claims [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Claim successful on node user
Nov 30 12:43:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:43:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:43:35 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updating instance_info_cache with network_info: [{"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-8de0a3f4-abcb-4302-90ea-aea9b8b996f2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:43:36 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:43:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:43:36 user nova-compute[75672]: INFO nova.virt.block_device [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Booting with volume 83a735a8-128e-4328-826b-f8450f2b4016 at /dev/vda
Nov 30 12:43:36 user nova-compute[75672]: DEBUG nova.policy [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15791a052aef4d7a9bc79c97075cbdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51606113e3d1460894fdc500924cb37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG os_brick.utils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39597c1-e12a-4b8c-a167-e769bbd3bee8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9fc50e-4161-4444-88e0-aa61a73ad1f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae2c4be-d3dd-4142-8381-9f96d532dfa9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bb56d7-03ce-4ae6-b0c5-44333e19fa3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:43:36 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:43:36 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bcc2db-8c85-4d5e-b537-7b8836b93c35]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG os_brick.utils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Updating existing volume attachment record: bd6683dd-88a5-4eac-93c1-989aaa3b2025 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:43:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:37 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Successfully created port: 84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Successfully updated port: 84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquired lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-50589220-64bb-4ffc-ad05-9f08aa1ba87e req-7372042e-3310-445e-ba6d-4a3536f7577a service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received event network-changed-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-50589220-64bb-4ffc-ad05-9f08aa1ba87e req-7372042e-3310-445e-ba6d-4a3536f7577a service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Refreshing instance network info cache due to event network-changed-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-50589220-64bb-4ffc-ad05-9f08aa1ba87e req-7372042e-3310-445e-ba6d-4a3536f7577a service nova] Acquiring lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Updating instance_info_cache with network_info: [{"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Releasing lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Instance network_info: |[{"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-50589220-64bb-4ffc-ad05-9f08aa1ba87e req-7372042e-3310-445e-ba6d-4a3536f7577a service nova] Acquired lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG nova.network.neutron [req-50589220-64bb-4ffc-ad05-9f08aa1ba87e req-7372042e-3310-445e-ba6d-4a3536f7577a service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Refreshing network info cache for port 84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG nova.network.neutron [req-50589220-64bb-4ffc-ad05-9f08aa1ba87e req-7372042e-3310-445e-ba6d-4a3536f7577a service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Updated VIF entry in instance network info cache for port 84c0b4e1-0414-45cb-a9db-88d4aa5bbf03. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG nova.network.neutron [req-50589220-64bb-4ffc-ad05-9f08aa1ba87e req-7372042e-3310-445e-ba6d-4a3536f7577a service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Updating instance_info_cache with network_info: [{"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-50589220-64bb-4ffc-ad05-9f08aa1ba87e req-7372042e-3310-445e-ba6d-4a3536f7577a service nova] Releasing lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:43:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:43:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:43:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:43:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:43:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:43:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:44 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:43:44 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=6689MB free_disk=25.129066467285156GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 874354b8-bf12-44d6-86f8-0db17ce28faa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance b06bea0f-9186-4ab8-8bad-588beb48a1f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 0a41ad0b-978b-4931-a30c-573e20f166a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 9ae3632c-e9ad-4bef-9ed9-5571d054b06e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance e60dffb1-a1b9-48cd-85a0-edccc97ea849 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 044e4031-8381-4e7f-a5ac-1a074e00497e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f5851479-d09b-4d84-9553-2b09646f2b4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:43:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:43:46 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Creating image(s)
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Ensure instance console log exists: /opt/stack/data/nova/instances/f5851479-d09b-4d84-9553-2b09646f2b4f/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Start _get_guest_xml network_info=[{"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'bd6683dd-88a5-4eac-93c1-989aaa3b2025', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNqFmylf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5851479-d09b-4d84-9553-2b09646f2b4f', 'attached_at': '', 'detached_at': '', 'volume_id': '83a735a8-128e-4328-826b-f8450f2b4016', 'serial': '83a735a8-128e-4328-826b-f8450f2b4016'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:43:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:43:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNqFmylf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:43:46 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:43:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:43:46 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:43:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:43:46 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:43:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8d2c64-9dbd-4a94-aba1-45e4f46761fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:43:46 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc44473-fa48-4495-9a1c-e4cd5fc2d432]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016] added
Nov 30 12:43:47 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2e3aef-6a29-4d9b-b323-f2c0373ab13a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4e87c1-d602-41d9-b8fe-c98b5d41a26a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNqFmylf {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNqFmylf" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35aae28-1c5f-476c-8e66-3e90f0ef99e0]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wNqFmylf'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ac6046-2273-4209-8879-90e428af1b4b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fcb1fe-7e49-4bbc-a22f-5aa9fafcdc8d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:43:47 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:43:47 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee5a01d-00b5-4611-9495-d3d03fd138df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260]
Nov 30 12:43:47 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260] successful.
Nov 30 12:43:47 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0723eb-a404-48e7-aa90-6a13aab57f99]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff06082-f543-4d22-95c5-b8e0a16e4922]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:43:47 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:43:47 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:43:47 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] HCTL ('39', '-', '-', 0) found on session 35 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7596d9-ae3e-4762-8eb9-66d87884fc51]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Searching for a device in session 35 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:43:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNqFmylf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23436393036366633', 'path': '/dev/sdh'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436393036366633', 'path': '/dev/sdh'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:43:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-580359070',display_name='tempest-ServerActionsTestOtherA-server-580359070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-580359070',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAGYYp9gmKcKQU/0AhKXIKN1vmmULr4112gYCMQNfGJmVLFUNJpr/fRLeXt2uFTxy9c+sqp7OE8Rgl3bMk88M8K66f/jnDNBbOBQMv+K2V48Kq8w3CudXAVm+CT4wTJ5Q==',key_name='tempest-keypair-1875335252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-ekoofs5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:43:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=f5851479-d09b-4d84-9553-2b09646f2b4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:6a,bridge_name='br-int',has_traffic_filtering=True,id=84c0b4e1-0414-45cb-a9db-88d4aa5bbf03,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c0b4e1-04') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG nova.objects.instance [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lazy-loading 'pci_devices' on Instance uuid f5851479-d09b-4d84-9553-2b09646f2b4f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:43:48 user nova-compute[75672]:   <uuid>f5851479-d09b-4d84-9553-2b09646f2b4f</uuid>
Nov 30 12:43:48 user nova-compute[75672]:   <name>instance-00000020</name>
Nov 30 12:43:48 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:43:48 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:43:48 user nova-compute[75672]:   <metadata>
Nov 30 12:43:48 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:43:48 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:43:48 user nova-compute[75672]:       <nova:name>tempest-ServerActionsTestOtherA-server-580359070</nova:name>
Nov 30 12:43:48 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:43:46</nova:creationTime>
Nov 30 12:43:48 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:43:48 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:43:48 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:43:48 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:43:48 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:43:48 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:43:48 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:43:48 user nova-compute[75672]:       <nova:owner>
Nov 30 12:43:48 user nova-compute[75672]:         <nova:user uuid="15791a052aef4d7a9bc79c97075cbdc9">tempest-ServerActionsTestOtherA-2076465849-project-member</nova:user>
Nov 30 12:43:48 user nova-compute[75672]:         <nova:project uuid="51606113e3d1460894fdc500924cb37a">tempest-ServerActionsTestOtherA-2076465849</nova:project>
Nov 30 12:43:48 user nova-compute[75672]:       </nova:owner>
Nov 30 12:43:48 user nova-compute[75672]:       <nova:ports>
Nov 30 12:43:48 user nova-compute[75672]:         <nova:port uuid="84c0b4e1-0414-45cb-a9db-88d4aa5bbf03">
Nov 30 12:43:48 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 12:43:48 user nova-compute[75672]:         </nova:port>
Nov 30 12:43:48 user nova-compute[75672]:       </nova:ports>
Nov 30 12:43:48 user nova-compute[75672]:     </nova:instance>
Nov 30 12:43:48 user nova-compute[75672]:   </metadata>
Nov 30 12:43:48 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:43:48 user nova-compute[75672]:     <system>
Nov 30 12:43:48 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:43:48 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:43:48 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:43:48 user nova-compute[75672]:       <entry name="serial">f5851479-d09b-4d84-9553-2b09646f2b4f</entry>
Nov 30 12:43:48 user nova-compute[75672]:       <entry name="uuid">f5851479-d09b-4d84-9553-2b09646f2b4f</entry>
Nov 30 12:43:48 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:43:48 user nova-compute[75672]:     </system>
Nov 30 12:43:48 user nova-compute[75672]:   </sysinfo>
Nov 30 12:43:48 user nova-compute[75672]:   <os>
Nov 30 12:43:48 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:43:48 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:43:48 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:43:48 user nova-compute[75672]:   </os>
Nov 30 12:43:48 user nova-compute[75672]:   <features>
Nov 30 12:43:48 user nova-compute[75672]:     <acpi/>
Nov 30 12:43:48 user nova-compute[75672]:     <apic/>
Nov 30 12:43:48 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:43:48 user nova-compute[75672]:   </features>
Nov 30 12:43:48 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:43:48 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:43:48 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:43:48 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:43:48 user nova-compute[75672]:   </clock>
Nov 30 12:43:48 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:43:48 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:43:48 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:43:48 user nova-compute[75672]:   </cpu>
Nov 30 12:43:48 user nova-compute[75672]:   <devices>
Nov 30 12:43:48 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:43:48 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:43:48 user nova-compute[75672]:       <source dev="/dev/sdh"/>
Nov 30 12:43:48 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:43:48 user nova-compute[75672]:       <serial>83a735a8-128e-4328-826b-f8450f2b4016</serial>
Nov 30 12:43:48 user nova-compute[75672]:     </disk>
Nov 30 12:43:48 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:43:48 user nova-compute[75672]:       <mac address="fa:16:3e:c1:fb:6a"/>
Nov 30 12:43:48 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:43:48 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:43:48 user nova-compute[75672]:       <target dev="tap84c0b4e1-04"/>
Nov 30 12:43:48 user nova-compute[75672]:     </interface>
Nov 30 12:43:48 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:43:48 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/f5851479-d09b-4d84-9553-2b09646f2b4f/console.log" append="off"/>
Nov 30 12:43:48 user nova-compute[75672]:     </serial>
Nov 30 12:43:48 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:43:48 user nova-compute[75672]:     <video>
Nov 30 12:43:48 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:43:48 user nova-compute[75672]:     </video>
Nov 30 12:43:48 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:43:48 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:43:48 user nova-compute[75672]:     </rng>
Nov 30 12:43:48 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:43:48 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:43:48 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:43:48 user nova-compute[75672]:     </memballoon>
Nov 30 12:43:48 user nova-compute[75672]:   </devices>
Nov 30 12:43:48 user nova-compute[75672]: </domain>
Nov 30 12:43:48 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:43:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-580359070',display_name='tempest-ServerActionsTestOtherA-server-580359070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-580359070',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAGYYp9gmKcKQU/0AhKXIKN1vmmULr4112gYCMQNfGJmVLFUNJpr/fRLeXt2uFTxy9c+sqp7OE8Rgl3bMk88M8K66f/jnDNBbOBQMv+K2V48Kq8w3CudXAVm+CT4wTJ5Q==',key_name='tempest-keypair-1875335252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-ekoofs5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:43:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=f5851479-d09b-4d84-9553-2b09646f2b4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:6a,bridge_name='br-int',has_traffic_filtering=True,id=84c0b4e1-0414-45cb-a9db-88d4aa5bbf03,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c0b4e1-04') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG os_vif [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:6a,bridge_name='br-int',has_traffic_filtering=True,id=84c0b4e1-0414-45cb-a9db-88d4aa5bbf03,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c0b4e1-04') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0df88f6e-df79-59ea-bb2b-ce0ed744aaed', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84c0b4e1-04, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84c0b4e1-04, col_values=(('qos', UUID('5d2c9230-8323-47c2-80a9-d8f2a9de1501')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84c0b4e1-04, col_values=(('external_ids', {'iface-id': '84c0b4e1-0414-45cb-a9db-88d4aa5bbf03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:fb:6a', 'vm-uuid': 'f5851479-d09b-4d84-9553-2b09646f2b4f'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:48 user nova-compute[75672]: INFO os_vif [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:6a,bridge_name='br-int',has_traffic_filtering=True,id=84c0b4e1-0414-45cb-a9db-88d4aa5bbf03,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c0b4e1-04')
Nov 30 12:43:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] No VIF found with MAC fa:16:3e:c1:fb:6a, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:43:48 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:43:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-62650f83-8935-4716-a100-632d5c037434 req-ef2802ff-0dcd-402e-ad2f-bcbb99d9db8c service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received event network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:43:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-62650f83-8935-4716-a100-632d5c037434 req-ef2802ff-0dcd-402e-ad2f-bcbb99d9db8c service nova] Acquiring lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:43:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-62650f83-8935-4716-a100-632d5c037434 req-ef2802ff-0dcd-402e-ad2f-bcbb99d9db8c service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:43:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-62650f83-8935-4716-a100-632d5c037434 req-ef2802ff-0dcd-402e-ad2f-bcbb99d9db8c service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:43:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-62650f83-8935-4716-a100-632d5c037434 req-ef2802ff-0dcd-402e-ad2f-bcbb99d9db8c service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] No waiting events found dispatching network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:43:49 user nova-compute[75672]: WARNING nova.compute.manager [req-62650f83-8935-4716-a100-632d5c037434 req-ef2802ff-0dcd-402e-ad2f-bcbb99d9db8c service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received unexpected event network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 for instance with vm_state building and task_state spawning.
Nov 30 12:43:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:43:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:43:51 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Instance spawned successfully.
Nov 30 12:43:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:43:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:43:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:43:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:43:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:43:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:43:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:43:51 user nova-compute[75672]: INFO nova.compute.manager [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 30 12:43:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:43:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-e555c246-0acb-49aa-92d8-3f419e9a03cc req-49da02c8-6686-4a30-944c-b4138fe2ca37 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received event network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:43:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e555c246-0acb-49aa-92d8-3f419e9a03cc req-49da02c8-6686-4a30-944c-b4138fe2ca37 service nova] Acquiring lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:43:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e555c246-0acb-49aa-92d8-3f419e9a03cc req-49da02c8-6686-4a30-944c-b4138fe2ca37 service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:43:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e555c246-0acb-49aa-92d8-3f419e9a03cc req-49da02c8-6686-4a30-944c-b4138fe2ca37 service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:43:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-e555c246-0acb-49aa-92d8-3f419e9a03cc req-49da02c8-6686-4a30-944c-b4138fe2ca37 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] No waiting events found dispatching network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:43:51 user nova-compute[75672]: WARNING nova.compute.manager [req-e555c246-0acb-49aa-92d8-3f419e9a03cc req-49da02c8-6686-4a30-944c-b4138fe2ca37 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received unexpected event network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 for instance with vm_state building and task_state spawning.
Nov 30 12:43:51 user nova-compute[75672]: INFO nova.compute.manager [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Took 16.45 seconds to build instance.
Nov 30 12:43:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dddc88e4-488d-4784-b1ce-f2122358fd9d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.543s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:43:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:43:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:06 user nova-compute[75672]: DEBUG nova.compute.manager [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:44:06 user nova-compute[75672]: INFO nova.compute.manager [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] instance snapshotting
Nov 30 12:44:06 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Beginning live snapshot process
Nov 30 12:44:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json -f qcow2 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json -f qcow2 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.167s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnju2dpk5/6b1e4d7ff05d403e8a470a78f4eceff2.delta 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnju2dpk5/6b1e4d7ff05d403e8a470a78f4eceff2.delta 1073741824" returned: 0 in 0.047s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:07 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 12:44:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:44:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:44:08 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 12:44:08 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:44:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnju2dpk5/6b1e4d7ff05d403e8a470a78f4eceff2.delta /opt/stack/data/nova/instances/snapshots/tmpnju2dpk5/6b1e4d7ff05d403e8a470a78f4eceff2 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnju2dpk5/6b1e4d7ff05d403e8a470a78f4eceff2.delta /opt/stack/data/nova/instances/snapshots/tmpnju2dpk5/6b1e4d7ff05d403e8a470a78f4eceff2" returned: 0 in 0.598s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:09 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Snapshot extracted, beginning image upload
Nov 30 12:44:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:10 user nova-compute[75672]: INFO nova.compute.manager [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Detaching volume 88d337fb-25c6-4aea-a867-147aaa39c907
Nov 30 12:44:10 user nova-compute[75672]: INFO nova.virt.block_device [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Attempting to driver detach volume 88d337fb-25c6-4aea-a867-147aaa39c907 from mountpoint /dev/vdb
Nov 30 12:44:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Attempting to detach device vdb from instance 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:44:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:44:10 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:44:10 user nova-compute[75672]:   <source dev="/dev/sdf"/>
Nov 30 12:44:10 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:44:10 user nova-compute[75672]:   <serial>88d337fb-25c6-4aea-a867-147aaa39c907</serial>
Nov 30 12:44:10 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:44:10 user nova-compute[75672]: </disk>
Nov 30 12:44:10 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:44:10 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Successfully detached device vdb from instance 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 from the persistent domain config.
Nov 30 12:44:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:44:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:44:10 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:44:10 user nova-compute[75672]:   <source dev="/dev/sdf"/>
Nov 30 12:44:10 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:44:10 user nova-compute[75672]:   <serial>88d337fb-25c6-4aea-a867-147aaa39c907</serial>
Nov 30 12:44:10 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:44:10 user nova-compute[75672]: </disk>
Nov 30 12:44:10 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:44:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:44:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:11 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Snapshot image upload complete
Nov 30 12:44:11 user nova-compute[75672]: INFO nova.compute.manager [None req-265d6de3-632a-4d02-9bdf-f71b6d875b09 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Took 5.21 seconds to snapshot the instance on the hypervisor.
Nov 30 12:44:12 user nova-compute[75672]: INFO nova.compute.manager [None req-5fc20449-eac5-4ef7-8b61-d46e332f6234 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Unrescuing
Nov 30 12:44:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5fc20449-eac5-4ef7-8b61-d46e332f6234 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:44:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5fc20449-eac5-4ef7-8b61-d46e332f6234 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquired lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:44:12 user nova-compute[75672]: DEBUG nova.network.neutron [None req-5fc20449-eac5-4ef7-8b61-d46e332f6234 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG nova.network.neutron [None req-5fc20449-eac5-4ef7-8b61-d46e332f6234 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Updating instance_info_cache with network_info: [{"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5fc20449-eac5-4ef7-8b61-d46e332f6234 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Releasing lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG nova.objects.instance [None req-5fc20449-eac5-4ef7-8b61-d46e332f6234 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'flavor' on Instance uuid b06bea0f-9186-4ab8-8bad-588beb48a1f1 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-dd9d9b2e-5c81-4a95-a371-e5d3a7789888 req-0dde1c26-f849-4905-9fe7-aa601cc9a8ad service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-unplugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dd9d9b2e-5c81-4a95-a371-e5d3a7789888 req-0dde1c26-f849-4905-9fe7-aa601cc9a8ad service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dd9d9b2e-5c81-4a95-a371-e5d3a7789888 req-0dde1c26-f849-4905-9fe7-aa601cc9a8ad service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dd9d9b2e-5c81-4a95-a371-e5d3a7789888 req-0dde1c26-f849-4905-9fe7-aa601cc9a8ad service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-dd9d9b2e-5c81-4a95-a371-e5d3a7789888 req-0dde1c26-f849-4905-9fe7-aa601cc9a8ad service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-unplugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:44:13 user nova-compute[75672]: WARNING nova.compute.manager [req-dd9d9b2e-5c81-4a95-a371-e5d3a7789888 req-0dde1c26-f849-4905-9fe7-aa601cc9a8ad service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received unexpected event network-vif-unplugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:44:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:13 user nova-compute[75672]: INFO nova.compute.manager [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Terminating instance
Nov 30 12:44:13 user nova-compute[75672]: DEBUG nova.compute.manager [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:44:13 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Instance destroyed successfully.
Nov 30 12:44:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-e5cf992a-9fbe-47b6-8afe-5a0b17a8e94f req-51de34da-6e05-43ce-9cef-07f83336f8e6 service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Received event network-vif-unplugged-3bb61b8e-0d6f-41e2-b5d2-047514910e00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e5cf992a-9fbe-47b6-8afe-5a0b17a8e94f req-51de34da-6e05-43ce-9cef-07f83336f8e6 service nova] Acquiring lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e5cf992a-9fbe-47b6-8afe-5a0b17a8e94f req-51de34da-6e05-43ce-9cef-07f83336f8e6 service nova] Lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e5cf992a-9fbe-47b6-8afe-5a0b17a8e94f req-51de34da-6e05-43ce-9cef-07f83336f8e6 service nova] Lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-e5cf992a-9fbe-47b6-8afe-5a0b17a8e94f req-51de34da-6e05-43ce-9cef-07f83336f8e6 service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] No waiting events found dispatching network-vif-unplugged-3bb61b8e-0d6f-41e2-b5d2-047514910e00 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-e5cf992a-9fbe-47b6-8afe-5a0b17a8e94f req-51de34da-6e05-43ce-9cef-07f83336f8e6 service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Received event network-vif-unplugged-3bb61b8e-0d6f-41e2-b5d2-047514910e00 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-00b05c98-8d4d-4770-98ee-3f515dcf91b3 req-a654e541-acc0-4fc4-bc9c-3bc8081a73a5 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Received event network-changed-c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-00b05c98-8d4d-4770-98ee-3f515dcf91b3 req-a654e541-acc0-4fc4-bc9c-3bc8081a73a5 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Refreshing instance network info cache due to event network-changed-c3804f22-1bd2-4813-bf7b-dd6d372f199e. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-00b05c98-8d4d-4770-98ee-3f515dcf91b3 req-a654e541-acc0-4fc4-bc9c-3bc8081a73a5 service nova] Acquiring lock "refresh_cache-9ae3632c-e9ad-4bef-9ed9-5571d054b06e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-00b05c98-8d4d-4770-98ee-3f515dcf91b3 req-a654e541-acc0-4fc4-bc9c-3bc8081a73a5 service nova] Acquired lock "refresh_cache-9ae3632c-e9ad-4bef-9ed9-5571d054b06e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG nova.network.neutron [req-00b05c98-8d4d-4770-98ee-3f515dcf91b3 req-a654e541-acc0-4fc4-bc9c-3bc8081a73a5 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Refreshing network info cache for port c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG nova.network.neutron [req-00b05c98-8d4d-4770-98ee-3f515dcf91b3 req-a654e541-acc0-4fc4-bc9c-3bc8081a73a5 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Updated VIF entry in instance network info cache for port c3804f22-1bd2-4813-bf7b-dd6d372f199e. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG nova.network.neutron [req-00b05c98-8d4d-4770-98ee-3f515dcf91b3 req-a654e541-acc0-4fc4-bc9c-3bc8081a73a5 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Updating instance_info_cache with network_info: [{"id": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "address": "fa:16:3e:8a:e2:85", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3804f22-1b", "ovs_interfaceid": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-00b05c98-8d4d-4770-98ee-3f515dcf91b3 req-a654e541-acc0-4fc4-bc9c-3bc8081a73a5 service nova] Releasing lock "refresh_cache-9ae3632c-e9ad-4bef-9ed9-5571d054b06e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:44:14 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Instance destroyed successfully.
Nov 30 12:44:14 user nova-compute[75672]: DEBUG nova.objects.instance [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lazy-loading 'resources' on Instance uuid 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1165295209',display_name='tempest-VolumesActionsTest-instance-1165295209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1165295209',id=28,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:42:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa5dfd98cc2e410db49639a642b13975',ramdisk_id='',reservation_id='r-xu61c371',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-364551348',owner_user_name='tempest-VolumesActionsTest-364551348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:42:34Z,user_data=None,user_id='abe9ecbcfe7e444c9946400a062e2b7a',uuid=515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "address": "fa:16:3e:94:ca:0d", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb61b8e-0d", "ovs_interfaceid": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Converting VIF {"id": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "address": "fa:16:3e:94:ca:0d", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb61b8e-0d", "ovs_interfaceid": "3bb61b8e-0d6f-41e2-b5d2-047514910e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:ca:0d,bridge_name='br-int',has_traffic_filtering=True,id=3bb61b8e-0d6f-41e2-b5d2-047514910e00,network=Network(ad88a05e-9702-4570-8363-f905f54e7c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb61b8e-0d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG os_vif [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:ca:0d,bridge_name='br-int',has_traffic_filtering=True,id=3bb61b8e-0d6f-41e2-b5d2-047514910e00,network=Network(ad88a05e-9702-4570-8363-f905f54e7c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb61b8e-0d') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bb61b8e-0d, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d513d04-2df1-4fc9-9e90-7f408f6e1878) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:14 user nova-compute[75672]: INFO os_vif [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:ca:0d,bridge_name='br-int',has_traffic_filtering=True,id=3bb61b8e-0d6f-41e2-b5d2-047514910e00,network=Network(ad88a05e-9702-4570-8363-f905f54e7c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb61b8e-0d')
Nov 30 12:44:14 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Deleting instance files /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7_del
Nov 30 12:44:14 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Deletion of /opt/stack/data/nova/instances/515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7_del complete
Nov 30 12:44:14 user nova-compute[75672]: INFO nova.compute.manager [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 30 12:44:14 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:44:14 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:44:15 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:44:15 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Took 0.56 seconds to deallocate network for instance.
Nov 30 12:44:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:15 user nova-compute[75672]: DEBUG nova.compute.manager [req-882834b6-ffbc-414f-8588-57c89057691e req-66a9f4d1-c792-4a93-8bbf-c23338c2d05e service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-882834b6-ffbc-414f-8588-57c89057691e req-66a9f4d1-c792-4a93-8bbf-c23338c2d05e service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-882834b6-ffbc-414f-8588-57c89057691e req-66a9f4d1-c792-4a93-8bbf-c23338c2d05e service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-882834b6-ffbc-414f-8588-57c89057691e req-66a9f4d1-c792-4a93-8bbf-c23338c2d05e service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:15 user nova-compute[75672]: DEBUG nova.compute.manager [req-882834b6-ffbc-414f-8588-57c89057691e req-66a9f4d1-c792-4a93-8bbf-c23338c2d05e service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:44:15 user nova-compute[75672]: WARNING nova.compute.manager [req-882834b6-ffbc-414f-8588-57c89057691e req-66a9f4d1-c792-4a93-8bbf-c23338c2d05e service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received unexpected event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:44:15 user nova-compute[75672]: DEBUG nova.compute.manager [req-882834b6-ffbc-414f-8588-57c89057691e req-66a9f4d1-c792-4a93-8bbf-c23338c2d05e service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Received event network-vif-deleted-3bb61b8e-0d6f-41e2-b5d2-047514910e00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:16 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:44:16 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:44:16 user nova-compute[75672]: DEBUG nova.compute.manager [req-96f36f43-8972-4137-9499-0bffeb337f34 req-12015cec-7079-405e-a3f2-4a508d5adb51 service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Received event network-vif-plugged-3bb61b8e-0d6f-41e2-b5d2-047514910e00 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-96f36f43-8972-4137-9499-0bffeb337f34 req-12015cec-7079-405e-a3f2-4a508d5adb51 service nova] Acquiring lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-96f36f43-8972-4137-9499-0bffeb337f34 req-12015cec-7079-405e-a3f2-4a508d5adb51 service nova] Lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-96f36f43-8972-4137-9499-0bffeb337f34 req-12015cec-7079-405e-a3f2-4a508d5adb51 service nova] Lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:16 user nova-compute[75672]: DEBUG nova.compute.manager [req-96f36f43-8972-4137-9499-0bffeb337f34 req-12015cec-7079-405e-a3f2-4a508d5adb51 service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] No waiting events found dispatching network-vif-plugged-3bb61b8e-0d6f-41e2-b5d2-047514910e00 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:44:16 user nova-compute[75672]: WARNING nova.compute.manager [req-96f36f43-8972-4137-9499-0bffeb337f34 req-12015cec-7079-405e-a3f2-4a508d5adb51 service nova] [instance: 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7] Received unexpected event network-vif-plugged-3bb61b8e-0d6f-41e2-b5d2-047514910e00 for instance with vm_state deleted and task_state None.
Nov 30 12:44:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.689s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:16 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Deleted allocations for instance 515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7
Nov 30 12:44:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-cdeb6a20-84b3-435a-a2e6-ed869b0574e7 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "515fff9f-b5a2-4e3e-858c-b1d18cfa7fd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.768s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:16 user nova-compute[75672]: DEBUG nova.objects.instance [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'flavor' on Instance uuid 9ae3632c-e9ad-4bef-9ed9-5571d054b06e {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:17 user nova-compute[75672]: INFO nova.compute.manager [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Attaching volume 23afb082-d1fd-4b49-8f04-99ed2cea086d to /dev/vdb
Nov 30 12:44:17 user nova-compute[75672]: DEBUG os_brick.utils [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f85325-3570-4efb-8121-0248517f1a8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc3951d-7699-46ea-be19-f3e97f146c88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4486c21-7267-4c2a-8620-1350b1d141d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b75c6b-38be-46b5-9100-7435c273211e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:44:17 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf5ee29-ea0b-40c1-a6c2-76deecf3eaf8]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG os_brick.utils [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Updating existing volume attachment record: 97c3732f-b6d5-4bbb-a25c-dd6e51d7899e {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG nova.compute.manager [req-371beb55-40d4-4856-9cc2-03a533b34ea5 req-680262cc-a764-44bf-82d4-46debc75ad9b service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-371beb55-40d4-4856-9cc2-03a533b34ea5 req-680262cc-a764-44bf-82d4-46debc75ad9b service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-371beb55-40d4-4856-9cc2-03a533b34ea5 req-680262cc-a764-44bf-82d4-46debc75ad9b service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-371beb55-40d4-4856-9cc2-03a533b34ea5 req-680262cc-a764-44bf-82d4-46debc75ad9b service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG nova.compute.manager [req-371beb55-40d4-4856-9cc2-03a533b34ea5 req-680262cc-a764-44bf-82d4-46debc75ad9b service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:44:17 user nova-compute[75672]: WARNING nova.compute.manager [req-371beb55-40d4-4856-9cc2-03a533b34ea5 req-680262cc-a764-44bf-82d4-46debc75ad9b service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received unexpected event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:44:17 user nova-compute[75672]: DEBUG nova.compute.manager [req-371beb55-40d4-4856-9cc2-03a533b34ea5 req-680262cc-a764-44bf-82d4-46debc75ad9b service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-371beb55-40d4-4856-9cc2-03a533b34ea5 req-680262cc-a764-44bf-82d4-46debc75ad9b service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-371beb55-40d4-4856-9cc2-03a533b34ea5 req-680262cc-a764-44bf-82d4-46debc75ad9b service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-371beb55-40d4-4856-9cc2-03a533b34ea5 req-680262cc-a764-44bf-82d4-46debc75ad9b service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:17 user nova-compute[75672]: DEBUG nova.compute.manager [req-371beb55-40d4-4856-9cc2-03a533b34ea5 req-680262cc-a764-44bf-82d4-46debc75ad9b service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:44:17 user nova-compute[75672]: WARNING nova.compute.manager [req-371beb55-40d4-4856-9cc2-03a533b34ea5 req-680262cc-a764-44bf-82d4-46debc75ad9b service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received unexpected event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:44:18 user nova-compute[75672]: DEBUG nova.compute.manager [None req-5fc20449-eac5-4ef7-8b61-d46e332f6234 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:44:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Acquiring lock "874354b8-bf12-44d6-86f8-0db17ce28faa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Acquiring lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:20 user nova-compute[75672]: INFO nova.compute.manager [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Terminating instance
Nov 30 12:44:20 user nova-compute[75672]: DEBUG nova.compute.manager [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-747c42b0-fe71-48ec-8e04-f0e236e2e07c req-7327154f-4670-4921-8ac8-bc08eebbd654 service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Received event network-vif-unplugged-9f557f6f-c9be-4f0d-be2b-90642b14413a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-747c42b0-fe71-48ec-8e04-f0e236e2e07c req-7327154f-4670-4921-8ac8-bc08eebbd654 service nova] Acquiring lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-747c42b0-fe71-48ec-8e04-f0e236e2e07c req-7327154f-4670-4921-8ac8-bc08eebbd654 service nova] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-747c42b0-fe71-48ec-8e04-f0e236e2e07c req-7327154f-4670-4921-8ac8-bc08eebbd654 service nova] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-747c42b0-fe71-48ec-8e04-f0e236e2e07c req-7327154f-4670-4921-8ac8-bc08eebbd654 service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] No waiting events found dispatching network-vif-unplugged-9f557f6f-c9be-4f0d-be2b-90642b14413a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:44:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-747c42b0-fe71-48ec-8e04-f0e236e2e07c req-7327154f-4670-4921-8ac8-bc08eebbd654 service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Received event network-vif-unplugged-9f557f6f-c9be-4f0d-be2b-90642b14413a for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:21 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Instance destroyed successfully.
Nov 30 12:44:21 user nova-compute[75672]: DEBUG nova.objects.instance [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lazy-loading 'resources' on Instance uuid 874354b8-bf12-44d6-86f8-0db17ce28faa {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:39:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1788780232',display_name='tempest-DeleteServersTestJSON-server-1788780232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1788780232',id=23,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:39:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65141868c783493d812c3be66128289b',ramdisk_id='',reservation_id='r-uq1qe90w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1168113283',owner_user_name='tempest-DeleteServersTestJSON-1168113283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:39:13Z,user_data=None,user_id='bfe9accbc4f04a72adaafd73ca7a8a56',uuid=874354b8-bf12-44d6-86f8-0db17ce28faa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "address": "fa:16:3e:d6:d0:9c", "network": {"id": "986a6ea8-182e-46a9-bb22-acec28e6fc61", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1467640286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65141868c783493d812c3be66128289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f557f6f-c9", "ovs_interfaceid": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Converting VIF {"id": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "address": "fa:16:3e:d6:d0:9c", "network": {"id": "986a6ea8-182e-46a9-bb22-acec28e6fc61", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1467640286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65141868c783493d812c3be66128289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f557f6f-c9", "ovs_interfaceid": "9f557f6f-c9be-4f0d-be2b-90642b14413a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9f557f6f-c9be-4f0d-be2b-90642b14413a,network=Network(986a6ea8-182e-46a9-bb22-acec28e6fc61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f557f6f-c9') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG os_vif [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9f557f6f-c9be-4f0d-be2b-90642b14413a,network=Network(986a6ea8-182e-46a9-bb22-acec28e6fc61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f557f6f-c9') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f557f6f-c9, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70ffe18b-e6d7-47c7-a378-fccc53453649) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:21 user nova-compute[75672]: INFO os_vif [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=9f557f6f-c9be-4f0d-be2b-90642b14413a,network=Network(986a6ea8-182e-46a9-bb22-acec28e6fc61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f557f6f-c9')
Nov 30 12:44:21 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Deleting instance files /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa_del
Nov 30 12:44:21 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Deletion of /opt/stack/data/nova/instances/874354b8-bf12-44d6-86f8-0db17ce28faa_del complete
Nov 30 12:44:21 user nova-compute[75672]: INFO nova.compute.manager [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 30 12:44:21 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:44:21 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:44:22 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:44:22 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Took 0.64 seconds to deallocate network for instance.
Nov 30 12:44:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:22 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:44:22 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:44:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.576s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:22 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Deleted allocations for instance 874354b8-bf12-44d6-86f8-0db17ce28faa
Nov 30 12:44:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-da805a95-417a-423e-9dab-632d2b8477f6 tempest-DeleteServersTestJSON-1168113283 tempest-DeleteServersTestJSON-1168113283-project-member] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.396s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:23 user nova-compute[75672]: DEBUG nova.compute.manager [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Received event network-vif-plugged-9f557f6f-c9be-4f0d-be2b-90642b14413a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] Acquiring lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] Lock "874354b8-bf12-44d6-86f8-0db17ce28faa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:23 user nova-compute[75672]: DEBUG nova.compute.manager [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] No waiting events found dispatching network-vif-plugged-9f557f6f-c9be-4f0d-be2b-90642b14413a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:44:23 user nova-compute[75672]: WARNING nova.compute.manager [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Received unexpected event network-vif-plugged-9f557f6f-c9be-4f0d-be2b-90642b14413a for instance with vm_state deleted and task_state None.
Nov 30 12:44:23 user nova-compute[75672]: DEBUG nova.compute.manager [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] [instance: 874354b8-bf12-44d6-86f8-0db17ce28faa] Received event network-vif-deleted-9f557f6f-c9be-4f0d-be2b-90642b14413a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:23 user nova-compute[75672]: DEBUG nova.compute.manager [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-changed-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:23 user nova-compute[75672]: DEBUG nova.compute.manager [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Refreshing instance network info cache due to event network-changed-1a9e56c6-c320-4afe-9ae3-d1ddca150724. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:44:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] Acquiring lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:44:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] Acquired lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:44:23 user nova-compute[75672]: DEBUG nova.network.neutron [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Refreshing network info cache for port 1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:44:23 user nova-compute[75672]: DEBUG nova.network.neutron [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Updated VIF entry in instance network info cache for port 1a9e56c6-c320-4afe-9ae3-d1ddca150724. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:44:23 user nova-compute[75672]: DEBUG nova.network.neutron [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Updating instance_info_cache with network_info: [{"id": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "address": "fa:16:3e:bd:1f:55", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9e56c6-c3", "ovs_interfaceid": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:44:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f4cb1f8f-131a-46e3-8cff-a593ef8facf7 req-ea4655fa-2dc4-4ac4-a827-dfd45f5dd99c service nova] Releasing lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:44:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-da945ade-9e6f-4625-bd53-2a295a9d37d1 req-66b6fca2-99b7-4c44-8798-17e24e23e368 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-changed-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-da945ade-9e6f-4625-bd53-2a295a9d37d1 req-66b6fca2-99b7-4c44-8798-17e24e23e368 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Refreshing instance network info cache due to event network-changed-1a9e56c6-c320-4afe-9ae3-d1ddca150724. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:44:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-da945ade-9e6f-4625-bd53-2a295a9d37d1 req-66b6fca2-99b7-4c44-8798-17e24e23e368 service nova] Acquiring lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:44:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-da945ade-9e6f-4625-bd53-2a295a9d37d1 req-66b6fca2-99b7-4c44-8798-17e24e23e368 service nova] Acquired lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:44:24 user nova-compute[75672]: DEBUG nova.network.neutron [req-da945ade-9e6f-4625-bd53-2a295a9d37d1 req-66b6fca2-99b7-4c44-8798-17e24e23e368 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Refreshing network info cache for port 1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:44:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:24 user nova-compute[75672]: INFO nova.compute.manager [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Detaching volume 90177125-7302-49b4-baa4-5a0256df924d
Nov 30 12:44:24 user nova-compute[75672]: INFO nova.virt.block_device [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Attempting to driver detach volume 90177125-7302-49b4-baa4-5a0256df924d from mountpoint /dev/vdb
Nov 30 12:44:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Attempting to detach device vdb from instance 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:44:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:44:24 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:44:24 user nova-compute[75672]:   <source dev="/dev/sdd"/>
Nov 30 12:44:24 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:44:24 user nova-compute[75672]:   <serial>90177125-7302-49b4-baa4-5a0256df924d</serial>
Nov 30 12:44:24 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:44:24 user nova-compute[75672]: </disk>
Nov 30 12:44:24 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:44:24 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Successfully detached device vdb from instance 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 from the persistent domain config.
Nov 30 12:44:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:44:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:44:24 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:44:24 user nova-compute[75672]:   <source dev="/dev/sdd"/>
Nov 30 12:44:24 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:44:24 user nova-compute[75672]:   <serial>90177125-7302-49b4-baa4-5a0256df924d</serial>
Nov 30 12:44:24 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:44:24 user nova-compute[75672]: </disk>
Nov 30 12:44:24 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:44:24 user nova-compute[75672]: DEBUG nova.network.neutron [req-da945ade-9e6f-4625-bd53-2a295a9d37d1 req-66b6fca2-99b7-4c44-8798-17e24e23e368 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Updated VIF entry in instance network info cache for port 1a9e56c6-c320-4afe-9ae3-d1ddca150724. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:44:24 user nova-compute[75672]: DEBUG nova.network.neutron [req-da945ade-9e6f-4625-bd53-2a295a9d37d1 req-66b6fca2-99b7-4c44-8798-17e24e23e368 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Updating instance_info_cache with network_info: [{"id": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "address": "fa:16:3e:bd:1f:55", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9e56c6-c3", "ovs_interfaceid": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:44:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-da945ade-9e6f-4625-bd53-2a295a9d37d1 req-66b6fca2-99b7-4c44-8798-17e24e23e368 service nova] Releasing lock "refresh_cache-9db955e1-4b9b-4627-b604-5f07ef8e5ad4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:44:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:44:25 user nova-compute[75672]: DEBUG nova.compute.manager [req-f1074ae9-f856-4f3c-9073-5ba900e6033e req-0714c65c-6089-46e0-95a6-ee436d405954 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Received event network-changed-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:25 user nova-compute[75672]: DEBUG nova.compute.manager [req-f1074ae9-f856-4f3c-9073-5ba900e6033e req-0714c65c-6089-46e0-95a6-ee436d405954 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Refreshing instance network info cache due to event network-changed-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:44:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f1074ae9-f856-4f3c-9073-5ba900e6033e req-0714c65c-6089-46e0-95a6-ee436d405954 service nova] Acquiring lock "refresh_cache-e60dffb1-a1b9-48cd-85a0-edccc97ea849" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:44:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f1074ae9-f856-4f3c-9073-5ba900e6033e req-0714c65c-6089-46e0-95a6-ee436d405954 service nova] Acquired lock "refresh_cache-e60dffb1-a1b9-48cd-85a0-edccc97ea849" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:44:25 user nova-compute[75672]: DEBUG nova.network.neutron [req-f1074ae9-f856-4f3c-9073-5ba900e6033e req-0714c65c-6089-46e0-95a6-ee436d405954 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Refreshing network info cache for port 8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:44:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:25 user nova-compute[75672]: INFO nova.compute.manager [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Terminating instance
Nov 30 12:44:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:44:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-90f7a4d7-898f-4ee7-90f0-23dcbe4b028d req-79cf27ab-e99d-449e-bcb9-145782dff604 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Received event network-vif-unplugged-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-90f7a4d7-898f-4ee7-90f0-23dcbe4b028d req-79cf27ab-e99d-449e-bcb9-145782dff604 service nova] Acquiring lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-90f7a4d7-898f-4ee7-90f0-23dcbe4b028d req-79cf27ab-e99d-449e-bcb9-145782dff604 service nova] Lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-90f7a4d7-898f-4ee7-90f0-23dcbe4b028d req-79cf27ab-e99d-449e-bcb9-145782dff604 service nova] Lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-90f7a4d7-898f-4ee7-90f0-23dcbe4b028d req-79cf27ab-e99d-449e-bcb9-145782dff604 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] No waiting events found dispatching network-vif-unplugged-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-90f7a4d7-898f-4ee7-90f0-23dcbe4b028d req-79cf27ab-e99d-449e-bcb9-145782dff604 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Received event network-vif-unplugged-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG nova.network.neutron [req-f1074ae9-f856-4f3c-9073-5ba900e6033e req-0714c65c-6089-46e0-95a6-ee436d405954 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Updated VIF entry in instance network info cache for port 8e0b2d72-1412-47d0-b759-4cdb0dadc5e9. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG nova.network.neutron [req-f1074ae9-f856-4f3c-9073-5ba900e6033e req-0714c65c-6089-46e0-95a6-ee436d405954 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Updating instance_info_cache with network_info: [{"id": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "address": "fa:16:3e:9c:77:f9", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0b2d72-14", "ovs_interfaceid": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f1074ae9-f856-4f3c-9073-5ba900e6033e req-0714c65c-6089-46e0-95a6-ee436d405954 service nova] Releasing lock "refresh_cache-e60dffb1-a1b9-48cd-85a0-edccc97ea849" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:26 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Instance destroyed successfully.
Nov 30 12:44:26 user nova-compute[75672]: DEBUG nova.objects.instance [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lazy-loading 'resources' on Instance uuid e60dffb1-a1b9-48cd-85a0-edccc97ea849 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1997438324',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1997438324',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1997438324',id=30,image_ref='1f536f0f-2a43-43ff-95cc-6885eefb7490',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGIcArp84sKTUfIrgeplVoG2KmejLU7s1CUHPvNNJOEqhqmTneNwd5fvUkqUYQ95JEJxl8ib7cHcfnTR7zFAJdT6VoIhfZg7KC+QgJ1nTuhrR+9OGoCN5Xur0oovlMsqw==',key_name='tempest-keypair-2088837571',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:42:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-36n02407',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1743139468',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:42:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=e60dffb1-a1b9-48cd-85a0-edccc97ea849,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "address": "fa:16:3e:9c:77:f9", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0b2d72-14", "ovs_interfaceid": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "address": "fa:16:3e:9c:77:f9", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0b2d72-14", "ovs_interfaceid": "8e0b2d72-1412-47d0-b759-4cdb0dadc5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:77:f9,bridge_name='br-int',has_traffic_filtering=True,id=8e0b2d72-1412-47d0-b759-4cdb0dadc5e9,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0b2d72-14') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_vif [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:77:f9,bridge_name='br-int',has_traffic_filtering=True,id=8e0b2d72-1412-47d0-b759-4cdb0dadc5e9,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0b2d72-14') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e0b2d72-14, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a40b7828-7605-4028-9b8b-3b217b97c94d) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:26 user nova-compute[75672]: INFO os_vif [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:77:f9,bridge_name='br-int',has_traffic_filtering=True,id=8e0b2d72-1412-47d0-b759-4cdb0dadc5e9,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0b2d72-14')
Nov 30 12:44:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcVKAuiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:44:26 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9761437-9f09-4546-882d-431888365c46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:44:26 user nova-compute[75672]: No targets found.
Nov 30 12:44:26 user nova-compute[75672]: iSNS:
Nov 30 12:44:26 user nova-compute[75672]: No targets found.
Nov 30 12:44:26 user nova-compute[75672]: STATIC:
Nov 30 12:44:26 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016
Nov 30 12:44:26 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:26 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:26 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907
Nov 30 12:44:26 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:26 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:26 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b
Nov 30 12:44:26 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:26 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:26 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480
Nov 30 12:44:26 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:26 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:26 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d
Nov 30 12:44:26 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:26 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:26 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7
Nov 30 12:44:26 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:26 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:26 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff
Nov 30 12:44:26 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:26 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:26 user nova-compute[75672]: FIRMWARE:
Nov 30 12:44:26 user nova-compute[75672]: No targets found.
Nov 30 12:44:26 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:44:26 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:44:26 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[67365754-9084-4ba0-96fb-94bc3e936b8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b503ed-0939-45df-aa71-04ff02dd5a81]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:26 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:44:26 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:26 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:44:26 user nova-compute[75672]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)
Nov 30 12:44:26 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:26 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:26 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:26 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:44:26 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:26 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:44:26 user nova-compute[75672]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 (non-flash)
Nov 30 12:44:26 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:26 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:26 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcb47cb520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7'): ({'sdg'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Removing single pathed devices sdg {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed60db52-e3e0-42e4-8201-fb3c43402a4a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8578d073-2cc0-41de-8dfe-6dd7e885f177]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flushing IO for device /dev/sdg {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f4d916-9ca5-427f-b464-a5a155b119b2]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ce715a-1d40-4e6a-a565-236a0ee591bb]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] SCSI volumes sdg have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIObfa9f1ea-03148cb31f6a068e', '/dev/disk/by-id/scsi-23033313438636233', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bfa9f1ea') {{(pid=86963) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8955f252-0dca-4788-97ff-3c3844d6a5bd]: (4, None) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a243e856-5b21-48a9-b0eb-a9c988651fda]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e07483-8cea-43be-a71c-95eade92f7c8]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7, portal: 172.16.0.220,3260]
Nov 30 12:44:26 user nova-compute[75672]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7, portal: 172.16.0.220,3260] successful.
Nov 30 12:44:26 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53d17f4-532f-4592-a468-464f9dc8f1a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cee4116-4343-4f93-a040-77be2a7ab3c5]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== disconnect_volume: return (360ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:44:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:44:26 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Deleting instance files /opt/stack/data/nova/instances/e60dffb1-a1b9-48cd-85a0-edccc97ea849_del
Nov 30 12:44:26 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Deletion of /opt/stack/data/nova/instances/e60dffb1-a1b9-48cd-85a0-edccc97ea849_del complete
Nov 30 12:44:27 user nova-compute[75672]: INFO nova.compute.manager [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 30 12:44:27 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:44:27 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:44:27 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:44:27 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:44:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-92165140-80f4-493f-8886-03992e0dc026 req-a65ff4a8-0fef-496c-9236-7035bc251b34 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Received event network-vif-deleted-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:27 user nova-compute[75672]: INFO nova.compute.manager [req-92165140-80f4-493f-8886-03992e0dc026 req-a65ff4a8-0fef-496c-9236-7035bc251b34 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Neutron deleted interface 8e0b2d72-1412-47d0-b759-4cdb0dadc5e9; detaching it from the instance and deleting it from the info cache
Nov 30 12:44:27 user nova-compute[75672]: DEBUG nova.network.neutron [req-92165140-80f4-493f-8886-03992e0dc026 req-a65ff4a8-0fef-496c-9236-7035bc251b34 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:44:27 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Took 0.62 seconds to deallocate network for instance.
Nov 30 12:44:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-92165140-80f4-493f-8886-03992e0dc026 req-a65ff4a8-0fef-496c-9236-7035bc251b34 service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Detach interface failed, port_id=8e0b2d72-1412-47d0-b759-4cdb0dadc5e9, reason: Instance e60dffb1-a1b9-48cd-85a0-edccc97ea849 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:44:28 user nova-compute[75672]: DEBUG nova.compute.manager [req-45360195-db52-4665-9695-bfefb880da93 req-9f329df2-9f75-4f60-a20e-6e67b5995b1c service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Received event network-vif-plugged-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-45360195-db52-4665-9695-bfefb880da93 req-9f329df2-9f75-4f60-a20e-6e67b5995b1c service nova] Acquiring lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-45360195-db52-4665-9695-bfefb880da93 req-9f329df2-9f75-4f60-a20e-6e67b5995b1c service nova] Lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-45360195-db52-4665-9695-bfefb880da93 req-9f329df2-9f75-4f60-a20e-6e67b5995b1c service nova] Lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:28 user nova-compute[75672]: DEBUG nova.compute.manager [req-45360195-db52-4665-9695-bfefb880da93 req-9f329df2-9f75-4f60-a20e-6e67b5995b1c service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] No waiting events found dispatching network-vif-plugged-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:44:28 user nova-compute[75672]: WARNING nova.compute.manager [req-45360195-db52-4665-9695-bfefb880da93 req-9f329df2-9f75-4f60-a20e-6e67b5995b1c service nova] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Received unexpected event network-vif-plugged-8e0b2d72-1412-47d0-b759-4cdb0dadc5e9 for instance with vm_state active and task_state deleting.
Nov 30 12:44:30 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 is timed out.
Nov 30 12:44:30 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Successfully detached device vdb from instance 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 from the live domain config.
Nov 30 12:44:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYDJxaZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:44:30 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21ecd42-63e5-4929-b0bf-3cafc1105a3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:44:30 user nova-compute[75672]: No targets found.
Nov 30 12:44:30 user nova-compute[75672]: iSNS:
Nov 30 12:44:30 user nova-compute[75672]: No targets found.
Nov 30 12:44:30 user nova-compute[75672]: STATIC:
Nov 30 12:44:30 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016
Nov 30 12:44:30 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:30 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:30 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907
Nov 30 12:44:30 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:30 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:30 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b
Nov 30 12:44:30 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:30 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:30 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480
Nov 30 12:44:30 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:30 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:30 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d
Nov 30 12:44:30 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:30 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:30 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff
Nov 30 12:44:30 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:30 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:30 user nova-compute[75672]: FIRMWARE:
Nov 30 12:44:30 user nova-compute[75672]: No targets found.
Nov 30 12:44:30 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:44:30 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:44:30 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0039b489-665a-4929-9d63-05d39f49a323]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a5e386-145c-413e-894e-7af077f3cc50]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:30 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:44:30 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:30 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:44:30 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:30 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:30 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:30 user nova-compute[75672]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 (non-flash)
Nov 30 12:44:30 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:30 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:44:30 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:30 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:30 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd450d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907'): ({'sdf'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Removing single pathed devices sdf {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f1277b-e9ca-4ed4-8080-fd02da2e34c3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5300d134-2914-44d2-b689-e01035a06f2b]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Flushing IO for device /dev/sdf {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba001d9-8875-4707-9275-b47336db2738]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b249172-2c0f-4c33-bcb1-48257db1b671]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] SCSI volumes sdf have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5153712f-d963-48af-a45b-af0931b1d7b1]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1007a9-3de9-4d4b-b400-b02bd8258178]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907, portal: 172.16.0.220,3260]
Nov 30 12:44:30 user nova-compute[75672]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907, portal: 172.16.0.220,3260] successful.
Nov 30 12:44:30 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d337fb-25c6-4aea-a867-147aaa39c907 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[982c1e31-9028-4f0a-94ea-2aa094f5bc22]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] <== disconnect_volume: return (353ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:44:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:44:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:31 user nova-compute[75672]: DEBUG nova.objects.instance [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lazy-loading 'flavor' on Instance uuid 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:44:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd3d9167-c8ac-47bf-984c-1491e75eb24d tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.812s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:31 user nova-compute[75672]: INFO nova.compute.manager [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Took 4.25 seconds to detach 1 volumes for instance.
Nov 30 12:44:31 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: e60dffb1-a1b9-48cd-85a0-edccc97ea849] Deleting volume: d53d17f4-532f-4592-a468-464f9dc8f1a7 {{(pid=75672) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 12:44:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:44:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEYVCBTv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:44:31 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:44:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:44:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:44:31 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:44:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:44:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:44:31 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:44:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7b20c1-2917-41b3-9ba8-aba2a349eb1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:44:32 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[af21cd6c-ef89-4004-a52c-53e8e22dc029]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d] added
Nov 30 12:44:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b96b215-c7c3-414e-9786-e28a215c8475]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8230cabb-e49d-4b8a-b36b-59d2f1feda29]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEYVCBTv {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEYVCBTv" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af92114-b4ab-47f9-8cae-e757c26d1fbb]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LEYVCBTv'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caa7825-a48f-4237-be91-432fb2f61ab6]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade8c471-cb91-491c-9270-f4d6c69b3c1b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[13091666-f19a-4021-9854-2dae0107950a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d, portal: 172.16.0.220,3260]
Nov 30 12:44:32 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d, portal: 172.16.0.220,3260] successful.
Nov 30 12:44:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcb6fe6-60b4-46c9-9d96-d0d456d616d6]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bfeb5c-9cdd-4809-8e18-63cc4dd4dfab]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)
Nov 30 12:44:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:32 user nova-compute[75672]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)
Nov 30 12:44:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e716137e-cac1-48c9-809c-e677c4c7ff2f]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEYVCBTv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:32 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Deleted allocations for instance e60dffb1-a1b9-48cd-85a0-edccc97ea849
Nov 30 12:44:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f03d71d5-96ad-4dcc-834a-ecb9d8934b79 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "e60dffb1-a1b9-48cd-85a0-edccc97ea849" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.828s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:44:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23836306535363235', 'path': '/dev/sdf'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:44:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836306535363235', 'path': '/dev/sdf'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:44:33 user nova-compute[75672]: DEBUG nova.objects.instance [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'flavor' on Instance uuid 9ae3632c-e9ad-4bef-9ed9-5571d054b06e {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:44:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:44:33 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:44:33 user nova-compute[75672]:   <source dev="/dev/sdf"/>
Nov 30 12:44:33 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:44:33 user nova-compute[75672]:   <serial>23afb082-d1fd-4b49-8f04-99ed2cea086d</serial>
Nov 30 12:44:33 user nova-compute[75672]: </disk>
Nov 30 12:44:33 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:44:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:44:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:44:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] No VIF found with MAC fa:16:3e:8a:e2:85, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:44:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-69269fbc-7ef5-41d1-b8aa-c8f346ec9b39 req-05a38d2d-95b1-42de-86a5-a655535ab47b service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Received event network-changed-19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:44:33 user nova-compute[75672]: DEBUG nova.compute.manager [req-69269fbc-7ef5-41d1-b8aa-c8f346ec9b39 req-05a38d2d-95b1-42de-86a5-a655535ab47b service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Refreshing instance network info cache due to event network-changed-19ff09c5-922f-48bf-a8d2-16f60aa9780f. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:44:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-69269fbc-7ef5-41d1-b8aa-c8f346ec9b39 req-05a38d2d-95b1-42de-86a5-a655535ab47b service nova] Acquiring lock "refresh_cache-044e4031-8381-4e7f-a5ac-1a074e00497e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:44:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-69269fbc-7ef5-41d1-b8aa-c8f346ec9b39 req-05a38d2d-95b1-42de-86a5-a655535ab47b service nova] Acquired lock "refresh_cache-044e4031-8381-4e7f-a5ac-1a074e00497e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:44:33 user nova-compute[75672]: DEBUG nova.network.neutron [req-69269fbc-7ef5-41d1-b8aa-c8f346ec9b39 req-05a38d2d-95b1-42de-86a5-a655535ab47b service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Refreshing network info cache for port 19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:44:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-31ae4ad2-9ac2-47b4-82cc-dc8597c78ffc tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.795s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:34 user nova-compute[75672]: DEBUG nova.network.neutron [req-69269fbc-7ef5-41d1-b8aa-c8f346ec9b39 req-05a38d2d-95b1-42de-86a5-a655535ab47b service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Updated VIF entry in instance network info cache for port 19ff09c5-922f-48bf-a8d2-16f60aa9780f. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:44:34 user nova-compute[75672]: DEBUG nova.network.neutron [req-69269fbc-7ef5-41d1-b8aa-c8f346ec9b39 req-05a38d2d-95b1-42de-86a5-a655535ab47b service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Updating instance_info_cache with network_info: [{"id": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "address": "fa:16:3e:0a:af:87", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ff09c5-92", "ovs_interfaceid": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:44:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-69269fbc-7ef5-41d1-b8aa-c8f346ec9b39 req-05a38d2d-95b1-42de-86a5-a655535ab47b service nova] Releasing lock "refresh_cache-044e4031-8381-4e7f-a5ac-1a074e00497e" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:44:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:35 user nova-compute[75672]: INFO nova.compute.manager [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Detaching volume 23afb082-d1fd-4b49-8f04-99ed2cea086d
Nov 30 12:44:35 user nova-compute[75672]: INFO nova.virt.block_device [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Attempting to driver detach volume 23afb082-d1fd-4b49-8f04-99ed2cea086d from mountpoint /dev/vdb
Nov 30 12:44:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Attempting to detach device vdb from instance 9ae3632c-e9ad-4bef-9ed9-5571d054b06e from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:44:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:44:35 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:44:35 user nova-compute[75672]:   <source dev="/dev/sdf"/>
Nov 30 12:44:35 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:44:35 user nova-compute[75672]:   <serial>23afb082-d1fd-4b49-8f04-99ed2cea086d</serial>
Nov 30 12:44:35 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:44:35 user nova-compute[75672]: </disk>
Nov 30 12:44:35 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:44:35 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Successfully detached device vdb from instance 9ae3632c-e9ad-4bef-9ed9-5571d054b06e from the persistent domain config.
Nov 30 12:44:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ae3632c-e9ad-4bef-9ed9-5571d054b06e from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:44:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:44:35 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:44:35 user nova-compute[75672]:   <source dev="/dev/sdf"/>
Nov 30 12:44:35 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:44:35 user nova-compute[75672]:   <serial>23afb082-d1fd-4b49-8f04-99ed2cea086d</serial>
Nov 30 12:44:35 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:44:35 user nova-compute[75672]: </disk>
Nov 30 12:44:35 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:44:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ae3632c-e9ad-4bef-9ed9-5571d054b06e {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:44:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:36 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:44:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:44:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:44:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:44:36 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:44:37 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Updating instance_info_cache with network_info: [{"id": "449f9465-ff37-41ba-a779-b6791644bfbe", "address": "fa:16:3e:16:c6:38", "network": {"id": "3fb890d7-13c7-46cd-a675-2e37f8faebcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1255737074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af7cfb45ca64a1ab37299ecbc1a1ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449f9465-ff", "ovs_interfaceid": "449f9465-ff37-41ba-a779-b6791644bfbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:44:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:44:37 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:44:37 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:44:38 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:44:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "044e4031-8381-4e7f-a5ac-1a074e00497e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:38 user nova-compute[75672]: DEBUG nova.objects.instance [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'flavor' on Instance uuid 044e4031-8381-4e7f-a5ac-1a074e00497e {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:44:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "044e4031-8381-4e7f-a5ac-1a074e00497e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:38 user nova-compute[75672]: INFO nova.compute.manager [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Attaching volume 15a44637-6640-4e09-be01-c77186074903 to /dev/vdb
Nov 30 12:44:38 user nova-compute[75672]: DEBUG os_brick.utils [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:44:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:38 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c487ecb-a10c-4636-ac7f-9c9d7439ff36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:38 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[55433192-e893-4124-b2b3-9c4b4fc582ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:38 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[781aa6a6-b013-4b26-934e-ddd7c80bc927]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f9c207-04ed-4627-8f69-6d0e66fdb0a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:44:39 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf390b3c-4e4c-4b65-97e4-23ad3f0bd4b8]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG os_brick.utils [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Updating existing volume attachment record: 87937a31-2d97-4dec-a44e-cb998a2f0942 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:44:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:44:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:44:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:44:44 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:44:44 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7058MB free_disk=25.130542755126953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance b06bea0f-9186-4ab8-8bad-588beb48a1f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 0a41ad0b-978b-4931-a30c-573e20f166a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 9ae3632c-e9ad-4bef-9ed9-5571d054b06e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 044e4031-8381-4e7f-a5ac-1a074e00497e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f5851479-d09b-4d84-9553-2b09646f2b4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:44:44 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 is timed out.
Nov 30 12:44:44 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Successfully detached device vdb from instance 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 from the live domain config.
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYSeHxMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:44:44 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:44:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[311cfefe-3fcd-486b-ab0f-925caefa5c2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:44:44 user nova-compute[75672]: No targets found.
Nov 30 12:44:44 user nova-compute[75672]: iSNS:
Nov 30 12:44:44 user nova-compute[75672]: No targets found.
Nov 30 12:44:44 user nova-compute[75672]: STATIC:
Nov 30 12:44:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016
Nov 30 12:44:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b
Nov 30 12:44:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480
Nov 30 12:44:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d
Nov 30 12:44:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d
Nov 30 12:44:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:44 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff
Nov 30 12:44:44 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:44 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:44 user nova-compute[75672]: FIRMWARE:
Nov 30 12:44:44 user nova-compute[75672]: No targets found.
Nov 30 12:44:44 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:44:44 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:44:44 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[950cdf5c-a0fb-490c-a958-3f9693787e5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb354857-b675-458c-a921-5dff02d718e2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:44 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:44 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:44:44 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:44 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:44 user nova-compute[75672]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)
Nov 30 12:44:44 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:44 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:44 user nova-compute[75672]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d (non-flash)
Nov 30 12:44:44 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:44 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:44 user nova-compute[75672]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)
Nov 30 12:44:44 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcf7e4a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d'): ({'sdd'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Removing single pathed devices sdd {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a7b8c3-326f-4366-95e5-53490df7040f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca39ddb-bcce-4035-965f-4e6f2ff0e77a]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Flushing IO for device /dev/sdd {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:44 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8494c4bb-5d54-41d5-b72d-a2670922ae4e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fec454-7dd0-486a-aefa-29d94c2ed1da]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] SCSI volumes sdd have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc825c79-2b2a-46da-a5c0-db2fce615432]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e3f6ce-c952-4061-b3e8-7a020e82f210]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d, portal: 172.16.0.220,3260]
Nov 30 12:44:45 user nova-compute[75672]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d, portal: 172.16.0.220,3260] successful.
Nov 30 12:44:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90177125-7302-49b4-baa4-5a0256df924d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ebadf8-66f8-4ba7-9141-1a45eb8054a6]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] <== disconnect_volume: return (336ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:44:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:44:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:44:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:44:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:44:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:44:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:44:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:44:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:49 user nova-compute[75672]: DEBUG nova.objects.instance [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'flavor' on Instance uuid 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:44:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-93340cc1-2e06-4a30-b7a3-74d0ae074ee9 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.600s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:44:49 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rmfPsGdB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:44:49 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:44:49 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:44:49 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:44:49 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:44:49 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:44:49 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:44:49 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:44:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:49 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25d92bf-7285-4fb4-944b-ee80e502b158]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:49 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:44:49 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f249e4-6bbe-4f89-ba7e-ffbc183ac2c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903] added
Nov 30 12:44:50 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[752c8eb6-99ef-4877-b356-5bfc6692dcb5]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[856a6fb6-a6df-4a25-9426-f8bf2fb65891]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rmfPsGdB {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rmfPsGdB" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b488ca6-3ce7-4ae5-aa08-f5a2ed04a9d4]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rmfPsGdB'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a942b4a3-1642-4979-acbc-a5dbc3803eec]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7769b704-3ba1-44a0-b3ce-25b98b4cfbf0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)
Nov 30 12:44:50 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)
Nov 30 12:44:50 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd48805c-bdc4-4595-953e-ec7f8ebef916]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903, portal: 172.16.0.220,3260]
Nov 30 12:44:50 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903, portal: 172.16.0.220,3260] successful.
Nov 30 12:44:50 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7533e11-67dd-4183-9617-20b3232c48c8]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a658c986-20a0-4bff-b215-2be6df89c4d5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)
Nov 30 12:44:50 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)
Nov 30 12:44:50 user nova-compute[75672]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)
Nov 30 12:44:50 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6913d12c-117a-4c03-82f1-d7bd754c8300]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:50 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:44:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:44:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rmfPsGdB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:44:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:44:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23739356264353366', 'path': '/dev/sdd'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:44:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739356264353366', 'path': '/dev/sdd'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:44:51 user nova-compute[75672]: DEBUG nova.objects.instance [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'flavor' on Instance uuid 044e4031-8381-4e7f-a5ac-1a074e00497e {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:44:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:44:51 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:44:51 user nova-compute[75672]:   <source dev="/dev/sdd"/>
Nov 30 12:44:51 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:44:51 user nova-compute[75672]:   <serial>15a44637-6640-4e09-be01-c77186074903</serial>
Nov 30 12:44:51 user nova-compute[75672]: </disk>
Nov 30 12:44:51 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:44:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:44:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:44:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:44:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] No VIF found with MAC fa:16:3e:0a:af:87, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:44:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-08f9e3d7-b977-4f6a-be34-f1327d33f8ef tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.948s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "044e4031-8381-4e7f-a5ac-1a074e00497e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG nova.objects.instance [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'flavor' on Instance uuid 044e4031-8381-4e7f-a5ac-1a074e00497e {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "044e4031-8381-4e7f-a5ac-1a074e00497e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:44:55 user nova-compute[75672]: INFO nova.compute.manager [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Attaching volume dc75033f-38c0-468e-961e-904c40c99c11 to /dev/vdc
Nov 30 12:44:55 user nova-compute[75672]: DEBUG os_brick.utils [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c693dd1b-9a1e-4916-a7e6-92bdad2d7bea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8065b307-2bac-464f-9643-ec3854f8208a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f71a1d3-e8e7-4302-942b-93f1a107caaf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[60592dc3-97f6-47ad-b265-9bb42c405d2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:44:55 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:44:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ccc1b7-03c4-4319-b55a-99241fa4e521]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG os_brick.utils [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:44:55 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Updating existing volume attachment record: a06b8e26-c1da-4817-817e-40a6bf4ec63c {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:44:56 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ae3632c-e9ad-4bef-9ed9-5571d054b06e is timed out.
Nov 30 12:44:56 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Successfully detached device vdb from instance 9ae3632c-e9ad-4bef-9ed9-5571d054b06e from the live domain config.
Nov 30 12:44:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEYVCBTv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:44:56 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc385f2-a27d-4dc1-8581-9d0db1fcf625]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:44:56 user nova-compute[75672]: No targets found.
Nov 30 12:44:56 user nova-compute[75672]: iSNS:
Nov 30 12:44:56 user nova-compute[75672]: No targets found.
Nov 30 12:44:56 user nova-compute[75672]: STATIC:
Nov 30 12:44:56 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016
Nov 30 12:44:56 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:56 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:56 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903
Nov 30 12:44:56 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:56 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:56 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b
Nov 30 12:44:56 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:56 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:56 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480
Nov 30 12:44:56 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:56 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:56 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d
Nov 30 12:44:56 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:56 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:56 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff
Nov 30 12:44:56 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:44:56 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:44:56 user nova-compute[75672]: FIRMWARE:
Nov 30 12:44:56 user nova-compute[75672]: No targets found.
Nov 30 12:44:56 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:44:56 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:44:56 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[013f5e47-a5e0-47d8-87da-da62dcbc7d25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0dfa28-976e-4cc0-b289-81b147f96633]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:56 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:56 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:56 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:56 user nova-compute[75672]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)
Nov 30 12:44:56 user nova-compute[75672]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)
Nov 30 12:44:56 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:44:56 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:44:56 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:44:56 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:44:56 user nova-compute[75672]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d (non-flash)
Nov 30 12:44:56 user nova-compute[75672]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)
Nov 30 12:44:56 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcb47ca560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d'): ({'sdf'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Removing single pathed devices sdf {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd74598-1679-435c-b284-ac0dc3259d56]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e023aec-73c4-4489-86dd-bf1581251546]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Flushing IO for device /dev/sdf {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eff325-db40-4254-8fbc-1b42ea65ecc2]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74c7f83-9955-4c91-968c-ae5e6cefa377]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] SCSI volumes sdf have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7ad6fe-c1cf-4fe9-8889-6592fc1c51a7]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67c8923-12ad-4370-b34c-3493b4da1cff]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d, portal: 172.16.0.220,3260]
Nov 30 12:44:56 user nova-compute[75672]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d, portal: 172.16.0.220,3260] successful.
Nov 30 12:44:56 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23afb082-d1fd-4b49-8f04-99ed2cea086d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf9f6d2-a4a2-4933-8552-e038e048b37e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] <== disconnect_volume: return (317ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:44:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:00 user nova-compute[75672]: INFO nova.compute.manager [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Terminating instance
Nov 30 12:45:00 user nova-compute[75672]: DEBUG nova.compute.manager [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-c0c7d53d-92f3-4f8b-bcab-fcfd6294d254 req-4f592798-a7d3-474c-92df-bca64ff123a6 service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received event network-vif-unplugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c0c7d53d-92f3-4f8b-bcab-fcfd6294d254 req-4f592798-a7d3-474c-92df-bca64ff123a6 service nova] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c0c7d53d-92f3-4f8b-bcab-fcfd6294d254 req-4f592798-a7d3-474c-92df-bca64ff123a6 service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c0c7d53d-92f3-4f8b-bcab-fcfd6294d254 req-4f592798-a7d3-474c-92df-bca64ff123a6 service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-c0c7d53d-92f3-4f8b-bcab-fcfd6294d254 req-4f592798-a7d3-474c-92df-bca64ff123a6 service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] No waiting events found dispatching network-vif-unplugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-c0c7d53d-92f3-4f8b-bcab-fcfd6294d254 req-4f592798-a7d3-474c-92df-bca64ff123a6 service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received event network-vif-unplugged-449f9465-ff37-41ba-a779-b6791644bfbe for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Instance destroyed successfully.
Nov 30 12:45:01 user nova-compute[75672]: DEBUG nova.objects.instance [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lazy-loading 'resources' on Instance uuid 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-572316796',display_name='tempest-TestServerVolumeAttachmentScenario-server-572316796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-572316796',id=22,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJojoxWrerIjfTb1C4budJ26TRiWZ4SUHy6lNhLYMip4xqi8rx4obsD3MSIJSzVPp8xLKXft8oiF5fnVJTVNMIPS1TKwBZCGZ/jFKyqAG9eu++eI3LdvIDwneMRJ527DQw==',key_name='tempest-keypair-1759477291',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:38:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6af7cfb45ca64a1ab37299ecbc1a1ce6',ramdisk_id='',reservation_id='r-7s7ec1q8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1990148836',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1990148836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:38:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00ef4da74def408a818911598648cf4f',uuid=76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "449f9465-ff37-41ba-a779-b6791644bfbe", "address": "fa:16:3e:16:c6:38", "network": {"id": "3fb890d7-13c7-46cd-a675-2e37f8faebcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1255737074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af7cfb45ca64a1ab37299ecbc1a1ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449f9465-ff", "ovs_interfaceid": "449f9465-ff37-41ba-a779-b6791644bfbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Converting VIF {"id": "449f9465-ff37-41ba-a779-b6791644bfbe", "address": "fa:16:3e:16:c6:38", "network": {"id": "3fb890d7-13c7-46cd-a675-2e37f8faebcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1255737074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af7cfb45ca64a1ab37299ecbc1a1ce6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449f9465-ff", "ovs_interfaceid": "449f9465-ff37-41ba-a779-b6791644bfbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:c6:38,bridge_name='br-int',has_traffic_filtering=True,id=449f9465-ff37-41ba-a779-b6791644bfbe,network=Network(3fb890d7-13c7-46cd-a675-2e37f8faebcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449f9465-ff') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG os_vif [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:c6:38,bridge_name='br-int',has_traffic_filtering=True,id=449f9465-ff37-41ba-a779-b6791644bfbe,network=Network(3fb890d7-13c7-46cd-a675-2e37f8faebcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449f9465-ff') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap449f9465-ff, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=837e4048-0bb9-4928-a66b-051815fe3d8f) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: INFO os_vif [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:c6:38,bridge_name='br-int',has_traffic_filtering=True,id=449f9465-ff37-41ba-a779-b6791644bfbe,network=Network(3fb890d7-13c7-46cd-a675-2e37f8faebcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449f9465-ff')
Nov 30 12:45:01 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Deleting instance files /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2_del
Nov 30 12:45:01 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Deletion of /opt/stack/data/nova/instances/76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2_del complete
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: INFO nova.compute.manager [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 30 12:45:01 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:02 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Took 0.97 seconds to deallocate network for instance.
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received event network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] No waiting events found dispatching network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:02 user nova-compute[75672]: WARNING nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received unexpected event network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe for instance with vm_state deleted and task_state None.
Nov 30 12:45:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received event network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] No waiting events found dispatching network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:02 user nova-compute[75672]: WARNING nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received unexpected event network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe for instance with vm_state deleted and task_state None.
Nov 30 12:45:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received event network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] No waiting events found dispatching network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:02 user nova-compute[75672]: WARNING nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received unexpected event network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe for instance with vm_state deleted and task_state None.
Nov 30 12:45:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received event network-vif-unplugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] No waiting events found dispatching network-vif-unplugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:02 user nova-compute[75672]: WARNING nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received unexpected event network-vif-unplugged-449f9465-ff37-41ba-a779-b6791644bfbe for instance with vm_state deleted and task_state None.
Nov 30 12:45:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received event network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Acquiring lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] No waiting events found dispatching network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:02 user nova-compute[75672]: WARNING nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received unexpected event network-vif-plugged-449f9465-ff37-41ba-a779-b6791644bfbe for instance with vm_state deleted and task_state None.
Nov 30 12:45:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-a8bc773c-3429-4ba5-80e0-cca991296b9c req-140f1380-a7d2-41f3-bdd5-bc473e14820f service nova] [instance: 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2] Received event network-vif-deleted-449f9465-ff37-41ba-a779-b6791644bfbe {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:02 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Deleted allocations for instance 76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2
Nov 30 12:45:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-167093ac-5cac-4c1b-8cb3-41f820423efa tempest-TestServerVolumeAttachmentScenario-1990148836 tempest-TestServerVolumeAttachmentScenario-1990148836-project-member] Lock "76d3ebe6-7ab8-4e0f-90bb-97dc8abe2ce2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.533s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:05 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:45:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:05 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:45:05 user nova-compute[75672]: INFO nova.compute.claims [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Claim successful on node user
Nov 30 12:45:05 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:45:05 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:45:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:05 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:45:05 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:45:05 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:45:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:45:05 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:45:05 user nova-compute[75672]: DEBUG nova.policy [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abe9ecbcfe7e444c9946400a062e2b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5dfd98cc2e410db49639a642b13975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:45:06 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Creating image(s)
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "/opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "/opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "/opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG nova.objects.instance [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'flavor' on Instance uuid 9ae3632c-e9ad-4bef-9ed9-5571d054b06e {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-58aba82c-ac82-4234-aa91-5b437662be86 tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.830s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk 1073741824" returned: 0 in 0.061s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Successfully created port: c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlcdouNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:45:06 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:45:06 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:45:06 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad2eef3-9117-4b13-a067-699a1ba4fe44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:45:06 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5e1538-4cd4-4852-91d5-6c25cb57a564]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11] added
Nov 30 12:45:06 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6ef3b8-cc3c-45b8-970c-9633db2680fa]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[41679e22-3c06-419f-99fa-bc75fc9551e8]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MlcdouNs {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MlcdouNs" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a204ebd3-b9c3-4c66-bbab-d35ae560728e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MlcdouNs'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.197s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9b929a-c662-4758-886c-5d4b642aca1b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cce6eb-640a-4cee-89b0-59ab37ee0132]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)
Nov 30 12:45:06 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)
Nov 30 12:45:06 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d329a7bd-2059-4be2-b5a1-71f5ce1da14b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11, portal: 172.16.0.220,3260]
Nov 30 12:45:06 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11, portal: 172.16.0.220,3260] successful.
Nov 30 12:45:06 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0476fa25-1671-4692-a6df-0f425be94b4a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Cannot resize image /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Ensure instance console log exists: /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[345ca1c0-ab6b-482f-ac86-769880e4146f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:06 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)
Nov 30 12:45:06 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:06 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8007324-af42-4b6b-a85e-16d8eb04203c]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:06 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: None {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Successfully updated port: c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "refresh_cache-4372bad4-2959-4c6f-bde0-29c8ecb166b7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquired lock "refresh_cache-4372bad4-2959-4c6f-bde0-29c8ecb166b7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-f251f79a-a301-4ea7-97d0-f7634f20b719 req-4261bd16-d277-4f94-8896-6d1128275269 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received event network-changed-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-f251f79a-a301-4ea7-97d0-f7634f20b719 req-4261bd16-d277-4f94-8896-6d1128275269 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Refreshing instance network info cache due to event network-changed-c4ce626e-d884-4b19-a03a-55ca1085e3be. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f251f79a-a301-4ea7-97d0-f7634f20b719 req-4261bd16-d277-4f94-8896-6d1128275269 service nova] Acquiring lock "refresh_cache-4372bad4-2959-4c6f-bde0-29c8ecb166b7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Updating instance_info_cache with network_info: [{"id": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "address": "fa:16:3e:87:75:c8", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ce626e-d8", "ovs_interfaceid": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Releasing lock "refresh_cache-4372bad4-2959-4c6f-bde0-29c8ecb166b7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Instance network_info: |[{"id": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "address": "fa:16:3e:87:75:c8", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ce626e-d8", "ovs_interfaceid": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f251f79a-a301-4ea7-97d0-f7634f20b719 req-4261bd16-d277-4f94-8896-6d1128275269 service nova] Acquired lock "refresh_cache-4372bad4-2959-4c6f-bde0-29c8ecb166b7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.network.neutron [req-f251f79a-a301-4ea7-97d0-f7634f20b719 req-4261bd16-d277-4f94-8896-6d1128275269 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Refreshing network info cache for port c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Start _get_guest_xml network_info=[{"id": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "address": "fa:16:3e:87:75:c8", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ce626e-d8", "ovs_interfaceid": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:45:07 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:45:07 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:45:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1207437810',display_name='tempest-VolumesActionsTest-instance-1207437810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1207437810',id=33,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa5dfd98cc2e410db49639a642b13975',ramdisk_id='',reservation_id='r-vmayfj0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-364551348',owner_user_name='tempest-VolumesActionsTest-364551348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:45:06Z,user_data=None,user_id='abe9ecbcfe7e444c9946400a062e2b7a',uuid=4372bad4-2959-4c6f-bde0-29c8ecb166b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "address": "fa:16:3e:87:75:c8", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ce626e-d8", "ovs_interfaceid": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Converting VIF {"id": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "address": "fa:16:3e:87:75:c8", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ce626e-d8", "ovs_interfaceid": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:75:c8,bridge_name='br-int',has_traffic_filtering=True,id=c4ce626e-d884-4b19-a03a-55ca1085e3be,network=Network(ad88a05e-9702-4570-8363-f905f54e7c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ce626e-d8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lazy-loading 'pci_devices' on Instance uuid 4372bad4-2959-4c6f-bde0-29c8ecb166b7 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:45:07 user nova-compute[75672]:   <uuid>4372bad4-2959-4c6f-bde0-29c8ecb166b7</uuid>
Nov 30 12:45:07 user nova-compute[75672]:   <name>instance-00000021</name>
Nov 30 12:45:07 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:45:07 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:45:07 user nova-compute[75672]:   <metadata>
Nov 30 12:45:07 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:45:07 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:45:07 user nova-compute[75672]:       <nova:name>tempest-VolumesActionsTest-instance-1207437810</nova:name>
Nov 30 12:45:07 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:45:07</nova:creationTime>
Nov 30 12:45:07 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:45:07 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:45:07 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:45:07 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:45:07 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:45:07 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:45:07 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:45:07 user nova-compute[75672]:       <nova:owner>
Nov 30 12:45:07 user nova-compute[75672]:         <nova:user uuid="abe9ecbcfe7e444c9946400a062e2b7a">tempest-VolumesActionsTest-364551348-project-member</nova:user>
Nov 30 12:45:07 user nova-compute[75672]:         <nova:project uuid="aa5dfd98cc2e410db49639a642b13975">tempest-VolumesActionsTest-364551348</nova:project>
Nov 30 12:45:07 user nova-compute[75672]:       </nova:owner>
Nov 30 12:45:07 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:45:07 user nova-compute[75672]:       <nova:ports>
Nov 30 12:45:07 user nova-compute[75672]:         <nova:port uuid="c4ce626e-d884-4b19-a03a-55ca1085e3be">
Nov 30 12:45:07 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 12:45:07 user nova-compute[75672]:         </nova:port>
Nov 30 12:45:07 user nova-compute[75672]:       </nova:ports>
Nov 30 12:45:07 user nova-compute[75672]:     </nova:instance>
Nov 30 12:45:07 user nova-compute[75672]:   </metadata>
Nov 30 12:45:07 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:45:07 user nova-compute[75672]:     <system>
Nov 30 12:45:07 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:45:07 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:45:07 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:45:07 user nova-compute[75672]:       <entry name="serial">4372bad4-2959-4c6f-bde0-29c8ecb166b7</entry>
Nov 30 12:45:07 user nova-compute[75672]:       <entry name="uuid">4372bad4-2959-4c6f-bde0-29c8ecb166b7</entry>
Nov 30 12:45:07 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:45:07 user nova-compute[75672]:     </system>
Nov 30 12:45:07 user nova-compute[75672]:   </sysinfo>
Nov 30 12:45:07 user nova-compute[75672]:   <os>
Nov 30 12:45:07 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:45:07 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:45:07 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:45:07 user nova-compute[75672]:   </os>
Nov 30 12:45:07 user nova-compute[75672]:   <features>
Nov 30 12:45:07 user nova-compute[75672]:     <acpi/>
Nov 30 12:45:07 user nova-compute[75672]:     <apic/>
Nov 30 12:45:07 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:45:07 user nova-compute[75672]:   </features>
Nov 30 12:45:07 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:45:07 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:45:07 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:45:07 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:45:07 user nova-compute[75672]:   </clock>
Nov 30 12:45:07 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:45:07 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:45:07 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:45:07 user nova-compute[75672]:   </cpu>
Nov 30 12:45:07 user nova-compute[75672]:   <devices>
Nov 30 12:45:07 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:45:07 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:45:07 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk"/>
Nov 30 12:45:07 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:45:07 user nova-compute[75672]:     </disk>
Nov 30 12:45:07 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:45:07 user nova-compute[75672]:       <mac address="fa:16:3e:87:75:c8"/>
Nov 30 12:45:07 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:45:07 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:45:07 user nova-compute[75672]:       <target dev="tapc4ce626e-d8"/>
Nov 30 12:45:07 user nova-compute[75672]:     </interface>
Nov 30 12:45:07 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:45:07 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/console.log" append="off"/>
Nov 30 12:45:07 user nova-compute[75672]:     </serial>
Nov 30 12:45:07 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:45:07 user nova-compute[75672]:     <video>
Nov 30 12:45:07 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:45:07 user nova-compute[75672]:     </video>
Nov 30 12:45:07 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:45:07 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:45:07 user nova-compute[75672]:     </rng>
Nov 30 12:45:07 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:45:07 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:45:07 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:45:07 user nova-compute[75672]:     </memballoon>
Nov 30 12:45:07 user nova-compute[75672]:   </devices>
Nov 30 12:45:07 user nova-compute[75672]: </domain>
Nov 30 12:45:07 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:45:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1207437810',display_name='tempest-VolumesActionsTest-instance-1207437810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1207437810',id=33,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa5dfd98cc2e410db49639a642b13975',ramdisk_id='',reservation_id='r-vmayfj0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-364551348',owner_user_name='tempest-VolumesActionsTest-364551348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:45:06Z,user_data=None,user_id='abe9ecbcfe7e444c9946400a062e2b7a',uuid=4372bad4-2959-4c6f-bde0-29c8ecb166b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "address": "fa:16:3e:87:75:c8", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ce626e-d8", "ovs_interfaceid": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Converting VIF {"id": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "address": "fa:16:3e:87:75:c8", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ce626e-d8", "ovs_interfaceid": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:75:c8,bridge_name='br-int',has_traffic_filtering=True,id=c4ce626e-d884-4b19-a03a-55ca1085e3be,network=Network(ad88a05e-9702-4570-8363-f905f54e7c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ce626e-d8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG os_vif [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:75:c8,bridge_name='br-int',has_traffic_filtering=True,id=c4ce626e-d884-4b19-a03a-55ca1085e3be,network=Network(ad88a05e-9702-4570-8363-f905f54e7c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ce626e-d8') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7bde11d-d5bf-5df0-b9ad-79db6cdb5df8', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4ce626e-d8, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4ce626e-d8, col_values=(('qos', UUID('5a3228c7-c07b-4d9d-a3a2-33097805aa13')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4ce626e-d8, col_values=(('external_ids', {'iface-id': 'c4ce626e-d884-4b19-a03a-55ca1085e3be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:75:c8', 'vm-uuid': '4372bad4-2959-4c6f-bde0-29c8ecb166b7'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:07 user nova-compute[75672]: INFO os_vif [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:75:c8,bridge_name='br-int',has_traffic_filtering=True,id=c4ce626e-d884-4b19-a03a-55ca1085e3be,network=Network(ad88a05e-9702-4570-8363-f905f54e7c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ce626e-d8')
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] No VIF found with MAC fa:16:3e:87:75:c8, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlcdouNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23130333932323734', 'path': '/dev/sdf'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130333932323734', 'path': '/dev/sdf'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.objects.instance [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'flavor' on Instance uuid 044e4031-8381-4e7f-a5ac-1a074e00497e {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:45:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:45:07 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:45:07 user nova-compute[75672]:   <source dev="/dev/sdf"/>
Nov 30 12:45:07 user nova-compute[75672]:   <target dev="vdc" bus="virtio"/>
Nov 30 12:45:07 user nova-compute[75672]:   <serial>dc75033f-38c0-468e-961e-904c40c99c11</serial>
Nov 30 12:45:07 user nova-compute[75672]: </disk>
Nov 30 12:45:07 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:45:08 user nova-compute[75672]: DEBUG nova.network.neutron [req-f251f79a-a301-4ea7-97d0-f7634f20b719 req-4261bd16-d277-4f94-8896-6d1128275269 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Updated VIF entry in instance network info cache for port c4ce626e-d884-4b19-a03a-55ca1085e3be. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:45:08 user nova-compute[75672]: DEBUG nova.network.neutron [req-f251f79a-a301-4ea7-97d0-f7634f20b719 req-4261bd16-d277-4f94-8896-6d1128275269 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Updating instance_info_cache with network_info: [{"id": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "address": "fa:16:3e:87:75:c8", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ce626e-d8", "ovs_interfaceid": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f251f79a-a301-4ea7-97d0-f7634f20b719 req-4261bd16-d277-4f94-8896-6d1128275269 service nova] Releasing lock "refresh_cache-4372bad4-2959-4c6f-bde0-29c8ecb166b7" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:45:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:45:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:45:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:45:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] No VIF found with MAC fa:16:3e:0a:af:87, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:45:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-388d4875-cd2d-48ed-a9a9-957f0083785a tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.069s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-1f4b3724-6a13-470d-bfee-ec2162e71278 req-eeaf7ce2-92be-49a4-92a8-68012efaa310 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received event network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1f4b3724-6a13-470d-bfee-ec2162e71278 req-eeaf7ce2-92be-49a4-92a8-68012efaa310 service nova] Acquiring lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1f4b3724-6a13-470d-bfee-ec2162e71278 req-eeaf7ce2-92be-49a4-92a8-68012efaa310 service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1f4b3724-6a13-470d-bfee-ec2162e71278 req-eeaf7ce2-92be-49a4-92a8-68012efaa310 service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-1f4b3724-6a13-470d-bfee-ec2162e71278 req-eeaf7ce2-92be-49a4-92a8-68012efaa310 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] No waiting events found dispatching network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:09 user nova-compute[75672]: WARNING nova.compute.manager [req-1f4b3724-6a13-470d-bfee-ec2162e71278 req-eeaf7ce2-92be-49a4-92a8-68012efaa310 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received unexpected event network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be for instance with vm_state building and task_state spawning.
Nov 30 12:45:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "044e4031-8381-4e7f-a5ac-1a074e00497e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:10 user nova-compute[75672]: INFO nova.compute.manager [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Detaching volume 15a44637-6640-4e09-be01-c77186074903
Nov 30 12:45:10 user nova-compute[75672]: INFO nova.virt.block_device [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Attempting to driver detach volume 15a44637-6640-4e09-be01-c77186074903 from mountpoint /dev/vdb
Nov 30 12:45:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Attempting to detach device vdb from instance 044e4031-8381-4e7f-a5ac-1a074e00497e from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:45:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:45:10 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:45:10 user nova-compute[75672]:   <source dev="/dev/sdd"/>
Nov 30 12:45:10 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:45:10 user nova-compute[75672]:   <serial>15a44637-6640-4e09-be01-c77186074903</serial>
Nov 30 12:45:10 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:45:10 user nova-compute[75672]: </disk>
Nov 30 12:45:10 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:45:10 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Successfully detached device vdb from instance 044e4031-8381-4e7f-a5ac-1a074e00497e from the persistent domain config.
Nov 30 12:45:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 044e4031-8381-4e7f-a5ac-1a074e00497e from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:45:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:45:10 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:45:10 user nova-compute[75672]:   <source dev="/dev/sdd"/>
Nov 30 12:45:10 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:45:10 user nova-compute[75672]:   <serial>15a44637-6640-4e09-be01-c77186074903</serial>
Nov 30 12:45:10 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:45:10 user nova-compute[75672]: </disk>
Nov 30 12:45:10 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:45:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 044e4031-8381-4e7f-a5ac-1a074e00497e {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:45:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:11 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:45:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:45:11 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Instance spawned successfully.
Nov 30 12:45:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:45:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-e971d554-36b4-4e70-a21a-a6576f654597 req-cb48de62-d6b1-4de6-aa0e-8b992ab93e9f service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received event network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e971d554-36b4-4e70-a21a-a6576f654597 req-cb48de62-d6b1-4de6-aa0e-8b992ab93e9f service nova] Acquiring lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e971d554-36b4-4e70-a21a-a6576f654597 req-cb48de62-d6b1-4de6-aa0e-8b992ab93e9f service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e971d554-36b4-4e70-a21a-a6576f654597 req-cb48de62-d6b1-4de6-aa0e-8b992ab93e9f service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-e971d554-36b4-4e70-a21a-a6576f654597 req-cb48de62-d6b1-4de6-aa0e-8b992ab93e9f service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] No waiting events found dispatching network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:11 user nova-compute[75672]: WARNING nova.compute.manager [req-e971d554-36b4-4e70-a21a-a6576f654597 req-cb48de62-d6b1-4de6-aa0e-8b992ab93e9f service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received unexpected event network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be for instance with vm_state building and task_state spawning.
Nov 30 12:45:11 user nova-compute[75672]: INFO nova.compute.manager [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 30 12:45:11 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:45:11 user nova-compute[75672]: INFO nova.compute.manager [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Took 6.30 seconds to build instance.
Nov 30 12:45:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c82b7263-2a6d-4de4-919e-9a598afb6506 tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.395s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "47ac940e-edbd-4732-ac04-e242709ee894" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:45:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:14 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:45:14 user nova-compute[75672]: INFO nova.compute.claims [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Claim successful on node user
Nov 30 12:45:14 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:45:14 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:45:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:45:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:45:14 user nova-compute[75672]: DEBUG nova.network.neutron [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:45:14 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:45:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:45:15 user nova-compute[75672]: DEBUG nova.policy [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa5b3c989c934220a07aba162e68ea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47874c48ecea456eac7968640910afba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:45:15 user nova-compute[75672]: INFO nova.virt.block_device [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Booting with blank volume at /dev/vda
Nov 30 12:45:15 user nova-compute[75672]: DEBUG nova.network.neutron [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Successfully created port: e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:45:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:16 user nova-compute[75672]: DEBUG nova.network.neutron [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Successfully updated port: e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:45:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:45:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquired lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:45:16 user nova-compute[75672]: DEBUG nova.network.neutron [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:45:16 user nova-compute[75672]: DEBUG nova.compute.manager [req-c5d5112e-2027-48c6-94a1-9ee2cb45b0c9 req-b59dbc30-4537-49e0-a66f-87e7d15bb6aa service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-changed-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:16 user nova-compute[75672]: DEBUG nova.compute.manager [req-c5d5112e-2027-48c6-94a1-9ee2cb45b0c9 req-b59dbc30-4537-49e0-a66f-87e7d15bb6aa service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Refreshing instance network info cache due to event network-changed-e153586a-8cf1-4e2d-838d-a0eadd151858. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:45:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c5d5112e-2027-48c6-94a1-9ee2cb45b0c9 req-b59dbc30-4537-49e0-a66f-87e7d15bb6aa service nova] Acquiring lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:45:16 user nova-compute[75672]: DEBUG nova.network.neutron [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:45:17 user nova-compute[75672]: DEBUG nova.network.neutron [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Updating instance_info_cache with network_info: [{"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Releasing lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:45:17 user nova-compute[75672]: DEBUG nova.compute.manager [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Instance network_info: |[{"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:45:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c5d5112e-2027-48c6-94a1-9ee2cb45b0c9 req-b59dbc30-4537-49e0-a66f-87e7d15bb6aa service nova] Acquired lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:45:17 user nova-compute[75672]: DEBUG nova.network.neutron [req-c5d5112e-2027-48c6-94a1-9ee2cb45b0c9 req-b59dbc30-4537-49e0-a66f-87e7d15bb6aa service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Refreshing network info cache for port e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:45:17 user nova-compute[75672]: DEBUG nova.network.neutron [req-c5d5112e-2027-48c6-94a1-9ee2cb45b0c9 req-b59dbc30-4537-49e0-a66f-87e7d15bb6aa service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Updated VIF entry in instance network info cache for port e153586a-8cf1-4e2d-838d-a0eadd151858. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:45:17 user nova-compute[75672]: DEBUG nova.network.neutron [req-c5d5112e-2027-48c6-94a1-9ee2cb45b0c9 req-b59dbc30-4537-49e0-a66f-87e7d15bb6aa service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Updating instance_info_cache with network_info: [{"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c5d5112e-2027-48c6-94a1-9ee2cb45b0c9 req-b59dbc30-4537-49e0-a66f-87e7d15bb6aa service nova] Releasing lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:45:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:19 user nova-compute[75672]: INFO nova.compute.manager [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Terminating instance
Nov 30 12:45:19 user nova-compute[75672]: DEBUG nova.compute.manager [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG nova.compute.manager [req-8be08fdb-7e03-4f65-bdda-74e4f7542d1a req-0bc78878-b010-4157-94dc-3c693be1a2da service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-vif-unplugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8be08fdb-7e03-4f65-bdda-74e4f7542d1a req-0bc78878-b010-4157-94dc-3c693be1a2da service nova] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8be08fdb-7e03-4f65-bdda-74e4f7542d1a req-0bc78878-b010-4157-94dc-3c693be1a2da service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8be08fdb-7e03-4f65-bdda-74e4f7542d1a req-0bc78878-b010-4157-94dc-3c693be1a2da service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG nova.compute.manager [req-8be08fdb-7e03-4f65-bdda-74e4f7542d1a req-0bc78878-b010-4157-94dc-3c693be1a2da service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] No waiting events found dispatching network-vif-unplugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG nova.compute.manager [req-8be08fdb-7e03-4f65-bdda-74e4f7542d1a req-0bc78878-b010-4157-94dc-3c693be1a2da service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-vif-unplugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:45:19 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Instance destroyed successfully.
Nov 30 12:45:19 user nova-compute[75672]: DEBUG nova.objects.instance [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lazy-loading 'resources' on Instance uuid 9db955e1-4b9b-4627-b604-5f07ef8e5ad4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-288700133',display_name='tempest-TestMinimumBasicScenario-server-288700133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-288700133',id=24,image_ref='1fd06ffb-4611-4ca5-a581-f0dfec4e24a8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+NKdDgCCLODYWhObm6nfZvQ+lqNaHUCf/r3dsyiCFT7WQ5ffknXihC91em5wy/sgYFziPZ0GCJqHlF8dRTe3+FiZwbYva78zPGlah21XeEQmQAOsySHLYariVK0Ca3KA==',key_name='tempest-TestMinimumBasicScenario-123450134',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:40:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc2e7dfcbff457c9e394b1e5d0d23e6',ramdisk_id='',reservation_id='r-pio6fc7w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1fd06ffb-4611-4ca5-a581-f0dfec4e24a8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-950497565',owner_user_name='tempest-TestMinimumBasicScenario-950497565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:42:39Z,user_data=None,user_id='c663fb001aa64ec6a8e5861449ec2bbb',uuid=9db955e1-4b9b-4627-b604-5f07ef8e5ad4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "address": "fa:16:3e:bd:1f:55", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9e56c6-c3", "ovs_interfaceid": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converting VIF {"id": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "address": "fa:16:3e:bd:1f:55", "network": {"id": "29dd691f-ac91-423b-9854-d353ff1b23a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1490898087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc2e7dfcbff457c9e394b1e5d0d23e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9e56c6-c3", "ovs_interfaceid": "1a9e56c6-c320-4afe-9ae3-d1ddca150724", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:1f:55,bridge_name='br-int',has_traffic_filtering=True,id=1a9e56c6-c320-4afe-9ae3-d1ddca150724,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9e56c6-c3') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG os_vif [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:1f:55,bridge_name='br-int',has_traffic_filtering=True,id=1a9e56c6-c320-4afe-9ae3-d1ddca150724,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9e56c6-c3') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a9e56c6-c3, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95f8eac6-d7ff-46fb-9610-d80813042c7f) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:19 user nova-compute[75672]: INFO os_vif [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:1f:55,bridge_name='br-int',has_traffic_filtering=True,id=1a9e56c6-c320-4afe-9ae3-d1ddca150724,network=Network(29dd691f-ac91-423b-9854-d353ff1b23a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9e56c6-c3')
Nov 30 12:45:19 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Deleting instance files /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4_del
Nov 30 12:45:19 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Deletion of /opt/stack/data/nova/instances/9db955e1-4b9b-4627-b604-5f07ef8e5ad4_del complete
Nov 30 12:45:20 user nova-compute[75672]: INFO nova.compute.manager [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:20 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Took 0.57 seconds to deallocate network for instance.
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG os_brick.utils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2548f475-0ed3-4d0f-9470-3d1993cbde0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[248ae5a2-f853-4917-bc5d-cd26e5cabd3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd62171-01e8-45f4-85b5-cdcf4e0da34d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc9e0ed-80dd-4c54-8d22-bb8eb67df234]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:45:20 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:45:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[40612b05-265c-4d93-b629-0ad69d627c86]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG os_brick.utils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:45:20 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Updating existing volume attachment record: 5f55fde7-ed77-497a-b435-c238f0ed5550 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.658s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:21 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Deleted allocations for instance 9db955e1-4b9b-4627-b604-5f07ef8e5ad4
Nov 30 12:45:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-267c16e5-c0c7-4c11-871f-51270f508c82 req-7fb1781c-5465-4f64-ad71-38e60db4b4f3 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-267c16e5-c0c7-4c11-871f-51270f508c82 req-7fb1781c-5465-4f64-ad71-38e60db4b4f3 service nova] Acquiring lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-267c16e5-c0c7-4c11-871f-51270f508c82 req-7fb1781c-5465-4f64-ad71-38e60db4b4f3 service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-267c16e5-c0c7-4c11-871f-51270f508c82 req-7fb1781c-5465-4f64-ad71-38e60db4b4f3 service nova] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-267c16e5-c0c7-4c11-871f-51270f508c82 req-7fb1781c-5465-4f64-ad71-38e60db4b4f3 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] No waiting events found dispatching network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:21 user nova-compute[75672]: WARNING nova.compute.manager [req-267c16e5-c0c7-4c11-871f-51270f508c82 req-7fb1781c-5465-4f64-ad71-38e60db4b4f3 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received unexpected event network-vif-plugged-1a9e56c6-c320-4afe-9ae3-d1ddca150724 for instance with vm_state deleted and task_state None.
Nov 30 12:45:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-267c16e5-c0c7-4c11-871f-51270f508c82 req-7fb1781c-5465-4f64-ad71-38e60db4b4f3 service nova] [instance: 9db955e1-4b9b-4627-b604-5f07ef8e5ad4] Received event network-vif-deleted-1a9e56c6-c320-4afe-9ae3-d1ddca150724 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-13238601-9dc8-4244-bb9a-1c0f81209d55 tempest-TestMinimumBasicScenario-950497565 tempest-TestMinimumBasicScenario-950497565-project-member] Lock "9db955e1-4b9b-4627-b604-5f07ef8e5ad4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.410s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "0a41ad0b-978b-4931-a30c-573e20f166a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:21 user nova-compute[75672]: INFO nova.compute.manager [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Terminating instance
Nov 30 12:45:21 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG nova.compute.manager [req-f8256ad9-bca9-4935-b35a-1f8900f0d9b4 req-ca4bc330-9c8c-448c-ba7d-0ad5b3d9a4cc service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received event network-vif-unplugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f8256ad9-bca9-4935-b35a-1f8900f0d9b4 req-ca4bc330-9c8c-448c-ba7d-0ad5b3d9a4cc service nova] Acquiring lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f8256ad9-bca9-4935-b35a-1f8900f0d9b4 req-ca4bc330-9c8c-448c-ba7d-0ad5b3d9a4cc service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f8256ad9-bca9-4935-b35a-1f8900f0d9b4 req-ca4bc330-9c8c-448c-ba7d-0ad5b3d9a4cc service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG nova.compute.manager [req-f8256ad9-bca9-4935-b35a-1f8900f0d9b4 req-ca4bc330-9c8c-448c-ba7d-0ad5b3d9a4cc service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] No waiting events found dispatching network-vif-unplugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG nova.compute.manager [req-f8256ad9-bca9-4935-b35a-1f8900f0d9b4 req-ca4bc330-9c8c-448c-ba7d-0ad5b3d9a4cc service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received event network-vif-unplugged-4a57924f-2da2-49db-9db8-3ee51193d52d for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:22 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Instance destroyed successfully.
Nov 30 12:45:22 user nova-compute[75672]: DEBUG nova.objects.instance [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lazy-loading 'resources' on Instance uuid 0a41ad0b-978b-4931-a30c-573e20f166a8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:40:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1408614858',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1408614858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1408614858',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5JXvu5nEJT82w4GUYAY25ltXp/bf9JoyLCMso/vG1vdn4ljM1yWs+9MEfmAZ9b8ximDYMFDPbN9X7uDRTfSLJom/g3ZmGMwUFzIezl/NNGjMK02KLxodEiE4Iz07DxEg==',key_name='tempest-keypair-356641453',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:40:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-jbi87e8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=0a41ad0b-978b-4931-a30c-573e20f166a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a57924f-2da2-49db-9db8-3ee51193d52d", "address": "fa:16:3e:6d:59:18", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57924f-2d", "ovs_interfaceid": "4a57924f-2da2-49db-9db8-3ee51193d52d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "4a57924f-2da2-49db-9db8-3ee51193d52d", "address": "fa:16:3e:6d:59:18", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a57924f-2d", "ovs_interfaceid": "4a57924f-2da2-49db-9db8-3ee51193d52d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:59:18,bridge_name='br-int',has_traffic_filtering=True,id=4a57924f-2da2-49db-9db8-3ee51193d52d,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57924f-2d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_vif [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:59:18,bridge_name='br-int',has_traffic_filtering=True,id=4a57924f-2da2-49db-9db8-3ee51193d52d,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57924f-2d') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a57924f-2d, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a311aa0-eb39-496a-a461-2567166cce7a) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:22 user nova-compute[75672]: INFO os_vif [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:59:18,bridge_name='br-int',has_traffic_filtering=True,id=4a57924f-2da2-49db-9db8-3ee51193d52d,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a57924f-2d')
Nov 30 12:45:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfUdoLSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:45:22 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.052s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[38efd486-c330-4b4d-8bc1-3a4f3b2fe99d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:45:22 user nova-compute[75672]: No targets found.
Nov 30 12:45:22 user nova-compute[75672]: iSNS:
Nov 30 12:45:22 user nova-compute[75672]: No targets found.
Nov 30 12:45:22 user nova-compute[75672]: STATIC:
Nov 30 12:45:22 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016
Nov 30 12:45:22 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:22 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:22 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903
Nov 30 12:45:22 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:22 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:22 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b
Nov 30 12:45:22 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:22 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:22 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480
Nov 30 12:45:22 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:22 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:22 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11
Nov 30 12:45:22 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:22 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:22 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff
Nov 30 12:45:22 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:22 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:22 user nova-compute[75672]: FIRMWARE:
Nov 30 12:45:22 user nova-compute[75672]: No targets found.
Nov 30 12:45:22 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:45:22 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:45:22 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[29902784-4e93-4424-818e-07f07063b50f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d93c2b-6b43-4f80-962c-5b1cf2ba1193]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:45:22 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:22 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:22 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:22 user nova-compute[75672]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)
Nov 30 12:45:22 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:22 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 (non-flash)
Nov 30 12:45:22 user nova-compute[75672]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:22 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:22 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:22 user nova-compute[75672]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)
Nov 30 12:45:22 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:22 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcb463b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480'): ({'sde'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Removing single pathed devices sde {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e7d176-0e95-41ab-bc5d-0b1c4bc68700]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7da2e7-70bc-4e05-b36d-cea9f8ff214a]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flushing IO for device /dev/sde {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ab679a-5a05-4ad0-99c1-d321d9aad676]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.091s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e646936a-9e94-4528-ae91-3bcefe522881]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] SCSI volumes sde have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOcf4e758c-287ccbb02842883b', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cf4e758c', '/dev/disk/by-id/scsi-23238376363626230') {{(pid=86963) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 12:45:22 user nova-compute[75672]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOcf4e758c-287ccbb02842883b
Nov 30 12:45:22 user nova-compute[75672]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_cf4e758c
Nov 30 12:45:22 user nova-compute[75672]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23238376363626230
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[39746317-79f6-49be-a2de-579c8c7276b8]: (4, None) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:45:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26d1e91-67b4-4fa1-9970-049b90277aa4]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb9f6d2-9392-438c-a99e-39ba66522a31]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480, portal: 172.16.0.220,3260]
Nov 30 12:45:23 user nova-compute[75672]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480, portal: 172.16.0.220,3260] successful.
Nov 30 12:45:23 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caee8471-7089-44b3-889a-56cc0df84480 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbcd8fb-8a2a-4fc8-aa3c-517368c2c587]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.502s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== disconnect_volume: return (504ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:45:23 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Deleting instance files /opt/stack/data/nova/instances/0a41ad0b-978b-4931-a30c-573e20f166a8_del
Nov 30 12:45:23 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Deletion of /opt/stack/data/nova/instances/0a41ad0b-978b-4931-a30c-573e20f166a8_del complete
Nov 30 12:45:23 user nova-compute[75672]: INFO nova.compute.manager [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Took 1.48 seconds to destroy the instance on the hypervisor.
Nov 30 12:45:23 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received event network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Acquiring lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] No waiting events found dispatching network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:24 user nova-compute[75672]: WARNING nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received unexpected event network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d for instance with vm_state active and task_state deleting.
Nov 30 12:45:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received event network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Acquiring lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] No waiting events found dispatching network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:24 user nova-compute[75672]: WARNING nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received unexpected event network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d for instance with vm_state active and task_state deleting.
Nov 30 12:45:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received event network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Acquiring lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] No waiting events found dispatching network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:24 user nova-compute[75672]: WARNING nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received unexpected event network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d for instance with vm_state active and task_state deleting.
Nov 30 12:45:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received event network-vif-unplugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Acquiring lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] No waiting events found dispatching network-vif-unplugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received event network-vif-unplugged-4a57924f-2da2-49db-9db8-3ee51193d52d for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received event network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Acquiring lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] No waiting events found dispatching network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:24 user nova-compute[75672]: WARNING nova.compute.manager [req-bd1ec8c5-6e9c-4985-9857-46fd49e6e2f2 req-b2cb8e45-b3b9-409a-8e04-9a768c4aba86 service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received unexpected event network-vif-plugged-4a57924f-2da2-49db-9db8-3ee51193d52d for instance with vm_state active and task_state deleting.
Nov 30 12:45:24 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:24 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Took 1.29 seconds to deallocate network for instance.
Nov 30 12:45:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-a688b2d5-8bea-4fbf-824a-80121b832f98 req-ff7dbcf2-c427-494c-9469-324b7a93827c service nova] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Received event network-vif-deleted-4a57924f-2da2-49db-9db8-3ee51193d52d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:25 user nova-compute[75672]: INFO nova.compute.manager [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Took 1.16 seconds to detach 1 volumes for instance.
Nov 30 12:45:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 0a41ad0b-978b-4931-a30c-573e20f166a8] Deleting volume: caee8471-7089-44b3-889a-56cc0df84480 {{(pid=75672) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 12:45:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:25 user nova-compute[75672]: INFO nova.compute.manager [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Terminating instance
Nov 30 12:45:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "87744aef-7e32-475b-907e-e30702d083bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.672s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.222s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:45:26 user nova-compute[75672]: INFO nova.compute.claims [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Claim successful on node user
Nov 30 12:45:26 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Deleted allocations for instance 0a41ad0b-978b-4931-a30c-573e20f166a8
Nov 30 12:45:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f7d2a1dc-99c2-4ce3-8518-30b4b3604fb2 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "0a41ad0b-978b-4931-a30c-573e20f166a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.919s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-990d6d83-3f7a-40c6-bf53-76ae05100d38 req-99e1a2a6-4fbb-4f11-b52f-69194a13b374 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Received event network-changed-7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-990d6d83-3f7a-40c6-bf53-76ae05100d38 req-99e1a2a6-4fbb-4f11-b52f-69194a13b374 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Refreshing instance network info cache due to event network-changed-7513ca6e-ee52-47e2-a2cb-428f6013ca40. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-990d6d83-3f7a-40c6-bf53-76ae05100d38 req-99e1a2a6-4fbb-4f11-b52f-69194a13b374 service nova] Acquiring lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-990d6d83-3f7a-40c6-bf53-76ae05100d38 req-99e1a2a6-4fbb-4f11-b52f-69194a13b374 service nova] Acquired lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG nova.network.neutron [req-990d6d83-3f7a-40c6-bf53-76ae05100d38 req-99e1a2a6-4fbb-4f11-b52f-69194a13b374 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Refreshing network info cache for port 7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:45:26 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Instance destroyed successfully.
Nov 30 12:45:26 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lazy-loading 'resources' on Instance uuid 9ae3632c-e9ad-4bef-9ed9-5571d054b06e {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1583209056',display_name='tempest-AttachVolumeNegativeTest-server-1583209056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1583209056',id=29,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE687QuW++RQm8Z9JnDbnSsrn8EPF/pb1f7HuO22CByZWSwGVivxVdLZpTslZkBbIfSx5c/WfotHrlFenhYCyjT87Z/Nn5FoGsFix3lrQA4OGjI0MIjU4f0p3CfZUsAx4w==',key_name='tempest-keypair-1622503333',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:42:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04f07019e3584771af197e865b6877cc',ramdisk_id='',reservation_id='r-51bqemz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1224349538',owner_user_name='tempest-AttachVolumeNegativeTest-1224349538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:42:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3166f2b3dee4aa4aa738f1f15ca7d19',uuid=9ae3632c-e9ad-4bef-9ed9-5571d054b06e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "address": "fa:16:3e:8a:e2:85", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3804f22-1b", "ovs_interfaceid": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converting VIF {"id": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "address": "fa:16:3e:8a:e2:85", "network": {"id": "809d0af5-a697-4f38-8e96-2096779178e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-296922396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f07019e3584771af197e865b6877cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3804f22-1b", "ovs_interfaceid": "c3804f22-1bd2-4813-bf7b-dd6d372f199e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:e2:85,bridge_name='br-int',has_traffic_filtering=True,id=c3804f22-1bd2-4813-bf7b-dd6d372f199e,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3804f22-1b') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG os_vif [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:e2:85,bridge_name='br-int',has_traffic_filtering=True,id=c3804f22-1bd2-4813-bf7b-dd6d372f199e,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3804f22-1b') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3804f22-1b, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0d7523c-23f0-4937-880c-ce1e4fd8ee3e) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:26 user nova-compute[75672]: INFO os_vif [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:e2:85,bridge_name='br-int',has_traffic_filtering=True,id=c3804f22-1bd2-4813-bf7b-dd6d372f199e,network=Network(809d0af5-a697-4f38-8e96-2096779178e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3804f22-1b')
Nov 30 12:45:26 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Deleting instance files /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e_del
Nov 30 12:45:26 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Deletion of /opt/stack/data/nova/instances/9ae3632c-e9ad-4bef-9ed9-5571d054b06e_del complete
Nov 30 12:45:26 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:45:27 user nova-compute[75672]: INFO nova.compute.manager [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:45:27 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:45:27 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Creating image(s)
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "/opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "/opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "/opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-9f41c983-e570-4ee4-9213-206f49151ec7 req-f4926421-1a87-4ef9-8870-689bb6905283 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Received event network-vif-unplugged-c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9f41c983-e570-4ee4-9213-206f49151ec7 req-f4926421-1a87-4ef9-8870-689bb6905283 service nova] Acquiring lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9f41c983-e570-4ee4-9213-206f49151ec7 req-f4926421-1a87-4ef9-8870-689bb6905283 service nova] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9f41c983-e570-4ee4-9213-206f49151ec7 req-f4926421-1a87-4ef9-8870-689bb6905283 service nova] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-9f41c983-e570-4ee4-9213-206f49151ec7 req-f4926421-1a87-4ef9-8870-689bb6905283 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] No waiting events found dispatching network-vif-unplugged-c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-9f41c983-e570-4ee4-9213-206f49151ec7 req-f4926421-1a87-4ef9-8870-689bb6905283 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Received event network-vif-unplugged-c3804f22-1bd2-4813-bf7b-dd6d372f199e for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.policy [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5019d84b3bb436f9125865467cbb702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bdd4c8e1345209fa532c6fd9496dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.195s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk 1073741824" returned: 0 in 0.064s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.network.neutron [req-990d6d83-3f7a-40c6-bf53-76ae05100d38 req-99e1a2a6-4fbb-4f11-b52f-69194a13b374 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updated VIF entry in instance network info cache for port 7513ca6e-ee52-47e2-a2cb-428f6013ca40. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.network.neutron [req-990d6d83-3f7a-40c6-bf53-76ae05100d38 req-99e1a2a6-4fbb-4f11-b52f-69194a13b374 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updating instance_info_cache with network_info: [{"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.247s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:45:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-990d6d83-3f7a-40c6-bf53-76ae05100d38 req-99e1a2a6-4fbb-4f11-b52f-69194a13b374 service nova] Releasing lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Cannot resize image /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Ensure instance console log exists: /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:28 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Took 1.68 seconds to deallocate network for instance.
Nov 30 12:45:28 user nova-compute[75672]: DEBUG nova.compute.manager [req-3e0b9f42-b179-4c8c-bd71-42f91ea63f1e req-4e20c35c-7228-483b-9574-1cc5d775e72f service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Received event network-vif-deleted-c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:28 user nova-compute[75672]: INFO nova.compute.manager [req-3e0b9f42-b179-4c8c-bd71-42f91ea63f1e req-4e20c35c-7228-483b-9574-1cc5d775e72f service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Neutron deleted interface c3804f22-1bd2-4813-bf7b-dd6d372f199e; detaching it from the instance and deleting it from the info cache
Nov 30 12:45:28 user nova-compute[75672]: DEBUG nova.network.neutron [req-3e0b9f42-b179-4c8c-bd71-42f91ea63f1e req-4e20c35c-7228-483b-9574-1cc5d775e72f service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG nova.compute.manager [req-3e0b9f42-b179-4c8c-bd71-42f91ea63f1e req-4e20c35c-7228-483b-9574-1cc5d775e72f service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Detach interface failed, port_id=c3804f22-1bd2-4813-bf7b-dd6d372f199e, reason: Instance 9ae3632c-e9ad-4bef-9ed9-5571d054b06e could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Successfully created port: fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG nova.compute.manager [req-6ca91192-8e65-416a-960f-13e1206d736e req-ab088ad8-f1ea-4294-8420-bc850fcfa65c service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received event network-changed-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG nova.compute.manager [req-6ca91192-8e65-416a-960f-13e1206d736e req-ab088ad8-f1ea-4294-8420-bc850fcfa65c service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Refreshing instance network info cache due to event network-changed-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6ca91192-8e65-416a-960f-13e1206d736e req-ab088ad8-f1ea-4294-8420-bc850fcfa65c service nova] Acquiring lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6ca91192-8e65-416a-960f-13e1206d736e req-ab088ad8-f1ea-4294-8420-bc850fcfa65c service nova] Acquired lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:45:28 user nova-compute[75672]: DEBUG nova.network.neutron [req-6ca91192-8e65-416a-960f-13e1206d736e req-ab088ad8-f1ea-4294-8420-bc850fcfa65c service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Refreshing network info cache for port 84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Stashing vm_state: active {{(pid=75672) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.104s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:45:29 user nova-compute[75672]: INFO nova.compute.claims [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Claim successful on node user
Nov 30 12:45:29 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Deleted allocations for instance 9ae3632c-e9ad-4bef-9ed9-5571d054b06e
Nov 30 12:45:29 user nova-compute[75672]: INFO nova.compute.resource_tracker [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Updating resource usage from migration e6561f04-9963-430b-88b5-66f4f4b3f9a4
Nov 30 12:45:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2907c1d-07fa-43cc-a645-f4556f51000a tempest-AttachVolumeNegativeTest-1224349538 tempest-AttachVolumeNegativeTest-1224349538-project-member] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.613s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-8e5c8636-cf1b-4d16-b0b8-984c2cc28645 req-be17730d-1d50-456d-bb1a-928f384319e2 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Received event network-vif-plugged-c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e5c8636-cf1b-4d16-b0b8-984c2cc28645 req-be17730d-1d50-456d-bb1a-928f384319e2 service nova] Acquiring lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e5c8636-cf1b-4d16-b0b8-984c2cc28645 req-be17730d-1d50-456d-bb1a-928f384319e2 service nova] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e5c8636-cf1b-4d16-b0b8-984c2cc28645 req-be17730d-1d50-456d-bb1a-928f384319e2 service nova] Lock "9ae3632c-e9ad-4bef-9ed9-5571d054b06e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG nova.compute.manager [req-8e5c8636-cf1b-4d16-b0b8-984c2cc28645 req-be17730d-1d50-456d-bb1a-928f384319e2 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] No waiting events found dispatching network-vif-plugged-c3804f22-1bd2-4813-bf7b-dd6d372f199e {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:29 user nova-compute[75672]: WARNING nova.compute.manager [req-8e5c8636-cf1b-4d16-b0b8-984c2cc28645 req-be17730d-1d50-456d-bb1a-928f384319e2 service nova] [instance: 9ae3632c-e9ad-4bef-9ed9-5571d054b06e] Received unexpected event network-vif-plugged-c3804f22-1bd2-4813-bf7b-dd6d372f199e for instance with vm_state deleted and task_state None.
Nov 30 12:45:29 user nova-compute[75672]: DEBUG nova.network.neutron [req-6ca91192-8e65-416a-960f-13e1206d736e req-ab088ad8-f1ea-4294-8420-bc850fcfa65c service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Updated VIF entry in instance network info cache for port 84c0b4e1-0414-45cb-a9db-88d4aa5bbf03. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG nova.network.neutron [req-6ca91192-8e65-416a-960f-13e1206d736e req-ab088ad8-f1ea-4294-8420-bc850fcfa65c service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Updating instance_info_cache with network_info: [{"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6ca91192-8e65-416a-960f-13e1206d736e req-ab088ad8-f1ea-4294-8420-bc850fcfa65c service nova] Releasing lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Successfully updated port: fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.537s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:29 user nova-compute[75672]: INFO nova.compute.manager [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Migrating
Nov 30 12:45:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquired lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquired lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:45:29 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updating instance_info_cache with network_info: [{"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Releasing lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Instance network_info: |[{"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Start _get_guest_xml network_info=[{"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:45:30 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:45:30 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1985842296',display_name='tempest-ServerStableDeviceRescueTest-server-1985842296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1985842296',id=35,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU4niv4fKwifKIbusrskjKw+QLKV7egXGWJ857PxXbYP3fg26Vzmu8p/sI061Q4sngY65sMaHhlDzQGbahnpFyqwvkTF2KQYtYaGXFjuu4zchSAXVVqtz2l6VqNailjUw==',key_name='tempest-keypair-1811480596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a37bdd4c8e1345209fa532c6fd9496dd',ramdisk_id='',reservation_id='r-zhq3ccpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-752573724',owner_user_name='tempest-ServerStableDeviceRescueTest-752573724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5019d84b3bb436f9125865467cbb702',uuid=87744aef-7e32-475b-907e-e30702d083bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Converting VIF {"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:73:38,bridge_name='br-int',has_traffic_filtering=True,id=fb7cf9cd-ce27-4327-97ad-1c2692de57e7,network=Network(10275d04-9a7c-40d7-9df0-3aa724a7b817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cf9cd-ce') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lazy-loading 'pci_devices' on Instance uuid 87744aef-7e32-475b-907e-e30702d083bf {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:45:30 user nova-compute[75672]:   <uuid>87744aef-7e32-475b-907e-e30702d083bf</uuid>
Nov 30 12:45:30 user nova-compute[75672]:   <name>instance-00000023</name>
Nov 30 12:45:30 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:45:30 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:45:30 user nova-compute[75672]:   <metadata>
Nov 30 12:45:30 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:45:30 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:45:30 user nova-compute[75672]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1985842296</nova:name>
Nov 30 12:45:30 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:45:30</nova:creationTime>
Nov 30 12:45:30 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:45:30 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:45:30 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:45:30 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:45:30 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:45:30 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:45:30 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:45:30 user nova-compute[75672]:       <nova:owner>
Nov 30 12:45:30 user nova-compute[75672]:         <nova:user uuid="e5019d84b3bb436f9125865467cbb702">tempest-ServerStableDeviceRescueTest-752573724-project-member</nova:user>
Nov 30 12:45:30 user nova-compute[75672]:         <nova:project uuid="a37bdd4c8e1345209fa532c6fd9496dd">tempest-ServerStableDeviceRescueTest-752573724</nova:project>
Nov 30 12:45:30 user nova-compute[75672]:       </nova:owner>
Nov 30 12:45:30 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:45:30 user nova-compute[75672]:       <nova:ports>
Nov 30 12:45:30 user nova-compute[75672]:         <nova:port uuid="fb7cf9cd-ce27-4327-97ad-1c2692de57e7">
Nov 30 12:45:30 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 12:45:30 user nova-compute[75672]:         </nova:port>
Nov 30 12:45:30 user nova-compute[75672]:       </nova:ports>
Nov 30 12:45:30 user nova-compute[75672]:     </nova:instance>
Nov 30 12:45:30 user nova-compute[75672]:   </metadata>
Nov 30 12:45:30 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:45:30 user nova-compute[75672]:     <system>
Nov 30 12:45:30 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:45:30 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:45:30 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:45:30 user nova-compute[75672]:       <entry name="serial">87744aef-7e32-475b-907e-e30702d083bf</entry>
Nov 30 12:45:30 user nova-compute[75672]:       <entry name="uuid">87744aef-7e32-475b-907e-e30702d083bf</entry>
Nov 30 12:45:30 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:45:30 user nova-compute[75672]:     </system>
Nov 30 12:45:30 user nova-compute[75672]:   </sysinfo>
Nov 30 12:45:30 user nova-compute[75672]:   <os>
Nov 30 12:45:30 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:45:30 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:45:30 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:45:30 user nova-compute[75672]:   </os>
Nov 30 12:45:30 user nova-compute[75672]:   <features>
Nov 30 12:45:30 user nova-compute[75672]:     <acpi/>
Nov 30 12:45:30 user nova-compute[75672]:     <apic/>
Nov 30 12:45:30 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:45:30 user nova-compute[75672]:   </features>
Nov 30 12:45:30 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:45:30 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:45:30 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:45:30 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:45:30 user nova-compute[75672]:   </clock>
Nov 30 12:45:30 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:45:30 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:45:30 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:45:30 user nova-compute[75672]:   </cpu>
Nov 30 12:45:30 user nova-compute[75672]:   <devices>
Nov 30 12:45:30 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:45:30 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:45:30 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk"/>
Nov 30 12:45:30 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:45:30 user nova-compute[75672]:     </disk>
Nov 30 12:45:30 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:45:30 user nova-compute[75672]:       <mac address="fa:16:3e:2f:73:38"/>
Nov 30 12:45:30 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:45:30 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:45:30 user nova-compute[75672]:       <target dev="tapfb7cf9cd-ce"/>
Nov 30 12:45:30 user nova-compute[75672]:     </interface>
Nov 30 12:45:30 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:45:30 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/console.log" append="off"/>
Nov 30 12:45:30 user nova-compute[75672]:     </serial>
Nov 30 12:45:30 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:45:30 user nova-compute[75672]:     <video>
Nov 30 12:45:30 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:45:30 user nova-compute[75672]:     </video>
Nov 30 12:45:30 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:45:30 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:45:30 user nova-compute[75672]:     </rng>
Nov 30 12:45:30 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:45:30 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:45:30 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:45:30 user nova-compute[75672]:     </memballoon>
Nov 30 12:45:30 user nova-compute[75672]:   </devices>
Nov 30 12:45:30 user nova-compute[75672]: </domain>
Nov 30 12:45:30 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1985842296',display_name='tempest-ServerStableDeviceRescueTest-server-1985842296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1985842296',id=35,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU4niv4fKwifKIbusrskjKw+QLKV7egXGWJ857PxXbYP3fg26Vzmu8p/sI061Q4sngY65sMaHhlDzQGbahnpFyqwvkTF2KQYtYaGXFjuu4zchSAXVVqtz2l6VqNailjUw==',key_name='tempest-keypair-1811480596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a37bdd4c8e1345209fa532c6fd9496dd',ramdisk_id='',reservation_id='r-zhq3ccpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-752573724',owner_user_name='tempest-ServerStableDeviceRescueTest-752573724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5019d84b3bb436f9125865467cbb702',uuid=87744aef-7e32-475b-907e-e30702d083bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Converting VIF {"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:73:38,bridge_name='br-int',has_traffic_filtering=True,id=fb7cf9cd-ce27-4327-97ad-1c2692de57e7,network=Network(10275d04-9a7c-40d7-9df0-3aa724a7b817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cf9cd-ce') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_vif [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:73:38,bridge_name='br-int',has_traffic_filtering=True,id=fb7cf9cd-ce27-4327-97ad-1c2692de57e7,network=Network(10275d04-9a7c-40d7-9df0-3aa724a7b817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cf9cd-ce') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42e0f426-ecda-54a9-a476-4eff156e14c5', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb7cf9cd-ce, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb7cf9cd-ce, col_values=(('qos', UUID('2f727753-b560-4e1f-aae0-70b3af7126a1')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb7cf9cd-ce, col_values=(('external_ids', {'iface-id': 'fb7cf9cd-ce27-4327-97ad-1c2692de57e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:73:38', 'vm-uuid': '87744aef-7e32-475b-907e-e30702d083bf'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:30 user nova-compute[75672]: INFO os_vif [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:73:38,bridge_name='br-int',has_traffic_filtering=True,id=fb7cf9cd-ce27-4327-97ad-1c2692de57e7,network=Network(10275d04-9a7c-40d7-9df0-3aa724a7b817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cf9cd-ce')
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Updating instance_info_cache with network_info: [{"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Releasing lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] No VIF found with MAC fa:16:3e:2f:73:38, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:45:30 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 044e4031-8381-4e7f-a5ac-1a074e00497e is timed out.
Nov 30 12:45:30 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Successfully detached device vdb from instance 044e4031-8381-4e7f-a5ac-1a074e00497e from the live domain config.
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rmfPsGdB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:45:30 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Starting migrate_disk_and_power_off {{(pid=75672) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11481}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfaab2f-3e77-4d64-855c-bc4ff6df64a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:45:30 user nova-compute[75672]: No targets found.
Nov 30 12:45:30 user nova-compute[75672]: iSNS:
Nov 30 12:45:30 user nova-compute[75672]: No targets found.
Nov 30 12:45:30 user nova-compute[75672]: STATIC:
Nov 30 12:45:30 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016
Nov 30 12:45:30 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:30 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:30 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903
Nov 30 12:45:30 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:30 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:30 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b
Nov 30 12:45:30 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:30 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:30 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11
Nov 30 12:45:30 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:30 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:30 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff
Nov 30 12:45:30 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:30 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:30 user nova-compute[75672]: FIRMWARE:
Nov 30 12:45:30 user nova-compute[75672]: No targets found.
Nov 30 12:45:30 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:45:30 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:45:30 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc5ab5d-0df4-4ba6-b0cd-27b8af9f44ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2d3136-38cb-4282-a75f-5f04260e322d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:30 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:30 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:30 user nova-compute[75672]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)
Nov 30 12:45:30 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:30 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:30 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:30 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:30 user nova-compute[75672]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 (non-flash)
Nov 30 12:45:30 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:30 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd450e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903'): ({'sdd'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Removing single pathed devices sdd {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff72081c-4a63-412e-b905-8f650af5c88a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.compute.manager [req-8800da34-2dc0-4831-ac8a-374a5c8001e4 req-91fb4c3d-ddb2-48b0-8c4f-5448941b3d8a service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-changed-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.compute.manager [req-8800da34-2dc0-4831-ac8a-374a5c8001e4 req-91fb4c3d-ddb2-48b0-8c4f-5448941b3d8a service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Refreshing instance network info cache due to event network-changed-fb7cf9cd-ce27-4327-97ad-1c2692de57e7. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8800da34-2dc0-4831-ac8a-374a5c8001e4 req-91fb4c3d-ddb2-48b0-8c4f-5448941b3d8a service nova] Acquiring lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8800da34-2dc0-4831-ac8a-374a5c8001e4 req-91fb4c3d-ddb2-48b0-8c4f-5448941b3d8a service nova] Acquired lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG nova.network.neutron [req-8800da34-2dc0-4831-ac8a-374a5c8001e4 req-91fb4c3d-ddb2-48b0-8c4f-5448941b3d8a service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Refreshing network info cache for port fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeef22fc-7b95-431d-afe8-5a901efcdb99]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Flushing IO for device /dev/sdd {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[55da1027-f5b3-4291-a333-6c3f249d17a9]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[163c9233-d2ed-46c1-93b8-7377ad6af6f4]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] SCSI volumes sdd have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3508c460-ee54-4cf2-bbb0-0977447412e0]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12ee3a4-2143-4b99-993e-91f12f6dc3eb]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903, portal: 172.16.0.220,3260]
Nov 30 12:45:30 user nova-compute[75672]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903, portal: 172.16.0.220,3260] successful.
Nov 30 12:45:30 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:30 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a44637-6640-4e09-be01-c77186074903 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c47ff05-7c5e-4d9d-a58e-06147ee378df]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] <== disconnect_volume: return (397ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.network.neutron [req-8800da34-2dc0-4831-ac8a-374a5c8001e4 req-91fb4c3d-ddb2-48b0-8c4f-5448941b3d8a service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updated VIF entry in instance network info cache for port fb7cf9cd-ce27-4327-97ad-1c2692de57e7. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.network.neutron [req-8800da34-2dc0-4831-ac8a-374a5c8001e4 req-91fb4c3d-ddb2-48b0-8c4f-5448941b3d8a service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updating instance_info_cache with network_info: [{"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8800da34-2dc0-4831-ac8a-374a5c8001e4 req-91fb4c3d-ddb2-48b0-8c4f-5448941b3d8a service nova] Releasing lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.compute.manager [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:45:31 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Creating image(s)
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Ensure instance console log exists: /opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Start _get_guest_xml network_info=[{"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '5f55fde7-ed77-497a-b435-c238f0ed5550', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdhfyGUb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '47ac940e-edbd-4732-ac04-e242709ee894', 'attached_at': '', 'detached_at': '', 'volume_id': '0fdbfd07-f8d4-4bf9-8102-232b67482e38', 'serial': '0fdbfd07-f8d4-4bf9-8102-232b67482e38'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:45:31 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:45:31 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdhfyGUb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:45:31 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:45:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:45:31 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:45:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:45:31 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d089c3cf-ed6b-49a7-afc3-8361cb8baa76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:45:31 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[127a5495-7947-4863-8391-a74ace24cbcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38] added
Nov 30 12:45:31 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[97037b89-3fa4-48dc-a622-dbe6be8090b8]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:31 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Instance destroyed successfully.
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:43:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-580359070',display_name='tempest-ServerActionsTestOtherA-server-580359070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-580359070',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAGYYp9gmKcKQU/0AhKXIKN1vmmULr4112gYCMQNfGJmVLFUNJpr/fRLeXt2uFTxy9c+sqp7OE8Rgl3bMk88M8K66f/jnDNBbOBQMv+K2V48Kq8w3CudXAVm+CT4wTJ5Q==',key_name='tempest-keypair-1875335252',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-ekoofs5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:45:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=f5851479-d09b-4d84-9553-2b09646f2b4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1973912560-network", "vif_mac": "fa:16:3e:c1:fb:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1973912560-network", "vif_mac": "fa:16:3e:c1:fb:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:fb:6a,bridge_name='br-int',has_traffic_filtering=True,id=84c0b4e1-0414-45cb-a9db-88d4aa5bbf03,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c0b4e1-04') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG os_vif [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:fb:6a,bridge_name='br-int',has_traffic_filtering=True,id=84c0b4e1-0414-45cb-a9db-88d4aa5bbf03,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c0b4e1-04') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84c0b4e1-04, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f4df09-a669-4dc4-87fc-a8a6b7636ad5]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdhfyGUb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d2c9230-8323-47c2-80a9-d8f2a9de1501) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdhfyGUb" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3bfe1a-34b7-40d0-8d5b-fb92f7ce194c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZdhfyGUb'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:32 user nova-compute[75672]: INFO os_vif [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:fb:6a,bridge_name='br-int',has_traffic_filtering=True,id=84c0b4e1-0414-45cb-a9db-88d4aa5bbf03,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c0b4e1-04')
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNqFmylf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:45:32 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b108af5e-1f47-463d-be6b-c22f6be766a7]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[21873f67-ab4f-4155-968d-56fee1ea8fe3]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:32 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:32 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:32 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:32 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:32 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:32 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG nova.objects.instance [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'flavor' on Instance uuid 044e4031-8381-4e7f-a5ac-1a074e00497e {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2a33ab-9173-4a14-81ac-bc94c1c8d296]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38, portal: 172.16.0.220,3260]
Nov 30 12:45:32 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38, portal: 172.16.0.220,3260] successful.
Nov 30 12:45:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-42f96bc3-7eef-4faf-b56c-6ed1f73d4a96 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.077s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dfe045-0c84-4514-9cd9-88aade27b26f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[505e6517-6e75-4d06-99da-9dafca6376d6]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:32 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:32 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:32 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:32 user nova-compute[75672]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:45:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:32 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:32 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:32 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:32 user nova-compute[75672]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:45:32 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[504d2a4d-b17c-4af7-bfa9-6a5429f05869]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdhfyGUb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-0c4cf4f8-5226-4173-ad87-a28e50e6a368 req-22ab2b49-7bb5-421f-b25b-f532f5e8df2c service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c4cf4f8-5226-4173-ad87-a28e50e6a368 req-22ab2b49-7bb5-421f-b25b-f532f5e8df2c service nova] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c4cf4f8-5226-4173-ad87-a28e50e6a368 req-22ab2b49-7bb5-421f-b25b-f532f5e8df2c service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c4cf4f8-5226-4173-ad87-a28e50e6a368 req-22ab2b49-7bb5-421f-b25b-f532f5e8df2c service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-0c4cf4f8-5226-4173-ad87-a28e50e6a368 req-22ab2b49-7bb5-421f-b25b-f532f5e8df2c service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] No waiting events found dispatching network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:32 user nova-compute[75672]: WARNING nova.compute.manager [req-0c4cf4f8-5226-4173-ad87-a28e50e6a368 req-22ab2b49-7bb5-421f-b25b-f532f5e8df2c service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received unexpected event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 for instance with vm_state building and task_state spawning.
Nov 30 12:45:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-2db91d8b-941d-4d40-938e-9e6ab13a01af req-95255a87-0cfa-460c-82dc-c63e1822d115 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received event network-vif-unplugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2db91d8b-941d-4d40-938e-9e6ab13a01af req-95255a87-0cfa-460c-82dc-c63e1822d115 service nova] Acquiring lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2db91d8b-941d-4d40-938e-9e6ab13a01af req-95255a87-0cfa-460c-82dc-c63e1822d115 service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2db91d8b-941d-4d40-938e-9e6ab13a01af req-95255a87-0cfa-460c-82dc-c63e1822d115 service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-2db91d8b-941d-4d40-938e-9e6ab13a01af req-95255a87-0cfa-460c-82dc-c63e1822d115 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] No waiting events found dispatching network-vif-unplugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:32 user nova-compute[75672]: WARNING nova.compute.manager [req-2db91d8b-941d-4d40-938e-9e6ab13a01af req-95255a87-0cfa-460c-82dc-c63e1822d115 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received unexpected event network-vif-unplugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 for instance with vm_state active and task_state resize_migrating.
Nov 30 12:45:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-2db91d8b-941d-4d40-938e-9e6ab13a01af req-95255a87-0cfa-460c-82dc-c63e1822d115 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received event network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2db91d8b-941d-4d40-938e-9e6ab13a01af req-95255a87-0cfa-460c-82dc-c63e1822d115 service nova] Acquiring lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2db91d8b-941d-4d40-938e-9e6ab13a01af req-95255a87-0cfa-460c-82dc-c63e1822d115 service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2db91d8b-941d-4d40-938e-9e6ab13a01af req-95255a87-0cfa-460c-82dc-c63e1822d115 service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-2db91d8b-941d-4d40-938e-9e6ab13a01af req-95255a87-0cfa-460c-82dc-c63e1822d115 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] No waiting events found dispatching network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:32 user nova-compute[75672]: WARNING nova.compute.manager [req-2db91d8b-941d-4d40-938e-9e6ab13a01af req-95255a87-0cfa-460c-82dc-c63e1822d115 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received unexpected event network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 for instance with vm_state active and task_state resize_migrating.
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "044e4031-8381-4e7f-a5ac-1a074e00497e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:32 user nova-compute[75672]: INFO nova.compute.manager [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Detaching volume dc75033f-38c0-468e-961e-904c40c99c11
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:33 user nova-compute[75672]: INFO nova.virt.block_device [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Attempting to driver detach volume dc75033f-38c0-468e-961e-904c40c99c11 from mountpoint /dev/vdc
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Attempting to detach device vdc from instance 044e4031-8381-4e7f-a5ac-1a074e00497e from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:45:33 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:45:33 user nova-compute[75672]:   <source dev="/dev/sdf"/>
Nov 30 12:45:33 user nova-compute[75672]:   <target dev="vdc" bus="virtio"/>
Nov 30 12:45:33 user nova-compute[75672]:   <serial>dc75033f-38c0-468e-961e-904c40c99c11</serial>
Nov 30 12:45:33 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 12:45:33 user nova-compute[75672]: </disk>
Nov 30 12:45:33 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:45:33 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Successfully detached device vdc from instance 044e4031-8381-4e7f-a5ac-1a074e00497e from the persistent domain config.
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 044e4031-8381-4e7f-a5ac-1a074e00497e from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:45:33 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:45:33 user nova-compute[75672]:   <source dev="/dev/sdf"/>
Nov 30 12:45:33 user nova-compute[75672]:   <target dev="vdc" bus="virtio"/>
Nov 30 12:45:33 user nova-compute[75672]:   <serial>dc75033f-38c0-468e-961e-904c40c99c11</serial>
Nov 30 12:45:33 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 12:45:33 user nova-compute[75672]: </disk>
Nov 30 12:45:33 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26331353234376130', 'path': '/dev/sdd'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331353234376130', 'path': '/dev/sdd'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.229s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60c7a83-ad3e-488a-b51f-2521c2d2b0d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:45:33 user nova-compute[75672]: No targets found.
Nov 30 12:45:33 user nova-compute[75672]: iSNS:
Nov 30 12:45:33 user nova-compute[75672]: No targets found.
Nov 30 12:45:33 user nova-compute[75672]: STATIC:
Nov 30 12:45:33 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016
Nov 30 12:45:33 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:33 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:33 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b
Nov 30 12:45:33 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:33 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:33 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:45:33 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:33 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:33 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11
Nov 30 12:45:33 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:33 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:33 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff
Nov 30 12:45:33 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:33 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:33 user nova-compute[75672]: FIRMWARE:
Nov 30 12:45:33 user nova-compute[75672]: No targets found.
Nov 30 12:45:33 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:45:33 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:45:33 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1500274755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1500274755',id=34,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47874c48ecea456eac7968640910afba',ramdisk_id='',reservation_id='r-mu7ztrq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-547265583',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:45:15Z,user_data=None,user_id='aa5b3c989c934220a07aba162e68ea87',uuid=47ac940e-edbd-4732-ac04-e242709ee894,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converting VIF {"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:3f:ff,bridge_name='br-int',has_traffic_filtering=True,id=e153586a-8cf1-4e2d-838d-a0eadd151858,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153586a-8c') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.objects.instance [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'pci_devices' on Instance uuid 47ac940e-edbd-4732-ac04-e242709ee894 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:45:33 user nova-compute[75672]:   <uuid>47ac940e-edbd-4732-ac04-e242709ee894</uuid>
Nov 30 12:45:33 user nova-compute[75672]:   <name>instance-00000022</name>
Nov 30 12:45:33 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:45:33 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:45:33 user nova-compute[75672]:   <metadata>
Nov 30 12:45:33 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:45:33 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:45:33 user nova-compute[75672]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1500274755</nova:name>
Nov 30 12:45:33 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:45:31</nova:creationTime>
Nov 30 12:45:33 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:45:33 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:45:33 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:45:33 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:45:33 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:45:33 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:45:33 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:45:33 user nova-compute[75672]:       <nova:owner>
Nov 30 12:45:33 user nova-compute[75672]:         <nova:user uuid="aa5b3c989c934220a07aba162e68ea87">tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member</nova:user>
Nov 30 12:45:33 user nova-compute[75672]:         <nova:project uuid="47874c48ecea456eac7968640910afba">tempest-ServerBootFromVolumeStableRescueTest-547265583</nova:project>
Nov 30 12:45:33 user nova-compute[75672]:       </nova:owner>
Nov 30 12:45:33 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:45:33 user nova-compute[75672]:       <nova:ports>
Nov 30 12:45:33 user nova-compute[75672]:         <nova:port uuid="e153586a-8cf1-4e2d-838d-a0eadd151858">
Nov 30 12:45:33 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 12:45:33 user nova-compute[75672]:         </nova:port>
Nov 30 12:45:33 user nova-compute[75672]:       </nova:ports>
Nov 30 12:45:33 user nova-compute[75672]:     </nova:instance>
Nov 30 12:45:33 user nova-compute[75672]:   </metadata>
Nov 30 12:45:33 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:45:33 user nova-compute[75672]:     <system>
Nov 30 12:45:33 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:45:33 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:45:33 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:45:33 user nova-compute[75672]:       <entry name="serial">47ac940e-edbd-4732-ac04-e242709ee894</entry>
Nov 30 12:45:33 user nova-compute[75672]:       <entry name="uuid">47ac940e-edbd-4732-ac04-e242709ee894</entry>
Nov 30 12:45:33 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:45:33 user nova-compute[75672]:     </system>
Nov 30 12:45:33 user nova-compute[75672]:   </sysinfo>
Nov 30 12:45:33 user nova-compute[75672]:   <os>
Nov 30 12:45:33 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:45:33 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:45:33 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:45:33 user nova-compute[75672]:   </os>
Nov 30 12:45:33 user nova-compute[75672]:   <features>
Nov 30 12:45:33 user nova-compute[75672]:     <acpi/>
Nov 30 12:45:33 user nova-compute[75672]:     <apic/>
Nov 30 12:45:33 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:45:33 user nova-compute[75672]:   </features>
Nov 30 12:45:33 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:45:33 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:45:33 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:45:33 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:45:33 user nova-compute[75672]:   </clock>
Nov 30 12:45:33 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:45:33 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:45:33 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:45:33 user nova-compute[75672]:   </cpu>
Nov 30 12:45:33 user nova-compute[75672]:   <devices>
Nov 30 12:45:33 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:45:33 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:45:33 user nova-compute[75672]:       <source dev="/dev/sdd"/>
Nov 30 12:45:33 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:45:33 user nova-compute[75672]:       <serial>0fdbfd07-f8d4-4bf9-8102-232b67482e38</serial>
Nov 30 12:45:33 user nova-compute[75672]:     </disk>
Nov 30 12:45:33 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:45:33 user nova-compute[75672]:       <mac address="fa:16:3e:76:3f:ff"/>
Nov 30 12:45:33 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:45:33 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:45:33 user nova-compute[75672]:       <target dev="tape153586a-8c"/>
Nov 30 12:45:33 user nova-compute[75672]:     </interface>
Nov 30 12:45:33 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:45:33 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/console.log" append="off"/>
Nov 30 12:45:33 user nova-compute[75672]:     </serial>
Nov 30 12:45:33 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:45:33 user nova-compute[75672]:     <video>
Nov 30 12:45:33 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:45:33 user nova-compute[75672]:     </video>
Nov 30 12:45:33 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:45:33 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:45:33 user nova-compute[75672]:     </rng>
Nov 30 12:45:33 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:45:33 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:45:33 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:45:33 user nova-compute[75672]:     </memballoon>
Nov 30 12:45:33 user nova-compute[75672]:   </devices>
Nov 30 12:45:33 user nova-compute[75672]: </domain>
Nov 30 12:45:33 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1500274755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1500274755',id=34,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47874c48ecea456eac7968640910afba',ramdisk_id='',reservation_id='r-mu7ztrq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-547265583',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:45:15Z,user_data=None,user_id='aa5b3c989c934220a07aba162e68ea87',uuid=47ac940e-edbd-4732-ac04-e242709ee894,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converting VIF {"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:3f:ff,bridge_name='br-int',has_traffic_filtering=True,id=e153586a-8cf1-4e2d-838d-a0eadd151858,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153586a-8c') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_vif [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:3f:ff,bridge_name='br-int',has_traffic_filtering=True,id=e153586a-8cf1-4e2d-838d-a0eadd151858,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153586a-8c') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[50753c0a-41a4-4af7-b9d9-5ed9ced31c92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '366efd94-d8ef-52fd-95ff-770c2b2d9567', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape153586a-8c, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape153586a-8c, col_values=(('qos', UUID('993ed47e-4a68-417d-b7a9-b543756c20d2')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape153586a-8c, col_values=(('external_ids', {'iface-id': 'e153586a-8cf1-4e2d-838d-a0eadd151858', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:3f:ff', 'vm-uuid': '47ac940e-edbd-4732-ac04-e242709ee894'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c97f28-07b3-4b09-9a4a-c4d6667a621b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:33 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:33 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:33 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:33 user nova-compute[75672]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:45:33 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:33 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:33 user nova-compute[75672]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:33 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:33 user nova-compute[75672]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:45:33 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd4326950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016'): ({'sdh'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Removing single pathed devices sdh {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:33 user nova-compute[75672]: INFO os_vif [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:3f:ff,bridge_name='br-int',has_traffic_filtering=True,id=e153586a-8cf1-4e2d-838d-a0eadd151858,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153586a-8c')
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca078f0f-8b72-45df-9ef3-a1895c3c1621]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4d5457-9919-4bf2-b60e-b5a1ee78d6fb]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Flushing IO for device /dev/sdh {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c535fa6e-e3be-4c38-9c60-577428fab2f0]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] No VIF found with MAC fa:16:3e:76:3f:ff, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[746c8247-201b-476d-9aad-6c9fc3adab2b]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] SCSI volumes sdh have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cb36eb-3d9c-4756-8794-aaffb7b5a3ef]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 044e4031-8381-4e7f-a5ac-1a074e00497e {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fa031f-0f56-49bf-90a1-257fec715006]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260]
Nov 30 12:45:33 user nova-compute[75672]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260] successful.
Nov 30 12:45:33 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30aadd8-0a86-47f3-b815-3e69d18df41f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] <== disconnect_volume: return (1599ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:45:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG nova.compute.manager [req-bdfd782f-247e-4dd5-a22f-67a52a5285b7 req-18f2b746-ab6c-4719-b1aa-318403696277 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bdfd782f-247e-4dd5-a22f-67a52a5285b7 req-18f2b746-ab6c-4719-b1aa-318403696277 service nova] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bdfd782f-247e-4dd5-a22f-67a52a5285b7 req-18f2b746-ab6c-4719-b1aa-318403696277 service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bdfd782f-247e-4dd5-a22f-67a52a5285b7 req-18f2b746-ab6c-4719-b1aa-318403696277 service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG nova.compute.manager [req-bdfd782f-247e-4dd5-a22f-67a52a5285b7 req-18f2b746-ab6c-4719-b1aa-318403696277 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] No waiting events found dispatching network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:34 user nova-compute[75672]: WARNING nova.compute.manager [req-bdfd782f-247e-4dd5-a22f-67a52a5285b7 req-18f2b746-ab6c-4719-b1aa-318403696277 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received unexpected event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 for instance with vm_state building and task_state spawning.
Nov 30 12:45:34 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Port 84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 binding to destination host user is already ACTIVE {{(pid=75672) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:45:34 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Instance spawned successfully.
Nov 30 12:45:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:34 user nova-compute[75672]: INFO nova.compute.manager [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Took 7.52 seconds to spawn the instance on the hypervisor.
Nov 30 12:45:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:34 user nova-compute[75672]: INFO nova.compute.manager [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Took 8.65 seconds to build instance.
Nov 30 12:45:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquired lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:45:34 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c60d6bf9-1d56-445d-a184-6798ce67c494 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "87744aef-7e32-475b-907e-e30702d083bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.799s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG nova.compute.manager [req-4da9174f-5005-4767-83da-8689832825ed req-e719f8b0-7ada-4279-ae46-5fdea3115821 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4da9174f-5005-4767-83da-8689832825ed req-e719f8b0-7ada-4279-ae46-5fdea3115821 service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4da9174f-5005-4767-83da-8689832825ed req-e719f8b0-7ada-4279-ae46-5fdea3115821 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4da9174f-5005-4767-83da-8689832825ed req-e719f8b0-7ada-4279-ae46-5fdea3115821 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG nova.compute.manager [req-4da9174f-5005-4767-83da-8689832825ed req-e719f8b0-7ada-4279-ae46-5fdea3115821 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:35 user nova-compute[75672]: WARNING nova.compute.manager [req-4da9174f-5005-4767-83da-8689832825ed req-e719f8b0-7ada-4279-ae46-5fdea3115821 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state building and task_state spawning.
Nov 30 12:45:35 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Updating instance_info_cache with network_info: [{"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Releasing lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG os_brick.utils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[276f4059-f939-4b47-ab32-afd8ddf0acc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4d417e-dc5b-4bf2-80a8-7394ca190492]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f92210-a30d-480c-ac11-034844e2774d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddb3a8c-95de-499f-a091-63a44ef9c05d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:45:35 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:45:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7623ed4-372d-4e7a-8321-5505054cacc4]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:45:35 user nova-compute[75672]: DEBUG os_brick.utils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:45:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG nova.compute.manager [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:45:37 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Instance spawned successfully.
Nov 30 12:45:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:45:37 user nova-compute[75672]: INFO nova.compute.manager [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 30 12:45:37 user nova-compute[75672]: DEBUG nova.compute.manager [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-0bfbc610-5018-404b-85e8-3ec71f0fc566 req-5d2a7d1c-ce16-4063-94b1-aec8f8681202 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0bfbc610-5018-404b-85e8-3ec71f0fc566 req-5d2a7d1c-ce16-4063-94b1-aec8f8681202 service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0bfbc610-5018-404b-85e8-3ec71f0fc566 req-5d2a7d1c-ce16-4063-94b1-aec8f8681202 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0bfbc610-5018-404b-85e8-3ec71f0fc566 req-5d2a7d1c-ce16-4063-94b1-aec8f8681202 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-0bfbc610-5018-404b-85e8-3ec71f0fc566 req-5d2a7d1c-ce16-4063-94b1-aec8f8681202 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:37 user nova-compute[75672]: WARNING nova.compute.manager [req-0bfbc610-5018-404b-85e8-3ec71f0fc566 req-5d2a7d1c-ce16-4063-94b1-aec8f8681202 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state building and task_state spawning.
Nov 30 12:45:37 user nova-compute[75672]: INFO nova.compute.manager [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Took 23.11 seconds to build instance.
Nov 30 12:45:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-33714205-34a0-4c4e-acce-67fad6fdeb5d tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "47ac940e-edbd-4732-ac04-e242709ee894" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.210s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Didn't find any instances for network info cache update. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 12:45:37 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:45:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:40 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:45:40 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:45:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:41 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:45:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:45:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:45:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:45:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:45:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:45:45 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:45:45 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:45:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7457MB free_disk=25.171791076660156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:45:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Starting finish_migration {{(pid=75672) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11668}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Instance directory exists: not creating {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Nov 30 12:45:46 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Creating image(s)
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Ensure instance console log exists: /opt/stack/data/nova/instances/f5851479-d09b-4d84-9553-2b09646f2b4f/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Start _get_guest_xml network_info=[{"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1973912560-network", "vif_mac": "fa:16:3e:c1:fb:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd36ff177-49dc-4cf9-96f0-09bee690f843', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNqFmylf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f5851479-d09b-4d84-9553-2b09646f2b4f', 'attached_at': '2023-11-30T12:45:46.000000', 'detached_at': '', 'volume_id': '83a735a8-128e-4328-826b-f8450f2b4016', 'serial': '83a735a8-128e-4328-826b-f8450f2b4016'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:45:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:45:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNqFmylf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:45:46 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:45:46 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:45:46 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fdeb41-c04c-45f6-9030-dca5ac63535b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:45:46 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Applying migration context for instance f5851479-d09b-4d84-9553-2b09646f2b4f as it has an incoming, in-progress migration e6561f04-9963-430b-88b5-66f4f4b3f9a4. Migration status is post-migrating {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 12:45:46 user nova-compute[75672]: INFO nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Updating resource usage from migration e6561f04-9963-430b-88b5-66f4f4b3f9a4
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad3ba17-e7c1-40cc-8e62-281a44013540]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016] added
Nov 30 12:45:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[805ccbc1-6a8d-4e09-a0d3-4134cf20bb9c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance b06bea0f-9186-4ab8-8bad-588beb48a1f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 044e4031-8381-4e7f-a5ac-1a074e00497e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 4372bad4-2959-4c6f-bde0-29c8ecb166b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 87744aef-7e32-475b-907e-e30702d083bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Migration e6561f04-9963-430b-88b5-66f4f4b3f9a4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f5851479-d09b-4d84-9553-2b09646f2b4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5001cac9-6a10-4368-9479-d54db4231cb4]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNqFmylf {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNqFmylf" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce42350-e40d-4bbf-85e1-1416fea642ba]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wNqFmylf'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[858e1085-f706-4fb4-8229-7f1808235771]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2b0a8c-716f-4cae-8391-07c668440ec1]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:46 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:46 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:46 user nova-compute[75672]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:45:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:46 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:46 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:46 user nova-compute[75672]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:45:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37bc57f-4621-4857-bbbf-065df60512c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260]
Nov 30 12:45:46 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260] successful.
Nov 30 12:45:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f77073-e7d9-4b47-8322-5254cd54b9a8]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[368994f5-33de-46a7-be13-cee4dd486de5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:46 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:46 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:46 user nova-compute[75672]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:45:46 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:46 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:46 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:46 user nova-compute[75672]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:45:46 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:46 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[77849c23-8add-433f-a020-2b3cecd154af]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNqFmylf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:45:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23436393036366633', 'path': '/dev/sde'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436393036366633', 'path': '/dev/sde'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:43:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-580359070',display_name='tempest-ServerActionsTestOtherA-server-580359070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-580359070',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAGYYp9gmKcKQU/0AhKXIKN1vmmULr4112gYCMQNfGJmVLFUNJpr/fRLeXt2uFTxy9c+sqp7OE8Rgl3bMk88M8K66f/jnDNBbOBQMv+K2V48Kq8w3CudXAVm+CT4wTJ5Q==',key_name='tempest-keypair-1875335252',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-ekoofs5a',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=f5851479-d09b-4d84-9553-2b09646f2b4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1973912560-network", "vif_mac": "fa:16:3e:c1:fb:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1973912560-network", "vif_mac": "fa:16:3e:c1:fb:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:6a,bridge_name='br-int',has_traffic_filtering=True,id=84c0b4e1-0414-45cb-a9db-88d4aa5bbf03,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c0b4e1-04') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:45:47 user nova-compute[75672]:   <uuid>f5851479-d09b-4d84-9553-2b09646f2b4f</uuid>
Nov 30 12:45:47 user nova-compute[75672]:   <name>instance-00000020</name>
Nov 30 12:45:47 user nova-compute[75672]:   <memory>2097152</memory>
Nov 30 12:45:47 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:45:47 user nova-compute[75672]:   <metadata>
Nov 30 12:45:47 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:45:47 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:45:47 user nova-compute[75672]:       <nova:name>tempest-ServerActionsTestOtherA-server-580359070</nova:name>
Nov 30 12:45:47 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:45:46</nova:creationTime>
Nov 30 12:45:47 user nova-compute[75672]:       <nova:flavor name="m1.small">
Nov 30 12:45:47 user nova-compute[75672]:         <nova:memory>2048</nova:memory>
Nov 30 12:45:47 user nova-compute[75672]:         <nova:disk>20</nova:disk>
Nov 30 12:45:47 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:45:47 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:45:47 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:45:47 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:45:47 user nova-compute[75672]:       <nova:owner>
Nov 30 12:45:47 user nova-compute[75672]:         <nova:user uuid="15791a052aef4d7a9bc79c97075cbdc9">tempest-ServerActionsTestOtherA-2076465849-project-member</nova:user>
Nov 30 12:45:47 user nova-compute[75672]:         <nova:project uuid="51606113e3d1460894fdc500924cb37a">tempest-ServerActionsTestOtherA-2076465849</nova:project>
Nov 30 12:45:47 user nova-compute[75672]:       </nova:owner>
Nov 30 12:45:47 user nova-compute[75672]:       <nova:ports>
Nov 30 12:45:47 user nova-compute[75672]:         <nova:port uuid="84c0b4e1-0414-45cb-a9db-88d4aa5bbf03">
Nov 30 12:45:47 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 12:45:47 user nova-compute[75672]:         </nova:port>
Nov 30 12:45:47 user nova-compute[75672]:       </nova:ports>
Nov 30 12:45:47 user nova-compute[75672]:     </nova:instance>
Nov 30 12:45:47 user nova-compute[75672]:   </metadata>
Nov 30 12:45:47 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:45:47 user nova-compute[75672]:     <system>
Nov 30 12:45:47 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:45:47 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:45:47 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:45:47 user nova-compute[75672]:       <entry name="serial">f5851479-d09b-4d84-9553-2b09646f2b4f</entry>
Nov 30 12:45:47 user nova-compute[75672]:       <entry name="uuid">f5851479-d09b-4d84-9553-2b09646f2b4f</entry>
Nov 30 12:45:47 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:45:47 user nova-compute[75672]:     </system>
Nov 30 12:45:47 user nova-compute[75672]:   </sysinfo>
Nov 30 12:45:47 user nova-compute[75672]:   <os>
Nov 30 12:45:47 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:45:47 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:45:47 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:45:47 user nova-compute[75672]:   </os>
Nov 30 12:45:47 user nova-compute[75672]:   <features>
Nov 30 12:45:47 user nova-compute[75672]:     <acpi/>
Nov 30 12:45:47 user nova-compute[75672]:     <apic/>
Nov 30 12:45:47 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:45:47 user nova-compute[75672]:   </features>
Nov 30 12:45:47 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:45:47 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:45:47 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:45:47 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:45:47 user nova-compute[75672]:   </clock>
Nov 30 12:45:47 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:45:47 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:45:47 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:45:47 user nova-compute[75672]:   </cpu>
Nov 30 12:45:47 user nova-compute[75672]:   <devices>
Nov 30 12:45:47 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:45:47 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:45:47 user nova-compute[75672]:       <source dev="/dev/sde"/>
Nov 30 12:45:47 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:45:47 user nova-compute[75672]:       <serial>83a735a8-128e-4328-826b-f8450f2b4016</serial>
Nov 30 12:45:47 user nova-compute[75672]:     </disk>
Nov 30 12:45:47 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:45:47 user nova-compute[75672]:       <mac address="fa:16:3e:c1:fb:6a"/>
Nov 30 12:45:47 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:45:47 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:45:47 user nova-compute[75672]:       <target dev="tap84c0b4e1-04"/>
Nov 30 12:45:47 user nova-compute[75672]:     </interface>
Nov 30 12:45:47 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:45:47 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/f5851479-d09b-4d84-9553-2b09646f2b4f/console.log" append="off"/>
Nov 30 12:45:47 user nova-compute[75672]:     </serial>
Nov 30 12:45:47 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:45:47 user nova-compute[75672]:     <video>
Nov 30 12:45:47 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:45:47 user nova-compute[75672]:     </video>
Nov 30 12:45:47 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:45:47 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:45:47 user nova-compute[75672]:     </rng>
Nov 30 12:45:47 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:45:47 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:45:47 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:45:47 user nova-compute[75672]:     </memballoon>
Nov 30 12:45:47 user nova-compute[75672]:   </devices>
Nov 30 12:45:47 user nova-compute[75672]: </domain>
Nov 30 12:45:47 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:43:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-580359070',display_name='tempest-ServerActionsTestOtherA-server-580359070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-580359070',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAGYYp9gmKcKQU/0AhKXIKN1vmmULr4112gYCMQNfGJmVLFUNJpr/fRLeXt2uFTxy9c+sqp7OE8Rgl3bMk88M8K66f/jnDNBbOBQMv+K2V48Kq8w3CudXAVm+CT4wTJ5Q==',key_name='tempest-keypair-1875335252',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-ekoofs5a',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=f5851479-d09b-4d84-9553-2b09646f2b4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1973912560-network", "vif_mac": "fa:16:3e:c1:fb:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1973912560-network", "vif_mac": "fa:16:3e:c1:fb:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:6a,bridge_name='br-int',has_traffic_filtering=True,id=84c0b4e1-0414-45cb-a9db-88d4aa5bbf03,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c0b4e1-04') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG os_vif [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:6a,bridge_name='br-int',has_traffic_filtering=True,id=84c0b4e1-0414-45cb-a9db-88d4aa5bbf03,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c0b4e1-04') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0df88f6e-df79-59ea-bb2b-ce0ed744aaed', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84c0b4e1-04, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84c0b4e1-04, col_values=(('qos', UUID('582da6ec-ccee-4d45-9d43-d1922eef82fd')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84c0b4e1-04, col_values=(('external_ids', {'iface-id': '84c0b4e1-0414-45cb-a9db-88d4aa5bbf03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:fb:6a', 'vm-uuid': 'f5851479-d09b-4d84-9553-2b09646f2b4f'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:47 user nova-compute[75672]: INFO os_vif [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:fb:6a,bridge_name='br-int',has_traffic_filtering=True,id=84c0b4e1-0414-45cb-a9db-88d4aa5bbf03,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c0b4e1-04')
Nov 30 12:45:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:45:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] No VIF found with MAC fa:16:3e:c1:fb:6a, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:45:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-f2b92946-e633-4a7c-8f49-89a6ba88a023 req-dd09a726-5fc7-44d2-b7ae-022f6a602732 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received event network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f2b92946-e633-4a7c-8f49-89a6ba88a023 req-dd09a726-5fc7-44d2-b7ae-022f6a602732 service nova] Acquiring lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f2b92946-e633-4a7c-8f49-89a6ba88a023 req-dd09a726-5fc7-44d2-b7ae-022f6a602732 service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f2b92946-e633-4a7c-8f49-89a6ba88a023 req-dd09a726-5fc7-44d2-b7ae-022f6a602732 service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-f2b92946-e633-4a7c-8f49-89a6ba88a023 req-dd09a726-5fc7-44d2-b7ae-022f6a602732 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] No waiting events found dispatching network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:49 user nova-compute[75672]: WARNING nova.compute.manager [req-f2b92946-e633-4a7c-8f49-89a6ba88a023 req-dd09a726-5fc7-44d2-b7ae-022f6a602732 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received unexpected event network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 for instance with vm_state active and task_state resize_finish.
Nov 30 12:45:49 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:45:49 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:45:49 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:45:49 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:45:49 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:45:49 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:45:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:45:50 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Instance running successfully.
Nov 30 12:45:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Failed to set time: agent not configured {{(pid=75672) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 30 12:45:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c1fe3ade-d27f-4709-b72c-74d8ee0b1887 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] finish_migration finished successfully. {{(pid=75672) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11763}}
Nov 30 12:45:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-a535face-2e24-484f-bf41-a5c99a502f73 req-41b8c0bc-c815-4377-b5fa-b338045ebfa7 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received event network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a535face-2e24-484f-bf41-a5c99a502f73 req-41b8c0bc-c815-4377-b5fa-b338045ebfa7 service nova] Acquiring lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a535face-2e24-484f-bf41-a5c99a502f73 req-41b8c0bc-c815-4377-b5fa-b338045ebfa7 service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a535face-2e24-484f-bf41-a5c99a502f73 req-41b8c0bc-c815-4377-b5fa-b338045ebfa7 service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-a535face-2e24-484f-bf41-a5c99a502f73 req-41b8c0bc-c815-4377-b5fa-b338045ebfa7 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] No waiting events found dispatching network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:51 user nova-compute[75672]: WARNING nova.compute.manager [req-a535face-2e24-484f-bf41-a5c99a502f73 req-41b8c0bc-c815-4377-b5fa-b338045ebfa7 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received unexpected event network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 for instance with vm_state resized and task_state None.
Nov 30 12:45:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:53 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 044e4031-8381-4e7f-a5ac-1a074e00497e is timed out.
Nov 30 12:45:53 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Successfully detached device vdc from instance 044e4031-8381-4e7f-a5ac-1a074e00497e from the live domain config.
Nov 30 12:45:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlcdouNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:45:53 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7dcd0f-07d7-46d7-a5ca-410567384833]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:45:53 user nova-compute[75672]: No targets found.
Nov 30 12:45:53 user nova-compute[75672]: iSNS:
Nov 30 12:45:53 user nova-compute[75672]: No targets found.
Nov 30 12:45:53 user nova-compute[75672]: STATIC:
Nov 30 12:45:53 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016
Nov 30 12:45:53 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:53 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:53 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b
Nov 30 12:45:53 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:53 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:53 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:45:53 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:53 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:53 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11
Nov 30 12:45:53 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:53 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:53 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff
Nov 30 12:45:53 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:45:53 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:45:53 user nova-compute[75672]: FIRMWARE:
Nov 30 12:45:53 user nova-compute[75672]: No targets found.
Nov 30 12:45:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:45:53 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:45:53 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[638fca3a-7cda-4e03-8242-b9242e66f07a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[18528bc2-36ba-4e94-96bd-c9ae919ba2b5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:53 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:53 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:53 user nova-compute[75672]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:45:53 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:45:53 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:45:53 user nova-compute[75672]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 (non-flash)
Nov 30 12:45:53 user nova-compute[75672]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:45:53 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:45:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcf454e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11'): ({'sdf'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Removing single pathed devices sdf {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3541e4-35a8-4783-aa83-f340834c193c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[163ac6c1-13a0-477e-a590-e8742a97e086]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Flushing IO for device /dev/sdf {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e925480-24e0-4d74-b59f-f7e73f4ec01e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c76efa4-074f-43a5-a1bd-850bd1ae5d65]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] SCSI volumes sdf have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[df94212d-4eeb-42d6-8990-1994c7b3feb1]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[33634971-9079-4e2a-bf75-2b57143687cc]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11, portal: 172.16.0.220,3260]
Nov 30 12:45:53 user nova-compute[75672]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11, portal: 172.16.0.220,3260] successful.
Nov 30 12:45:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc75033f-38c0-468e-961e-904c40c99c11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9396d644-44f9-4c49-bbfc-caeb2c45d25c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] <== disconnect_volume: return (349ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:45:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:45:56 user nova-compute[75672]: DEBUG nova.objects.instance [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'flavor' on Instance uuid 044e4031-8381-4e7f-a5ac-1a074e00497e {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:45:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-697b1d78-0883-4033-94ec-a61ecb13dfc5 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.189s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "044e4031-8381-4e7f-a5ac-1a074e00497e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:57 user nova-compute[75672]: INFO nova.compute.manager [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Terminating instance
Nov 30 12:45:57 user nova-compute[75672]: DEBUG nova.compute.manager [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-862dcbaa-c42f-4329-8ffe-d02e8fefea0d req-dcc58bb7-df97-42d0-832f-d2cbd65e96e5 service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Received event network-vif-unplugged-19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-862dcbaa-c42f-4329-8ffe-d02e8fefea0d req-dcc58bb7-df97-42d0-832f-d2cbd65e96e5 service nova] Acquiring lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-862dcbaa-c42f-4329-8ffe-d02e8fefea0d req-dcc58bb7-df97-42d0-832f-d2cbd65e96e5 service nova] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-862dcbaa-c42f-4329-8ffe-d02e8fefea0d req-dcc58bb7-df97-42d0-832f-d2cbd65e96e5 service nova] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-862dcbaa-c42f-4329-8ffe-d02e8fefea0d req-dcc58bb7-df97-42d0-832f-d2cbd65e96e5 service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] No waiting events found dispatching network-vif-unplugged-19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-862dcbaa-c42f-4329-8ffe-d02e8fefea0d req-dcc58bb7-df97-42d0-832f-d2cbd65e96e5 service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Received event network-vif-unplugged-19ff09c5-922f-48bf-a8d2-16f60aa9780f for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:45:57 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Instance destroyed successfully.
Nov 30 12:45:57 user nova-compute[75672]: DEBUG nova.objects.instance [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lazy-loading 'resources' on Instance uuid 044e4031-8381-4e7f-a5ac-1a074e00497e {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1638881149',display_name='tempest-AttachVolumeTestJSON-server-1638881149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1638881149',id=31,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9vdovZQPOEjNzeCnnWz+GhaHsq8urPdGpsEcNLsf39j/emMV+n/4wUOFOewsBXR/WZMO1qPgagjHOBw1F9a1GgtrgvdD8i+OZsciZp0+H9SvqPDzr10p3WRdDc5EYAAw==',key_name='tempest-keypair-1075059070',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a0ca8eb58644e058b2019a4faa41a46',ramdisk_id='',reservation_id='r-fni6hndl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2004678694',owner_user_name='tempest-AttachVolumeTestJSON-2004678694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:42:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e98ee9bd3b604b39a3f6013a40398642',uuid=044e4031-8381-4e7f-a5ac-1a074e00497e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "address": "fa:16:3e:0a:af:87", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ff09c5-92", "ovs_interfaceid": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converting VIF {"id": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "address": "fa:16:3e:0a:af:87", "network": {"id": "cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1236280092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a0ca8eb58644e058b2019a4faa41a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ff09c5-92", "ovs_interfaceid": "19ff09c5-922f-48bf-a8d2-16f60aa9780f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:af:87,bridge_name='br-int',has_traffic_filtering=True,id=19ff09c5-922f-48bf-a8d2-16f60aa9780f,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ff09c5-92') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG os_vif [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:af:87,bridge_name='br-int',has_traffic_filtering=True,id=19ff09c5-922f-48bf-a8d2-16f60aa9780f,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ff09c5-92') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19ff09c5-92, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=929d3bf3-b8be-490d-abcb-21ab34f3d707) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:45:58 user nova-compute[75672]: INFO os_vif [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:af:87,bridge_name='br-int',has_traffic_filtering=True,id=19ff09c5-922f-48bf-a8d2-16f60aa9780f,network=Network(cabcc9c8-ab4e-4c79-98b4-dbcf52d0f35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ff09c5-92')
Nov 30 12:45:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Deleting instance files /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e_del
Nov 30 12:45:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Deletion of /opt/stack/data/nova/instances/044e4031-8381-4e7f-a5ac-1a074e00497e_del complete
Nov 30 12:45:58 user nova-compute[75672]: INFO nova.compute.manager [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 30 12:45:58 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:45:58 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:45:59 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:45:59 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Took 1.03 seconds to deallocate network for instance.
Nov 30 12:45:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:59 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:45:59 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:45:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-2e02882b-5486-4f6b-858e-4bafa9998b01 req-bd13adca-4573-43aa-8808-0fd1c2b1a186 service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Received event network-vif-plugged-19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2e02882b-5486-4f6b-858e-4bafa9998b01 req-bd13adca-4573-43aa-8808-0fd1c2b1a186 service nova] Acquiring lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:45:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2e02882b-5486-4f6b-858e-4bafa9998b01 req-bd13adca-4573-43aa-8808-0fd1c2b1a186 service nova] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:45:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2e02882b-5486-4f6b-858e-4bafa9998b01 req-bd13adca-4573-43aa-8808-0fd1c2b1a186 service nova] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-2e02882b-5486-4f6b-858e-4bafa9998b01 req-bd13adca-4573-43aa-8808-0fd1c2b1a186 service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] No waiting events found dispatching network-vif-plugged-19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:45:59 user nova-compute[75672]: WARNING nova.compute.manager [req-2e02882b-5486-4f6b-858e-4bafa9998b01 req-bd13adca-4573-43aa-8808-0fd1c2b1a186 service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Received unexpected event network-vif-plugged-19ff09c5-922f-48bf-a8d2-16f60aa9780f for instance with vm_state deleted and task_state None.
Nov 30 12:45:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-2e02882b-5486-4f6b-858e-4bafa9998b01 req-bd13adca-4573-43aa-8808-0fd1c2b1a186 service nova] [instance: 044e4031-8381-4e7f-a5ac-1a074e00497e] Received event network-vif-deleted-19ff09c5-922f-48bf-a8d2-16f60aa9780f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:45:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:45:59 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Deleted allocations for instance 044e4031-8381-4e7f-a5ac-1a074e00497e
Nov 30 12:45:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-69d6a816-1ca1-439b-a8ac-cafe80ccc6f0 tempest-AttachVolumeTestJSON-2004678694 tempest-AttachVolumeTestJSON-2004678694-project-member] Lock "044e4031-8381-4e7f-a5ac-1a074e00497e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.468s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-a5443a70-7466-4640-9b1c-ce9b83cd120e req-11788ba2-e79f-41e8-a5f6-4c7bd0bac542 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-changed-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-a5443a70-7466-4640-9b1c-ce9b83cd120e req-11788ba2-e79f-41e8-a5f6-4c7bd0bac542 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Refreshing instance network info cache due to event network-changed-e5d9e2a3-ef19-41bb-b090-13c40c8986ee. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a5443a70-7466-4640-9b1c-ce9b83cd120e req-11788ba2-e79f-41e8-a5f6-4c7bd0bac542 service nova] Acquiring lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a5443a70-7466-4640-9b1c-ce9b83cd120e req-11788ba2-e79f-41e8-a5f6-4c7bd0bac542 service nova] Acquired lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG nova.network.neutron [req-a5443a70-7466-4640-9b1c-ce9b83cd120e req-11788ba2-e79f-41e8-a5f6-4c7bd0bac542 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Refreshing network info cache for port e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:04 user nova-compute[75672]: INFO nova.compute.manager [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Terminating instance
Nov 30 12:46:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.network.neutron [req-a5443a70-7466-4640-9b1c-ce9b83cd120e req-11788ba2-e79f-41e8-a5f6-4c7bd0bac542 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Updated VIF entry in instance network info cache for port e5d9e2a3-ef19-41bb-b090-13c40c8986ee. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.network.neutron [req-a5443a70-7466-4640-9b1c-ce9b83cd120e req-11788ba2-e79f-41e8-a5f6-4c7bd0bac542 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Updating instance_info_cache with network_info: [{"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a5443a70-7466-4640-9b1c-ce9b83cd120e req-11788ba2-e79f-41e8-a5f6-4c7bd0bac542 service nova] Releasing lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-2b10e7c1-fcb9-4b07-8172-e31d9970295c req-5206fdea-cdfc-4fc7-831c-e7964a393846 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-unplugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2b10e7c1-fcb9-4b07-8172-e31d9970295c req-5206fdea-cdfc-4fc7-831c-e7964a393846 service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2b10e7c1-fcb9-4b07-8172-e31d9970295c req-5206fdea-cdfc-4fc7-831c-e7964a393846 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2b10e7c1-fcb9-4b07-8172-e31d9970295c req-5206fdea-cdfc-4fc7-831c-e7964a393846 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-2b10e7c1-fcb9-4b07-8172-e31d9970295c req-5206fdea-cdfc-4fc7-831c-e7964a393846 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-unplugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-2b10e7c1-fcb9-4b07-8172-e31d9970295c req-5206fdea-cdfc-4fc7-831c-e7964a393846 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-unplugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:05 user nova-compute[75672]: INFO nova.compute.manager [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Detaching volume ede70206-ad9f-4e86-9acf-024fe5d639ff
Nov 30 12:46:05 user nova-compute[75672]: INFO nova.virt.block_device [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Attempting to driver detach volume ede70206-ad9f-4e86-9acf-024fe5d639ff from mountpoint /dev/vdb
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Attempting to detach device vdb from instance b06bea0f-9186-4ab8-8bad-588beb48a1f1 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:46:05 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:46:05 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 12:46:05 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:46:05 user nova-compute[75672]:   <serial>ede70206-ad9f-4e86-9acf-024fe5d639ff</serial>
Nov 30 12:46:05 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:46:05 user nova-compute[75672]: </disk>
Nov 30 12:46:05 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:46:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Successfully detached device vdb from instance b06bea0f-9186-4ab8-8bad-588beb48a1f1 from the persistent domain config.
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b06bea0f-9186-4ab8-8bad-588beb48a1f1 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:46:05 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:46:05 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 12:46:05 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:46:05 user nova-compute[75672]:   <serial>ede70206-ad9f-4e86-9acf-024fe5d639ff</serial>
Nov 30 12:46:05 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:46:05 user nova-compute[75672]: </disk>
Nov 30 12:46:05 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Instance destroyed successfully.
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.objects.instance [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lazy-loading 'resources' on Instance uuid 8de0a3f4-abcb-4302-90ea-aea9b8b996f2 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-961439957',display_name='tempest-ServerActionsTestOtherB-server-961439957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-961439957',id=18,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9gzfXTAlw2XGf9HvtWm3alibDkZBaXqK6wU5D1XQgJAmyQFnvfR/7D9hAZOoFAhfgJYL3hqOw1f+3LmQPn02on/lNVBVazzydax1s8XfXwCPBkyn03q1zhUSD6eiHCpA==',key_name='tempest-keypair-1520780273',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:43:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69506305cadd4ab483ce9ee5e8da9625',ramdisk_id='',reservation_id='r-k234blik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-372668652',owner_user_name='tempest-ServerActionsTestOtherB-372668652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:43:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68b5a0c78cb840038a79b946d02562a6',uuid=8de0a3f4-abcb-4302-90ea-aea9b8b996f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converting VIF {"id": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "address": "fa:16:3e:f3:03:0e", "network": {"id": "3520af87-614f-4ccb-985b-500c9002c71e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-689822038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69506305cadd4ab483ce9ee5e8da9625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955b65e8-9d", "ovs_interfaceid": "955b65e8-9d92-4ba6-a330-7ca8fd6433ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_vif [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap955b65e8-9d, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f62005ad-c546-4626-bfe0-1dad03832646) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:46:05 user nova-compute[75672]: INFO os_vif [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=955b65e8-9d92-4ba6-a330-7ca8fd6433ca,network=Network(3520af87-614f-4ccb-985b-500c9002c71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955b65e8-9d')
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpPaXMlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:46:05 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[db861d9c-4d62-48ae-9a49-9258da20787f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:46:05 user nova-compute[75672]: No targets found.
Nov 30 12:46:05 user nova-compute[75672]: iSNS:
Nov 30 12:46:05 user nova-compute[75672]: No targets found.
Nov 30 12:46:05 user nova-compute[75672]: STATIC:
Nov 30 12:46:05 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016
Nov 30 12:46:05 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:46:05 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:46:05 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b
Nov 30 12:46:05 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:46:05 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:46:05 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:46:05 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:46:05 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:46:05 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff
Nov 30 12:46:05 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:46:05 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:46:05 user nova-compute[75672]: FIRMWARE:
Nov 30 12:46:05 user nova-compute[75672]: No targets found.
Nov 30 12:46:05 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:46:05 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:46:05 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffe0840-866d-420e-b404-c5c2a5cdbda5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[14076771-aa75-4b31-9798-557c7c46a23d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:46:05 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:46:05 user nova-compute[75672]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:46:05 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:46:05 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:46:05 user nova-compute[75672]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b (non-flash)
Nov 30 12:46:05 user nova-compute[75672]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:46:05 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:46:05 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd42ce320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[33852d6e-5da7-4cb1-b99b-1abcb45fc629]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[954d0238-3906-4c32-8a14-d3677dbe0841]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[536b9bed-ea76-45d1-8e89-f7e5dc8ee69c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba39b790-0be9-4e23-a332-13d8cb20d068]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b06bea0f-9186-4ab8-8bad-588beb48a1f1 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fc92b1-4496-4f99-b4e1-b520803d195c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd13dc0-c305-40fb-a7c0-c16d7e6eb694]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260]
Nov 30 12:46:05 user nova-compute[75672]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b, portal: 172.16.0.220,3260] successful.
Nov 30 12:46:05 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc0c9fa-b1e3-4af4-bdda-830f8899be4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[920bf8a5-4d6f-461d-8186-2aa8566e11c4]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] <== disconnect_volume: return (365ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:46:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:46:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Deleting instance files /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2_del
Nov 30 12:46:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Deletion of /opt/stack/data/nova/instances/8de0a3f4-abcb-4302-90ea-aea9b8b996f2_del complete
Nov 30 12:46:06 user nova-compute[75672]: INFO nova.compute.manager [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 30 12:46:06 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:46:06 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:46:06 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:46:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-4424a3c8-b219-441c-9f50-3e4efbccb3cd req-cdec5b56-c017-4cc1-a1b9-4f7899481077 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-changed-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-4424a3c8-b219-441c-9f50-3e4efbccb3cd req-cdec5b56-c017-4cc1-a1b9-4f7899481077 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Refreshing instance network info cache due to event network-changed-e5d9e2a3-ef19-41bb-b090-13c40c8986ee. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:46:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4424a3c8-b219-441c-9f50-3e4efbccb3cd req-cdec5b56-c017-4cc1-a1b9-4f7899481077 service nova] Acquiring lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:46:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4424a3c8-b219-441c-9f50-3e4efbccb3cd req-cdec5b56-c017-4cc1-a1b9-4f7899481077 service nova] Acquired lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:46:06 user nova-compute[75672]: DEBUG nova.network.neutron [req-4424a3c8-b219-441c-9f50-3e4efbccb3cd req-cdec5b56-c017-4cc1-a1b9-4f7899481077 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Refreshing network info cache for port e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:46:07 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Took 0.96 seconds to deallocate network for instance.
Nov 30 12:46:07 user nova-compute[75672]: DEBUG nova.network.neutron [req-4424a3c8-b219-441c-9f50-3e4efbccb3cd req-cdec5b56-c017-4cc1-a1b9-4f7899481077 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Updated VIF entry in instance network info cache for port e5d9e2a3-ef19-41bb-b090-13c40c8986ee. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG nova.network.neutron [req-4424a3c8-b219-441c-9f50-3e4efbccb3cd req-cdec5b56-c017-4cc1-a1b9-4f7899481077 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Updating instance_info_cache with network_info: [{"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4424a3c8-b219-441c-9f50-3e4efbccb3cd req-cdec5b56-c017-4cc1-a1b9-4f7899481077 service nova] Releasing lock "refresh_cache-b06bea0f-9186-4ab8-8bad-588beb48a1f1" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:07 user nova-compute[75672]: WARNING nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received unexpected event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with vm_state active and task_state deleting.
Nov 30 12:46:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:07 user nova-compute[75672]: WARNING nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received unexpected event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with vm_state active and task_state deleting.
Nov 30 12:46:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:07 user nova-compute[75672]: WARNING nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received unexpected event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with vm_state active and task_state deleting.
Nov 30 12:46:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-unplugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-unplugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-unplugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Acquiring lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] No waiting events found dispatching network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:07 user nova-compute[75672]: WARNING nova.compute.manager [req-ccebdc90-0418-49c5-9931-7e8a1f200354 req-db07ef1d-fe2e-4507-ad00-517731019837 service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received unexpected event network-vif-plugged-955b65e8-9d92-4ba6-a330-7ca8fd6433ca for instance with vm_state active and task_state deleting.
Nov 30 12:46:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:08 user nova-compute[75672]: INFO nova.compute.manager [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Took 1.03 seconds to detach 1 volumes for instance.
Nov 30 12:46:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:08 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:46:08 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:46:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:08 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Deleted allocations for instance 8de0a3f4-abcb-4302-90ea-aea9b8b996f2
Nov 30 12:46:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0f53555-c6f0-4a71-bae9-2654ce75a4ca tempest-ServerActionsTestOtherB-372668652 tempest-ServerActionsTestOtherB-372668652-project-member] Lock "8de0a3f4-abcb-4302-90ea-aea9b8b996f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.928s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-be429be7-06e4-4f4e-a167-622b708c4694 req-46166e02-ff98-4782-83af-7aacdb934a9f service nova] [instance: 8de0a3f4-abcb-4302-90ea-aea9b8b996f2] Received event network-vif-deleted-955b65e8-9d92-4ba6-a330-7ca8fd6433ca {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:25 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b06bea0f-9186-4ab8-8bad-588beb48a1f1 is timed out.
Nov 30 12:46:25 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Successfully detached device vdb from instance b06bea0f-9186-4ab8-8bad-588beb48a1f1 from the live domain config.
Nov 30 12:46:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txKrJOse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:46:25 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:46:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53b9394-bc06-4562-aacb-a4542b482ce3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:46:25 user nova-compute[75672]: No targets found.
Nov 30 12:46:25 user nova-compute[75672]: iSNS:
Nov 30 12:46:25 user nova-compute[75672]: No targets found.
Nov 30 12:46:25 user nova-compute[75672]: STATIC:
Nov 30 12:46:25 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016
Nov 30 12:46:25 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:46:25 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:46:25 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:46:25 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:46:25 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:46:25 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff
Nov 30 12:46:25 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:46:25 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:46:25 user nova-compute[75672]: FIRMWARE:
Nov 30 12:46:25 user nova-compute[75672]: No targets found.
Nov 30 12:46:25 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:46:25 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:46:25 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b934aa-3e1c-4681-beb4-30bb5fe15255]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[942d8225-8b23-434e-82ed-ade5b7536f16]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:46:25 user nova-compute[75672]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:46:25 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:46:25 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff (non-flash)
Nov 30 12:46:25 user nova-compute[75672]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:46:25 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:46:25 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd42bc430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff'): ({'sdc'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Removing single pathed devices sdc {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5a8256-7b05-4d33-8031-c30781a32521]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95342c2-2d9b-4cad-806e-761922203792]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Flushing IO for device /dev/sdc {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2234a9f2-53b1-41b1-b451-5088ff8fd3a6]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfb65b0-cd83-439e-a848-69b47b18b2e4]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f15bf3-3896-4a21-8188-5e24775eb79b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b064c4-1df5-4585-a014-e4c19dde72ab]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff, portal: 172.16.0.220,3260]
Nov 30 12:46:26 user nova-compute[75672]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff, portal: 172.16.0.220,3260] successful.
Nov 30 12:46:26 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede70206-ad9f-4e86-9acf-024fe5d639ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfb537f-958b-480e-b9a6-8750458e420f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] <== disconnect_volume: return (326ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:46:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:46:27 user nova-compute[75672]: DEBUG nova.objects.instance [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'flavor' on Instance uuid b06bea0f-9186-4ab8-8bad-588beb48a1f1 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:46:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-8ca15518-9a7f-409b-9897-51d724d2f0e9 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.788s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:46:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:27 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:46:27 user nova-compute[75672]: INFO nova.compute.claims [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Claim successful on node user
Nov 30 12:46:27 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:46:27 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:46:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:46:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:46:27 user nova-compute[75672]: DEBUG nova.network.neutron [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:46:27 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:46:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG nova.policy [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '924cf8ff73154f8fadb371175a0d8fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513644b3a140400dbdf6b07e8e727dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:46:28 user nova-compute[75672]: INFO nova.virt.block_device [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Booting with volume 3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf at /dev/vda
Nov 30 12:46:28 user nova-compute[75672]: DEBUG os_brick.utils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[75642e0d-0c8a-4e0e-8e1c-5d20c21122be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[10434ef5-b360-4b2f-b6c0-79314f6c2ea2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b48d69-d2ea-4900-a733-059457970a0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e425c5-ade5-46e2-b972-bbc4620a6138]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:46:28 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:46:28 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b23d09c-afee-49b7-b4f7-c4b8ced8bff3]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG os_brick.utils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Updating existing volume attachment record: 771c1cdf-105e-4d54-ac1c-8842bbcad805 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:46:28 user nova-compute[75672]: DEBUG nova.network.neutron [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Successfully created port: 0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:46:29 user nova-compute[75672]: DEBUG nova.network.neutron [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Successfully updated port: 0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:46:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "refresh_cache-eb96c0c6-bcda-45b2-a7a5-308471a5003c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:46:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquired lock "refresh_cache-eb96c0c6-bcda-45b2-a7a5-308471a5003c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:46:29 user nova-compute[75672]: DEBUG nova.network.neutron [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG nova.compute.manager [req-108d6d9e-27fb-48db-bb72-75136f7799d3 req-55d53704-53f8-4006-8a40-d73e9cdca648 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Received event network-changed-0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG nova.compute.manager [req-108d6d9e-27fb-48db-bb72-75136f7799d3 req-55d53704-53f8-4006-8a40-d73e9cdca648 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Refreshing instance network info cache due to event network-changed-0a9fb28e-1985-4953-ae9f-308edfdb62a1. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-108d6d9e-27fb-48db-bb72-75136f7799d3 req-55d53704-53f8-4006-8a40-d73e9cdca648 service nova] Acquiring lock "refresh_cache-eb96c0c6-bcda-45b2-a7a5-308471a5003c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG nova.network.neutron [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG nova.network.neutron [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Updating instance_info_cache with network_info: [{"id": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "address": "fa:16:3e:6e:b2:35", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9fb28e-19", "ovs_interfaceid": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Releasing lock "refresh_cache-eb96c0c6-bcda-45b2-a7a5-308471a5003c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG nova.compute.manager [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Instance network_info: |[{"id": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "address": "fa:16:3e:6e:b2:35", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9fb28e-19", "ovs_interfaceid": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-108d6d9e-27fb-48db-bb72-75136f7799d3 req-55d53704-53f8-4006-8a40-d73e9cdca648 service nova] Acquired lock "refresh_cache-eb96c0c6-bcda-45b2-a7a5-308471a5003c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG nova.network.neutron [req-108d6d9e-27fb-48db-bb72-75136f7799d3 req-55d53704-53f8-4006-8a40-d73e9cdca648 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Refreshing network info cache for port 0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG nova.network.neutron [req-108d6d9e-27fb-48db-bb72-75136f7799d3 req-55d53704-53f8-4006-8a40-d73e9cdca648 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Updated VIF entry in instance network info cache for port 0a9fb28e-1985-4953-ae9f-308edfdb62a1. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG nova.network.neutron [req-108d6d9e-27fb-48db-bb72-75136f7799d3 req-55d53704-53f8-4006-8a40-d73e9cdca648 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Updating instance_info_cache with network_info: [{"id": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "address": "fa:16:3e:6e:b2:35", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9fb28e-19", "ovs_interfaceid": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:46:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-108d6d9e-27fb-48db-bb72-75136f7799d3 req-55d53704-53f8-4006-8a40-d73e9cdca648 service nova] Releasing lock "refresh_cache-eb96c0c6-bcda-45b2-a7a5-308471a5003c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:46:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:37 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:46:37 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:46:37 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 12:46:37 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Skipping network cache update for instance because it is Building. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 30 12:46:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:46:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:46:37 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:46:37 user nova-compute[75672]: DEBUG nova.objects.instance [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lazy-loading 'info_cache' on Instance uuid 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:46:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Updating instance_info_cache with network_info: [{"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:46:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:46:38 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:46:38 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:46:40 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:46:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:46:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:46:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:46:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:46:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:46:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:41 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:46:41 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:46:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:41 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:46:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.compute.manager [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:46:42 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Creating image(s)
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Ensure instance console log exists: /opt/stack/data/nova/instances/eb96c0c6-bcda-45b2-a7a5-308471a5003c/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Start _get_guest_xml network_info=[{"id": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "address": "fa:16:3e:6e:b2:35", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9fb28e-19", "ovs_interfaceid": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '771c1cdf-105e-4d54-ac1c-8842bbcad805', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viUPLGdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eb96c0c6-bcda-45b2-a7a5-308471a5003c', 'attached_at': '', 'detached_at': '', 'volume_id': '3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf', 'serial': '3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:46:42 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:46:42 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viUPLGdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:46:42 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:46:42 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:46:42 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eaffed-a6ce-489e-b9ce-a378fe60eeed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:46:42 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[159af0da-7d7c-4a3c-950a-e5719818332f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf] added
Nov 30 12:46:42 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[813a1663-ec1f-4128-9026-6fd40fbf36a7]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5df10a6-93d7-422e-bf2e-b3208f39f466]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v viUPLGdj {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v viUPLGdj" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e51aab-3971-415a-844f-8d9a55f80a7c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'viUPLGdj'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[837443ab-8797-4c2d-892d-fa78f8ed2612]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa416065-f3bb-4ac1-bb3e-c8d403312854]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:46:42 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:46:42 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:46:42 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:46:42 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[62341420-788c-4d35-8ee7-de9edf108aa8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260]
Nov 30 12:46:42 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260] successful.
Nov 30 12:46:42 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faf7d83-7bd3-448c-9afb-0642ec168256]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[39caa8f8-39a9-49e1-be86-54bc566377cf]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:46:42 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:46:42 user nova-compute[75672]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:46:42 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:46:42 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:46:42 user nova-compute[75672]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:46:42 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a785424-2e45-41bf-a58f-e63605c18623]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viUPLGdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23233313766323333', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233313766323333', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-882577862',display_name='tempest-TestVolumeBootPattern-server-882577862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-882577862',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/tiWnKVjyQ+YQ0wPEgFpD4sUWbk2GMRtR0fUhMrrhWzqEfZseqSV3bBKpPI9FNVcBh3EJSPDcri0dXJ24ST3AlMd1Z9vj5ezFGg5LMAjAiHzircmeHJyIgzk+4EYWw6A==',key_name='tempest-TestVolumeBootPattern-1453287901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-u41yb8zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:46:28Z,user_data=None,user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=eb96c0c6-bcda-45b2-a7a5-308471a5003c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "address": "fa:16:3e:6e:b2:35", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9fb28e-19", "ovs_interfaceid": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "address": "fa:16:3e:6e:b2:35", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9fb28e-19", "ovs_interfaceid": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b2:35,bridge_name='br-int',has_traffic_filtering=True,id=0a9fb28e-1985-4953-ae9f-308edfdb62a1,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a9fb28e-19') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG nova.objects.instance [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lazy-loading 'pci_devices' on Instance uuid eb96c0c6-bcda-45b2-a7a5-308471a5003c {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:46:43 user nova-compute[75672]:   <uuid>eb96c0c6-bcda-45b2-a7a5-308471a5003c</uuid>
Nov 30 12:46:43 user nova-compute[75672]:   <name>instance-00000024</name>
Nov 30 12:46:43 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:46:43 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:46:43 user nova-compute[75672]:   <metadata>
Nov 30 12:46:43 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:46:43 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:46:43 user nova-compute[75672]:       <nova:name>tempest-TestVolumeBootPattern-server-882577862</nova:name>
Nov 30 12:46:43 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:46:42</nova:creationTime>
Nov 30 12:46:43 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:46:43 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:46:43 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:46:43 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:46:43 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:46:43 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:46:43 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:46:43 user nova-compute[75672]:       <nova:owner>
Nov 30 12:46:43 user nova-compute[75672]:         <nova:user uuid="924cf8ff73154f8fadb371175a0d8fc4">tempest-TestVolumeBootPattern-1743139468-project-member</nova:user>
Nov 30 12:46:43 user nova-compute[75672]:         <nova:project uuid="513644b3a140400dbdf6b07e8e727dd4">tempest-TestVolumeBootPattern-1743139468</nova:project>
Nov 30 12:46:43 user nova-compute[75672]:       </nova:owner>
Nov 30 12:46:43 user nova-compute[75672]:       <nova:ports>
Nov 30 12:46:43 user nova-compute[75672]:         <nova:port uuid="0a9fb28e-1985-4953-ae9f-308edfdb62a1">
Nov 30 12:46:43 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 12:46:43 user nova-compute[75672]:         </nova:port>
Nov 30 12:46:43 user nova-compute[75672]:       </nova:ports>
Nov 30 12:46:43 user nova-compute[75672]:     </nova:instance>
Nov 30 12:46:43 user nova-compute[75672]:   </metadata>
Nov 30 12:46:43 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:46:43 user nova-compute[75672]:     <system>
Nov 30 12:46:43 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:46:43 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:46:43 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:46:43 user nova-compute[75672]:       <entry name="serial">eb96c0c6-bcda-45b2-a7a5-308471a5003c</entry>
Nov 30 12:46:43 user nova-compute[75672]:       <entry name="uuid">eb96c0c6-bcda-45b2-a7a5-308471a5003c</entry>
Nov 30 12:46:43 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:46:43 user nova-compute[75672]:     </system>
Nov 30 12:46:43 user nova-compute[75672]:   </sysinfo>
Nov 30 12:46:43 user nova-compute[75672]:   <os>
Nov 30 12:46:43 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:46:43 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:46:43 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:46:43 user nova-compute[75672]:   </os>
Nov 30 12:46:43 user nova-compute[75672]:   <features>
Nov 30 12:46:43 user nova-compute[75672]:     <acpi/>
Nov 30 12:46:43 user nova-compute[75672]:     <apic/>
Nov 30 12:46:43 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:46:43 user nova-compute[75672]:   </features>
Nov 30 12:46:43 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:46:43 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:46:43 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:46:43 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:46:43 user nova-compute[75672]:   </clock>
Nov 30 12:46:43 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:46:43 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:46:43 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:46:43 user nova-compute[75672]:   </cpu>
Nov 30 12:46:43 user nova-compute[75672]:   <devices>
Nov 30 12:46:43 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:46:43 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:46:43 user nova-compute[75672]:       <source dev="/dev/sdb"/>
Nov 30 12:46:43 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:46:43 user nova-compute[75672]:       <serial>3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf</serial>
Nov 30 12:46:43 user nova-compute[75672]:     </disk>
Nov 30 12:46:43 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:46:43 user nova-compute[75672]:       <mac address="fa:16:3e:6e:b2:35"/>
Nov 30 12:46:43 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:46:43 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:46:43 user nova-compute[75672]:       <target dev="tap0a9fb28e-19"/>
Nov 30 12:46:43 user nova-compute[75672]:     </interface>
Nov 30 12:46:43 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:46:43 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/eb96c0c6-bcda-45b2-a7a5-308471a5003c/console.log" append="off"/>
Nov 30 12:46:43 user nova-compute[75672]:     </serial>
Nov 30 12:46:43 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:46:43 user nova-compute[75672]:     <video>
Nov 30 12:46:43 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:46:43 user nova-compute[75672]:     </video>
Nov 30 12:46:43 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:46:43 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:46:43 user nova-compute[75672]:     </rng>
Nov 30 12:46:43 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:46:43 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:46:43 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:46:43 user nova-compute[75672]:     </memballoon>
Nov 30 12:46:43 user nova-compute[75672]:   </devices>
Nov 30 12:46:43 user nova-compute[75672]: </domain>
Nov 30 12:46:43 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-882577862',display_name='tempest-TestVolumeBootPattern-server-882577862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-882577862',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/tiWnKVjyQ+YQ0wPEgFpD4sUWbk2GMRtR0fUhMrrhWzqEfZseqSV3bBKpPI9FNVcBh3EJSPDcri0dXJ24ST3AlMd1Z9vj5ezFGg5LMAjAiHzircmeHJyIgzk+4EYWw6A==',key_name='tempest-TestVolumeBootPattern-1453287901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-u41yb8zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:46:28Z,user_data=None,user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=eb96c0c6-bcda-45b2-a7a5-308471a5003c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "address": "fa:16:3e:6e:b2:35", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9fb28e-19", "ovs_interfaceid": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "address": "fa:16:3e:6e:b2:35", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9fb28e-19", "ovs_interfaceid": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b2:35,bridge_name='br-int',has_traffic_filtering=True,id=0a9fb28e-1985-4953-ae9f-308edfdb62a1,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a9fb28e-19') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG os_vif [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b2:35,bridge_name='br-int',has_traffic_filtering=True,id=0a9fb28e-1985-4953-ae9f-308edfdb62a1,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a9fb28e-19') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ba7b01d-502c-5d7f-8295-ccb4cb5b5140', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a9fb28e-19, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a9fb28e-19, col_values=(('qos', UUID('e1572db6-7630-4f6d-b60b-fcfc19ac2578')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a9fb28e-19, col_values=(('external_ids', {'iface-id': '0a9fb28e-1985-4953-ae9f-308edfdb62a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:b2:35', 'vm-uuid': 'eb96c0c6-bcda-45b2-a7a5-308471a5003c'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:43 user nova-compute[75672]: INFO os_vif [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b2:35,bridge_name='br-int',has_traffic_filtering=True,id=0a9fb28e-1985-4953-ae9f-308edfdb62a1,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a9fb28e-19')
Nov 30 12:46:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] No VIF found with MAC fa:16:3e:6e:b2:35, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:46:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:46:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-45de2ccd-2c01-4f06-8323-c3a75581770b req-38ce75ac-35d9-4fc6-ae90-0f3d3c074208 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Received event network-vif-plugged-0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-45de2ccd-2c01-4f06-8323-c3a75581770b req-38ce75ac-35d9-4fc6-ae90-0f3d3c074208 service nova] Acquiring lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-45de2ccd-2c01-4f06-8323-c3a75581770b req-38ce75ac-35d9-4fc6-ae90-0f3d3c074208 service nova] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-45de2ccd-2c01-4f06-8323-c3a75581770b req-38ce75ac-35d9-4fc6-ae90-0f3d3c074208 service nova] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-45de2ccd-2c01-4f06-8323-c3a75581770b req-38ce75ac-35d9-4fc6-ae90-0f3d3c074208 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] No waiting events found dispatching network-vif-plugged-0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:47 user nova-compute[75672]: WARNING nova.compute.manager [req-45de2ccd-2c01-4f06-8323-c3a75581770b req-38ce75ac-35d9-4fc6-ae90-0f3d3c074208 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Received unexpected event network-vif-plugged-0a9fb28e-1985-4953-ae9f-308edfdb62a1 for instance with vm_state building and task_state spawning.
Nov 30 12:46:47 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:46:47 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7652MB free_disk=25.224815368652344GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:47 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Instance spawned successfully.
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-8477edc7-4ccd-486b-998d-de8c194320fa req-4ce3f4f2-8edb-4afe-9a00-8cff3c5cba53 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Received event network-vif-plugged-0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8477edc7-4ccd-486b-998d-de8c194320fa req-4ce3f4f2-8edb-4afe-9a00-8cff3c5cba53 service nova] Acquiring lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8477edc7-4ccd-486b-998d-de8c194320fa req-4ce3f4f2-8edb-4afe-9a00-8cff3c5cba53 service nova] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8477edc7-4ccd-486b-998d-de8c194320fa req-4ce3f4f2-8edb-4afe-9a00-8cff3c5cba53 service nova] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-8477edc7-4ccd-486b-998d-de8c194320fa req-4ce3f4f2-8edb-4afe-9a00-8cff3c5cba53 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] No waiting events found dispatching network-vif-plugged-0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:47 user nova-compute[75672]: WARNING nova.compute.manager [req-8477edc7-4ccd-486b-998d-de8c194320fa req-4ce3f4f2-8edb-4afe-9a00-8cff3c5cba53 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Received unexpected event network-vif-plugged-0a9fb28e-1985-4953-ae9f-308edfdb62a1 for instance with vm_state building and task_state spawning.
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Applying migration context for instance f5851479-d09b-4d84-9553-2b09646f2b4f as it has an incoming, in-progress migration e6561f04-9963-430b-88b5-66f4f4b3f9a4. Migration status is finished {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 12:46:47 user nova-compute[75672]: INFO nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Updating resource usage from migration e6561f04-9963-430b-88b5-66f4f4b3f9a4
Nov 30 12:46:47 user nova-compute[75672]: INFO nova.compute.manager [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance b06bea0f-9186-4ab8-8bad-588beb48a1f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 4372bad4-2959-4c6f-bde0-29c8ecb166b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 87744aef-7e32-475b-907e-e30702d083bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Migration e6561f04-9963-430b-88b5-66f4f4b3f9a4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f5851479-d09b-4d84-9553-2b09646f2b4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance eb96c0c6-bcda-45b2-a7a5-308471a5003c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:46:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:46:47 user nova-compute[75672]: INFO nova.compute.manager [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Took 20.59 seconds to build instance.
Nov 30 12:46:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-4b2b5e98-bd88-4448-bee3-ab5ceadd9f7a tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.692s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:48 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:46:48 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:46:48 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:46:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:53 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:46:53 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:46:53 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:46:53 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:46:53 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:46:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:55 user nova-compute[75672]: INFO nova.compute.manager [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Terminating instance
Nov 30 12:46:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:46:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-124ba3d2-ffe0-48ff-a3d4-94d01f06ae29 req-20a41b27-bf56-49ca-ac49-4e54cca40237 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-unplugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-124ba3d2-ffe0-48ff-a3d4-94d01f06ae29 req-20a41b27-bf56-49ca-ac49-4e54cca40237 service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-124ba3d2-ffe0-48ff-a3d4-94d01f06ae29 req-20a41b27-bf56-49ca-ac49-4e54cca40237 service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-124ba3d2-ffe0-48ff-a3d4-94d01f06ae29 req-20a41b27-bf56-49ca-ac49-4e54cca40237 service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-124ba3d2-ffe0-48ff-a3d4-94d01f06ae29 req-20a41b27-bf56-49ca-ac49-4e54cca40237 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-unplugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-124ba3d2-ffe0-48ff-a3d4-94d01f06ae29 req-20a41b27-bf56-49ca-ac49-4e54cca40237 service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-unplugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:56 user nova-compute[75672]: INFO nova.compute.manager [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Terminating instance
Nov 30 12:46:56 user nova-compute[75672]: DEBUG nova.compute.manager [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG nova.compute.manager [req-3a9c863b-c74a-45f8-8a47-a63233d83e1d req-526349c8-7d78-4670-a6fd-95ab192b6da0 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received event network-vif-unplugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3a9c863b-c74a-45f8-8a47-a63233d83e1d req-526349c8-7d78-4670-a6fd-95ab192b6da0 service nova] Acquiring lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3a9c863b-c74a-45f8-8a47-a63233d83e1d req-526349c8-7d78-4670-a6fd-95ab192b6da0 service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3a9c863b-c74a-45f8-8a47-a63233d83e1d req-526349c8-7d78-4670-a6fd-95ab192b6da0 service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG nova.compute.manager [req-3a9c863b-c74a-45f8-8a47-a63233d83e1d req-526349c8-7d78-4670-a6fd-95ab192b6da0 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] No waiting events found dispatching network-vif-unplugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG nova.compute.manager [req-3a9c863b-c74a-45f8-8a47-a63233d83e1d req-526349c8-7d78-4670-a6fd-95ab192b6da0 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received event network-vif-unplugged-c4ce626e-d884-4b19-a03a-55ca1085e3be for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:46:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:57 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Instance destroyed successfully.
Nov 30 12:46:57 user nova-compute[75672]: DEBUG nova.objects.instance [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'resources' on Instance uuid b06bea0f-9186-4ab8-8bad-588beb48a1f1 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:46:57 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Instance destroyed successfully.
Nov 30 12:46:57 user nova-compute[75672]: DEBUG nova.objects.instance [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lazy-loading 'resources' on Instance uuid 4372bad4-2959-4c6f-bde0-29c8ecb166b7 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:40:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1869500337',display_name='tempest-ServerRescueNegativeTestJSON-server-1869500337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1869500337',id=25,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKvX8kREpKHdh7QTeqLrDuWRIr/0HgYYg/g29TAlyvhlnFXG14JSKT5CfnTGyflUqYYfYdN7lRf5nU1oNeKgDqmKR3vKW6jKYX535rLOk8b3qYyPl+hAKXOZnV2LrefZA==',key_name='tempest-keypair-1145147896',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:42:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='601d2f3e56844b68b3a0c71f8a7f5454',ramdisk_id='',reservation_id='r-res9s6m6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-928198583',owner_user_name='tempest-ServerRescueNegativeTestJSON-928198583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61c6bf770dfe4eadba28f371b29f1d79',uuid=b06bea0f-9186-4ab8-8bad-588beb48a1f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converting VIF {"id": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "address": "fa:16:3e:64:5c:19", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d9e2a3-ef", "ovs_interfaceid": "e5d9e2a3-ef19-41bb-b090-13c40c8986ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e5d9e2a3-ef19-41bb-b090-13c40c8986ee,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5d9e2a3-ef') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG os_vif [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e5d9e2a3-ef19-41bb-b090-13c40c8986ee,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5d9e2a3-ef') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5d9e2a3-ef, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:45:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1207437810',display_name='tempest-VolumesActionsTest-instance-1207437810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1207437810',id=33,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:45:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa5dfd98cc2e410db49639a642b13975',ramdisk_id='',reservation_id='r-vmayfj0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-364551348',owner_user_name='tempest-VolumesActionsTest-364551348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:45:12Z,user_data=None,user_id='abe9ecbcfe7e444c9946400a062e2b7a',uuid=4372bad4-2959-4c6f-bde0-29c8ecb166b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "address": "fa:16:3e:87:75:c8", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ce626e-d8", "ovs_interfaceid": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Converting VIF {"id": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "address": "fa:16:3e:87:75:c8", "network": {"id": "ad88a05e-9702-4570-8363-f905f54e7c19", "bridge": "br-int", "label": "tempest-VolumesActionsTest-762018013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5dfd98cc2e410db49639a642b13975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ce626e-d8", "ovs_interfaceid": "c4ce626e-d884-4b19-a03a-55ca1085e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:75:c8,bridge_name='br-int',has_traffic_filtering=True,id=c4ce626e-d884-4b19-a03a-55ca1085e3be,network=Network(ad88a05e-9702-4570-8363-f905f54e7c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ce626e-d8') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG os_vif [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:75:c8,bridge_name='br-int',has_traffic_filtering=True,id=c4ce626e-d884-4b19-a03a-55ca1085e3be,network=Network(ad88a05e-9702-4570-8363-f905f54e7c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ce626e-d8') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4ce626e-d8, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5b05e75-848c-4d21-a725-f32870bebf5d) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a3228c7-c07b-4d9d-a3a2-33097805aa13) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:57 user nova-compute[75672]: INFO os_vif [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e5d9e2a3-ef19-41bb-b090-13c40c8986ee,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5d9e2a3-ef')
Nov 30 12:46:57 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Deleting instance files /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1_del
Nov 30 12:46:57 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Deletion of /opt/stack/data/nova/instances/b06bea0f-9186-4ab8-8bad-588beb48a1f1_del complete
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:46:57 user nova-compute[75672]: INFO os_vif [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:75:c8,bridge_name='br-int',has_traffic_filtering=True,id=c4ce626e-d884-4b19-a03a-55ca1085e3be,network=Network(ad88a05e-9702-4570-8363-f905f54e7c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ce626e-d8')
Nov 30 12:46:57 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Deleting instance files /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7_del
Nov 30 12:46:57 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Deletion of /opt/stack/data/nova/instances/4372bad4-2959-4c6f-bde0-29c8ecb166b7_del complete
Nov 30 12:46:57 user nova-compute[75672]: INFO nova.compute.manager [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 30 12:46:57 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:46:57 user nova-compute[75672]: INFO nova.compute.manager [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Took 1.66 seconds to destroy the instance on the hypervisor.
Nov 30 12:46:57 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:58 user nova-compute[75672]: WARNING nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received unexpected event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with vm_state active and task_state deleting.
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:58 user nova-compute[75672]: WARNING nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received unexpected event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with vm_state active and task_state deleting.
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:58 user nova-compute[75672]: WARNING nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received unexpected event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with vm_state active and task_state deleting.
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-unplugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-unplugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-unplugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Acquiring lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] No waiting events found dispatching network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:58 user nova-compute[75672]: WARNING nova.compute.manager [req-a887a982-d043-4caf-946e-86e3e33b7fb9 req-1c2fd9a2-ba9a-47ff-ba53-3066556f081d service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received unexpected event network-vif-plugged-e5d9e2a3-ef19-41bb-b090-13c40c8986ee for instance with vm_state active and task_state deleting.
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received event network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Acquiring lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] No waiting events found dispatching network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:58 user nova-compute[75672]: WARNING nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received unexpected event network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be for instance with vm_state active and task_state deleting.
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received event network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Acquiring lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] No waiting events found dispatching network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:58 user nova-compute[75672]: WARNING nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received unexpected event network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be for instance with vm_state active and task_state deleting.
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received event network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Acquiring lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] No waiting events found dispatching network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:58 user nova-compute[75672]: WARNING nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received unexpected event network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be for instance with vm_state active and task_state deleting.
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received event network-vif-unplugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Acquiring lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] No waiting events found dispatching network-vif-unplugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received event network-vif-unplugged-c4ce626e-d884-4b19-a03a-55ca1085e3be for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received event network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Acquiring lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] No waiting events found dispatching network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:46:58 user nova-compute[75672]: WARNING nova.compute.manager [req-8e8f081b-5115-4a50-b68a-1d052230ab4f req-0ce1e81f-e407-4dcb-9ef1-4f5ca15cb856 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received unexpected event network-vif-plugged-c4ce626e-d884-4b19-a03a-55ca1085e3be for instance with vm_state active and task_state deleting.
Nov 30 12:46:59 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:46:59 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Took 1.87 seconds to deallocate network for instance.
Nov 30 12:46:59 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:46:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-55e98985-659a-4ebd-974a-e8b28b0d9b2f req-53ab6e66-5c54-4ab7-9b38-80e3654f9971 service nova] [instance: 4372bad4-2959-4c6f-bde0-29c8ecb166b7] Received event network-vif-deleted-c4ce626e-d884-4b19-a03a-55ca1085e3be {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:46:59 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Took 1.87 seconds to deallocate network for instance.
Nov 30 12:46:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:46:59 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:46:59 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:46:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:46:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.403s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:46:59 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Deleted allocations for instance 4372bad4-2959-4c6f-bde0-29c8ecb166b7
Nov 30 12:46:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-acbabeb8-308c-4e81-8986-7d7c2263273c tempest-VolumesActionsTest-364551348 tempest-VolumesActionsTest-364551348-project-member] Lock "4372bad4-2959-4c6f-bde0-29c8ecb166b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.803s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:00 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:47:00 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:47:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:00 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Deleted allocations for instance b06bea0f-9186-4ab8-8bad-588beb48a1f1
Nov 30 12:47:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f2d5d97c-e200-4144-9931-297e0fd93e28 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "b06bea0f-9186-4ab8-8bad-588beb48a1f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.585s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:01 user nova-compute[75672]: DEBUG nova.compute.manager [req-07990e07-0de7-4926-854f-615980f4d453 req-2b41f668-7c1c-4c1b-abdc-157f80e226df service nova] [instance: b06bea0f-9186-4ab8-8bad-588beb48a1f1] Received event network-vif-deleted-e5d9e2a3-ef19-41bb-b090-13c40c8986ee {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:05 user nova-compute[75672]: INFO nova.compute.manager [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Rescuing
Nov 30 12:47:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:47:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquired lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:47:05 user nova-compute[75672]: DEBUG nova.network.neutron [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:47:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:06 user nova-compute[75672]: DEBUG nova.network.neutron [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Updating instance_info_cache with network_info: [{"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:47:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Releasing lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:47:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-0216e761-b137-4950-bec9-0e6215ada611 req-56ffd17c-2dca-4a8c-a15e-5c2692fde493 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-unplugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0216e761-b137-4950-bec9-0e6215ada611 req-56ffd17c-2dca-4a8c-a15e-5c2692fde493 service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0216e761-b137-4950-bec9-0e6215ada611 req-56ffd17c-2dca-4a8c-a15e-5c2692fde493 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0216e761-b137-4950-bec9-0e6215ada611 req-56ffd17c-2dca-4a8c-a15e-5c2692fde493 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-0216e761-b137-4950-bec9-0e6215ada611 req-56ffd17c-2dca-4a8c-a15e-5c2692fde493 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-unplugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:47:06 user nova-compute[75672]: WARNING nova.compute.manager [req-0216e761-b137-4950-bec9-0e6215ada611 req-56ffd17c-2dca-4a8c-a15e-5c2692fde493 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-unplugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state active and task_state rescuing.
Nov 30 12:47:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:07 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Instance destroyed successfully.
Nov 30 12:47:07 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Attempting a stable device rescue
Nov 30 12:47:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75672) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Nov 30 12:47:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Instance directory exists: not creating {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Nov 30 12:47:07 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Creating image(s)
Nov 30 12:47:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "/opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "/opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "/opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:07 user nova-compute[75672]: DEBUG nova.objects.instance [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'trusted_certs' on Instance uuid 47ac940e-edbd-4732-ac04-e242709ee894 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:47:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "185a84359485fd1e8ee42f7859997ee85af80f44" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "185a84359485fd1e8ee42f7859997ee85af80f44" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44.part --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44.part --force-share --output=json" returned: 0 in 0.225s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:08 user nova-compute[75672]: DEBUG nova.virt.images [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] 9ea8428c-afbe-4ab3-ba6b-7e0a8b2f4d60 was qcow2, converting to raw {{(pid=75672) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 12:47:08 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:47:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44.part /opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44.converted {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-3f72009b-e2a6-4069-9bc9-22c026efbc0f req-0b4349ef-b130-4be1-b814-0a5bc33daa68 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3f72009b-e2a6-4069-9bc9-22c026efbc0f req-0b4349ef-b130-4be1-b814-0a5bc33daa68 service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3f72009b-e2a6-4069-9bc9-22c026efbc0f req-0b4349ef-b130-4be1-b814-0a5bc33daa68 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3f72009b-e2a6-4069-9bc9-22c026efbc0f req-0b4349ef-b130-4be1-b814-0a5bc33daa68 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-3f72009b-e2a6-4069-9bc9-22c026efbc0f req-0b4349ef-b130-4be1-b814-0a5bc33daa68 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:47:08 user nova-compute[75672]: WARNING nova.compute.manager [req-3f72009b-e2a6-4069-9bc9-22c026efbc0f req-0b4349ef-b130-4be1-b814-0a5bc33daa68 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state active and task_state rescuing.
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44.part /opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44.converted" returned: 0 in 0.419s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44.converted --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "185a84359485fd1e8ee42f7859997ee85af80f44" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.923s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "185a84359485fd1e8ee42f7859997ee85af80f44" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "185a84359485fd1e8ee42f7859997ee85af80f44" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44 --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44,backing_fmt=raw /opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/disk.rescue {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44,backing_fmt=raw /opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/disk.rescue" returned: 0 in 0.059s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "185a84359485fd1e8ee42f7859997ee85af80f44" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.objects.instance [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'migration_context' on Instance uuid 47ac940e-edbd-4732-ac04-e242709ee894 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.objects.base [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Object Instance<47ac940e-edbd-4732-ac04-e242709ee894> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Start _get_guest_xml network_info=[{"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "vif_mac": "fa:16:3e:76:3f:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9ea8428c-afbe-4ab3-ba6b-7e0a8b2f4d60', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '5f55fde7-ed77-497a-b435-c238f0ed5550', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdhfyGUb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '47ac940e-edbd-4732-ac04-e242709ee894', 'attached_at': '', 'detached_at': '', 'volume_id': '0fdbfd07-f8d4-4bf9-8102-232b67482e38', 'serial': '0fdbfd07-f8d4-4bf9-8102-232b67482e38'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.objects.instance [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'resources' on Instance uuid 47ac940e-edbd-4732-ac04-e242709ee894 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.objects.base [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Object Instance<47ac940e-edbd-4732-ac04-e242709ee894> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.objects.instance [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'numa_topology' on Instance uuid 47ac940e-edbd-4732-ac04-e242709ee894 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.objects.base [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Object Instance<47ac940e-edbd-4732-ac04-e242709ee894> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:47:09 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:47:09 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.objects.instance [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'vcpu_model' on Instance uuid 47ac940e-edbd-4732-ac04-e242709ee894 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.objects.base [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Object Instance<47ac940e-edbd-4732-ac04-e242709ee894> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdhfyGUb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:47:09 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:47:09 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:47:09 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cf1a6e-398a-413f-b90e-cfaefd1bc5af]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ZdhfyGUb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 12:47:09 user nova-compute[75672]: node.name = iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:47:09 user nova-compute[75672]: node.tpgt = -1
Nov 30 12:47:09 user nova-compute[75672]: node.startup = automatic
Nov 30 12:47:09 user nova-compute[75672]: node.leading_login = No
Nov 30 12:47:09 user nova-compute[75672]: iface.iscsi_ifacename = default
Nov 30 12:47:09 user nova-compute[75672]: iface.net_ifacename = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.ipaddress = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.prefix_len = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.hwaddress = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.transport_name = tcp
Nov 30 12:47:09 user nova-compute[75672]: iface.initiatorname = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.state = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.vlan_id = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.vlan_priority = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.vlan_state = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.iface_num = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.mtu = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.port = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.bootproto = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.subnet_mask = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.gateway = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.dhcp_alt_client_id = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.dhcp_dns = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.dhcp_learn_iqn = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.dhcp_vendor_id_state = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.dhcp_vendor_id = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.dhcp_slp_da = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.fragmentation = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.gratuitous_arp = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.incoming_forwarding = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.tos_state = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.tos = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.ttl = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.delayed_ack = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.tcp_nagle = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.tcp_wsf_state = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.tcp_wsf = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.tcp_timer_scale = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.tcp_timestamp = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.redirect = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.def_task_mgmt_timeout = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.header_digest = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.data_digest = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.immediate_data = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.initial_r2t = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.data_seq_inorder = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.data_pdu_inorder = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.erl = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.max_receive_data_len = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.first_burst_len = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.max_outstanding_r2t = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.max_burst_len = 0
Nov 30 12:47:09 user nova-compute[75672]: iface.chap_auth = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.bidi_chap = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.strict_login_compliance = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.discovery_auth = <empty>
Nov 30 12:47:09 user nova-compute[75672]: iface.discovery_logout = <empty>
Nov 30 12:47:09 user nova-compute[75672]: node.discovery_address = <empty>
Nov 30 12:47:09 user nova-compute[75672]: node.discovery_port = 0
Nov 30 12:47:09 user nova-compute[75672]: node.discovery_type = static
Nov 30 12:47:09 user nova-compute[75672]: node.session.initial_cmdsn = 0
Nov 30 12:47:09 user nova-compute[75672]: node.session.initial_login_retry_max = 8
Nov 30 12:47:09 user nova-compute[75672]: node.session.xmit_thread_priority = -20
Nov 30 12:47:09 user nova-compute[75672]: node.session.cmds_max = 128
Nov 30 12:47:09 user nova-compute[75672]: node.session.queue_depth = 32
Nov 30 12:47:09 user nova-compute[75672]: node.session.nr_sessions = 1
Nov 30 12:47:09 user nova-compute[75672]: node.session.auth.authmethod = CHAP
Nov 30 12:47:09 user nova-compute[75672]: node.session.auth.username = ZdhfyGUb
Nov 30 12:47:09 user nova-compute[75672]: node.session.auth.password = ***
Nov 30 12:47:09 user nova-compute[75672]: node.session.auth.username_in = <empty>
Nov 30 12:47:09 user nova-compute[75672]: node.session.auth.password_in = <empty>
Nov 30 12:47:09 user nova-compute[75672]: node.session.auth.chap_algs = MD5
Nov 30 12:47:09 user nova-compute[75672]: node.session.timeo.replacement_timeout = 120
Nov 30 12:47:09 user nova-compute[75672]: node.session.err_timeo.abort_timeout = 15
Nov 30 12:47:09 user nova-compute[75672]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 12:47:09 user nova-compute[75672]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 12:47:09 user nova-compute[75672]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 12:47:09 user nova-compute[75672]: node.session.iscsi.FastAbort = Yes
Nov 30 12:47:09 user nova-compute[75672]: node.session.iscsi.InitialR2T = No
Nov 30 12:47:09 user nova-compute[75672]: node.session.iscsi.ImmediateData = Yes
Nov 30 12:47:09 user nova-compute[75672]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 12:47:09 user nova-compute[75672]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 12:47:09 user nova-compute[75672]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 12:47:09 user nova-compute[75672]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 12:47:09 user nova-compute[75672]: node.session.iscsi.MaxConnections = 1
Nov 30 12:47:09 user nova-compute[75672]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 12:47:09 user nova-compute[75672]: node.session.iscsi.ERL = 0
Nov 30 12:47:09 user nova-compute[75672]: node.session.scan = manual
Nov 30 12:47:09 user nova-compute[75672]: node.session.reopen_max = 0
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].address = 172.16.0.220
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].port = 3260
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].startup = manual
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].tcp.window_size = 524288
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].tcp.type_of_service = 0
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].timeo.logout_timeout = 15
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].timeo.login_timeout = 15
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].timeo.auth_timeout = 45
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].iscsi.DataDigest = None
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].iscsi.IFMarker = No
Nov 30 12:47:09 user nova-compute[75672]: node.conn[0].iscsi.OFMarker = No
Nov 30 12:47:09 user nova-compute[75672]: # END RECORD
Nov 30 12:47:09 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cdf53e-ed9c-4218-ad49-8bf63d623b37]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[02304e51-3045-48fa-9c8f-7288de5eee59]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdhfyGUb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdhfyGUb" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[97906d6e-42af-4a35-96be-cc9ea09e219e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZdhfyGUb'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a830cb-4c4e-4ce5-8ece-df3a57f93b4c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c192456-46ef-4a45-a379-e09a47dd2bb9]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:47:09 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:47:09 user nova-compute[75672]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:47:09 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:47:09 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:47:09 user nova-compute[75672]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:47:09 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.162s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] HCTL ('35', '0', '0', 0) found on session 39 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b54d9cf-0e73-4629-a5cb-1839fe3f5497]: (4, ('0 0 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching for a device in session 39 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdhfyGUb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.189s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] <== connect_volume: return (192ms) {'type': 'block', 'scsi_wwn': '26331353234376130', 'path': '/dev/sdd'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331353234376130', 'path': '/dev/sdd'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1500274755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1500274755',id=34,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:45:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47874c48ecea456eac7968640910afba',ramdisk_id='',reservation_id='r-mu7ztrq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-547265583',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:45:37Z,user_data=None,user_id='aa5b3c989c934220a07aba162e68ea87',uuid=47ac940e-edbd-4732-ac04-e242709ee894,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "vif_mac": "fa:16:3e:76:3f:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converting VIF {"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "vif_mac": "fa:16:3e:76:3f:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:3f:ff,bridge_name='br-int',has_traffic_filtering=True,id=e153586a-8cf1-4e2d-838d-a0eadd151858,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153586a-8c') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:47:09 user nova-compute[75672]: DEBUG nova.objects.instance [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'pci_devices' on Instance uuid 47ac940e-edbd-4732-ac04-e242709ee894 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:47:10 user nova-compute[75672]: DEBUG nova.objects.base [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Object Instance<47ac940e-edbd-4732-ac04-e242709ee894> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:47:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:47:10 user nova-compute[75672]:   <uuid>47ac940e-edbd-4732-ac04-e242709ee894</uuid>
Nov 30 12:47:10 user nova-compute[75672]:   <name>instance-00000022</name>
Nov 30 12:47:10 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:47:10 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:47:10 user nova-compute[75672]:   <metadata>
Nov 30 12:47:10 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:47:10 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:47:10 user nova-compute[75672]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1500274755</nova:name>
Nov 30 12:47:10 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:47:09</nova:creationTime>
Nov 30 12:47:10 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:47:10 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:47:10 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:47:10 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:47:10 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:47:10 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:47:10 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:47:10 user nova-compute[75672]:       <nova:owner>
Nov 30 12:47:10 user nova-compute[75672]:         <nova:user uuid="aa5b3c989c934220a07aba162e68ea87">tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member</nova:user>
Nov 30 12:47:10 user nova-compute[75672]:         <nova:project uuid="47874c48ecea456eac7968640910afba">tempest-ServerBootFromVolumeStableRescueTest-547265583</nova:project>
Nov 30 12:47:10 user nova-compute[75672]:       </nova:owner>
Nov 30 12:47:10 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:47:10 user nova-compute[75672]:       <nova:ports>
Nov 30 12:47:10 user nova-compute[75672]:         <nova:port uuid="e153586a-8cf1-4e2d-838d-a0eadd151858">
Nov 30 12:47:10 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 12:47:10 user nova-compute[75672]:         </nova:port>
Nov 30 12:47:10 user nova-compute[75672]:       </nova:ports>
Nov 30 12:47:10 user nova-compute[75672]:     </nova:instance>
Nov 30 12:47:10 user nova-compute[75672]:   </metadata>
Nov 30 12:47:10 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:47:10 user nova-compute[75672]:     <system>
Nov 30 12:47:10 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:47:10 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:47:10 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:47:10 user nova-compute[75672]:       <entry name="serial">47ac940e-edbd-4732-ac04-e242709ee894</entry>
Nov 30 12:47:10 user nova-compute[75672]:       <entry name="uuid">47ac940e-edbd-4732-ac04-e242709ee894</entry>
Nov 30 12:47:10 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:47:10 user nova-compute[75672]:     </system>
Nov 30 12:47:10 user nova-compute[75672]:   </sysinfo>
Nov 30 12:47:10 user nova-compute[75672]:   <os>
Nov 30 12:47:10 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:47:10 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:47:10 user nova-compute[75672]:   </os>
Nov 30 12:47:10 user nova-compute[75672]:   <features>
Nov 30 12:47:10 user nova-compute[75672]:     <acpi/>
Nov 30 12:47:10 user nova-compute[75672]:     <apic/>
Nov 30 12:47:10 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:47:10 user nova-compute[75672]:   </features>
Nov 30 12:47:10 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:47:10 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:47:10 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:47:10 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:47:10 user nova-compute[75672]:   </clock>
Nov 30 12:47:10 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:47:10 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:47:10 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:47:10 user nova-compute[75672]:   </cpu>
Nov 30 12:47:10 user nova-compute[75672]:   <devices>
Nov 30 12:47:10 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:47:10 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:47:10 user nova-compute[75672]:       <source dev="/dev/sdd"/>
Nov 30 12:47:10 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:47:10 user nova-compute[75672]:       <serial>0fdbfd07-f8d4-4bf9-8102-232b67482e38</serial>
Nov 30 12:47:10 user nova-compute[75672]:     </disk>
Nov 30 12:47:10 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:47:10 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:47:10 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/disk.rescue"/>
Nov 30 12:47:10 user nova-compute[75672]:       <target dev="vdb" bus="virtio"/>
Nov 30 12:47:10 user nova-compute[75672]:       <boot order="1"/>
Nov 30 12:47:10 user nova-compute[75672]:     </disk>
Nov 30 12:47:10 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:47:10 user nova-compute[75672]:       <mac address="fa:16:3e:76:3f:ff"/>
Nov 30 12:47:10 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:47:10 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:47:10 user nova-compute[75672]:       <target dev="tape153586a-8c"/>
Nov 30 12:47:10 user nova-compute[75672]:     </interface>
Nov 30 12:47:10 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:47:10 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/console.log" append="off"/>
Nov 30 12:47:10 user nova-compute[75672]:     </serial>
Nov 30 12:47:10 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:47:10 user nova-compute[75672]:     <video>
Nov 30 12:47:10 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:47:10 user nova-compute[75672]:     </video>
Nov 30 12:47:10 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:47:10 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:47:10 user nova-compute[75672]:     </rng>
Nov 30 12:47:10 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:47:10 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:47:10 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:47:10 user nova-compute[75672]:     </memballoon>
Nov 30 12:47:10 user nova-compute[75672]:   </devices>
Nov 30 12:47:10 user nova-compute[75672]: </domain>
Nov 30 12:47:10 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:47:10 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Instance destroyed successfully.
Nov 30 12:47:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:47:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:47:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] No VIF found with MAC fa:16:3e:76:3f:ff, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:47:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-0ca7877a-087a-4193-80d7-62e89066fceb req-bc108687-1090-4c95-a4a8-4b38c7249d9f service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0ca7877a-087a-4193-80d7-62e89066fceb req-bc108687-1090-4c95-a4a8-4b38c7249d9f service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0ca7877a-087a-4193-80d7-62e89066fceb req-bc108687-1090-4c95-a4a8-4b38c7249d9f service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0ca7877a-087a-4193-80d7-62e89066fceb req-bc108687-1090-4c95-a4a8-4b38c7249d9f service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-0ca7877a-087a-4193-80d7-62e89066fceb req-bc108687-1090-4c95-a4a8-4b38c7249d9f service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:47:11 user nova-compute[75672]: WARNING nova.compute.manager [req-0ca7877a-087a-4193-80d7-62e89066fceb req-bc108687-1090-4c95-a4a8-4b38c7249d9f service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state active and task_state rescuing.
Nov 30 12:47:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-24b467c2-cb93-4c7b-8355-61a6667d1a5f req-28e6c0f3-dd9f-4a42-946e-5b33bb307130 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-24b467c2-cb93-4c7b-8355-61a6667d1a5f req-28e6c0f3-dd9f-4a42-946e-5b33bb307130 service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-24b467c2-cb93-4c7b-8355-61a6667d1a5f req-28e6c0f3-dd9f-4a42-946e-5b33bb307130 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-24b467c2-cb93-4c7b-8355-61a6667d1a5f req-28e6c0f3-dd9f-4a42-946e-5b33bb307130 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-24b467c2-cb93-4c7b-8355-61a6667d1a5f req-28e6c0f3-dd9f-4a42-946e-5b33bb307130 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:47:13 user nova-compute[75672]: WARNING nova.compute.manager [req-24b467c2-cb93-4c7b-8355-61a6667d1a5f req-28e6c0f3-dd9f-4a42-946e-5b33bb307130 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state active and task_state rescuing.
Nov 30 12:47:13 user nova-compute[75672]: DEBUG nova.compute.manager [None req-fb9a16ba-c069-4d01-aa20-896a9244ced2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:47:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "c00b64bd-8011-4609-8953-315f1e655930" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "c00b64bd-8011-4609-8953-315f1e655930" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:15 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:47:16 user nova-compute[75672]: INFO nova.compute.claims [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Claim successful on node user
Nov 30 12:47:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:47:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:47:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG nova.policy [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa04e80eda5248478efbdcc04f68d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a515a90e05403281db278fd0da0516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:47:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Creating image(s)
Nov 30 12:47:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "/opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "/opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "/opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG nova.compute.manager [req-6793076a-803a-4c08-846e-0a7a4b275f15 req-74cf3bd1-2e13-4924-b927-47f8b0a30877 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-changed-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG nova.compute.manager [req-6793076a-803a-4c08-846e-0a7a4b275f15 req-74cf3bd1-2e13-4924-b927-47f8b0a30877 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Refreshing instance network info cache due to event network-changed-fb7cf9cd-ce27-4327-97ad-1c2692de57e7. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6793076a-803a-4c08-846e-0a7a4b275f15 req-74cf3bd1-2e13-4924-b927-47f8b0a30877 service nova] Acquiring lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6793076a-803a-4c08-846e-0a7a4b275f15 req-74cf3bd1-2e13-4924-b927-47f8b0a30877 service nova] Acquired lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG nova.network.neutron [req-6793076a-803a-4c08-846e-0a7a4b275f15 req-74cf3bd1-2e13-4924-b927-47f8b0a30877 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Refreshing network info cache for port fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.222s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk 1073741824" returned: 0 in 0.090s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.197s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Cannot resize image /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Ensure instance console log exists: /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:18 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Successfully created port: 7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:47:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "f5851479-d09b-4d84-9553-2b09646f2b4f" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:18 user nova-compute[75672]: DEBUG nova.compute.manager [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Going to confirm migration 2 {{(pid=75672) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 30 12:47:18 user nova-compute[75672]: DEBUG nova.compute.manager [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:47:18 user nova-compute[75672]: INFO nova.compute.manager [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] instance snapshotting
Nov 30 12:47:18 user nova-compute[75672]: DEBUG nova.network.neutron [req-6793076a-803a-4c08-846e-0a7a4b275f15 req-74cf3bd1-2e13-4924-b927-47f8b0a30877 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updated VIF entry in instance network info cache for port fb7cf9cd-ce27-4327-97ad-1c2692de57e7. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:47:18 user nova-compute[75672]: DEBUG nova.network.neutron [req-6793076a-803a-4c08-846e-0a7a4b275f15 req-74cf3bd1-2e13-4924-b927-47f8b0a30877 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updating instance_info_cache with network_info: [{"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:47:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:47:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquired lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:47:18 user nova-compute[75672]: DEBUG nova.network.neutron [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:47:18 user nova-compute[75672]: DEBUG nova.objects.instance [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lazy-loading 'info_cache' on Instance uuid f5851479-d09b-4d84-9553-2b09646f2b4f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:47:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6793076a-803a-4c08-846e-0a7a4b275f15 req-74cf3bd1-2e13-4924-b927-47f8b0a30877 service nova] Releasing lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:47:18 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Beginning live snapshot process
Nov 30 12:47:18 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json -f qcow2 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json -f qcow2 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Successfully updated port: 7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "refresh_cache-c00b64bd-8011-4609-8953-315f1e655930" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquired lock "refresh_cache-c00b64bd-8011-4609-8953-315f1e655930" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.compute.manager [req-0bac2193-6e63-4900-99c0-0f4966db9632 req-1536e4bb-333d-4d93-bcef-ff17973ca279 service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Received event network-changed-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.compute.manager [req-0bac2193-6e63-4900-99c0-0f4966db9632 req-1536e4bb-333d-4d93-bcef-ff17973ca279 service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Refreshing instance network info cache due to event network-changed-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0bac2193-6e63-4900-99c0-0f4966db9632 req-1536e4bb-333d-4d93-bcef-ff17973ca279 service nova] Acquiring lock "refresh_cache-c00b64bd-8011-4609-8953-315f1e655930" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.network.neutron [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Updating instance_info_cache with network_info: [{"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Releasing lock "refresh_cache-f5851479-d09b-4d84-9553-2b09646f2b4f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.objects.instance [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lazy-loading 'migration_context' on Instance uuid f5851479-d09b-4d84-9553-2b09646f2b4f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.objects.base [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Object Instance<f5851479-d09b-4d84-9553-2b09646f2b4f> lazy-loaded attributes: info_cache,migration_context {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.208s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0wpkr4t2/ef36a75bb57f4cdab78ea4a4a1ac43da.delta 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0wpkr4t2/ef36a75bb57f4cdab78ea4a4a1ac43da.delta 1073741824" returned: 0 in 0.054s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:19 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Updating instance_info_cache with network_info: [{"id": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "address": "fa:16:3e:d5:5a:b2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1b4262-1c", "ovs_interfaceid": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Releasing lock "refresh_cache-c00b64bd-8011-4609-8953-315f1e655930" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Instance network_info: |[{"id": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "address": "fa:16:3e:d5:5a:b2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1b4262-1c", "ovs_interfaceid": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0bac2193-6e63-4900-99c0-0f4966db9632 req-1536e4bb-333d-4d93-bcef-ff17973ca279 service nova] Acquired lock "refresh_cache-c00b64bd-8011-4609-8953-315f1e655930" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.network.neutron [req-0bac2193-6e63-4900-99c0-0f4966db9632 req-1536e4bb-333d-4d93-bcef-ff17973ca279 service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Refreshing network info cache for port 7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Start _get_guest_xml network_info=[{"id": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "address": "fa:16:3e:d5:5a:b2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1b4262-1c", "ovs_interfaceid": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:47:19 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:47:19 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:47:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-506734386',display_name='tempest-ServersNegativeTestJSON-server-506734386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-506734386',id=37,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5a515a90e05403281db278fd0da0516',ramdisk_id='',reservation_id='r-1ms9zekp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-69784533',owner_user_name='tempest-ServersNegativeTestJSON-69784533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:47:17Z,user_data=None,user_id='aa04e80eda5248478efbdcc04f68d79f',uuid=c00b64bd-8011-4609-8953-315f1e655930,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "address": "fa:16:3e:d5:5a:b2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1b4262-1c", "ovs_interfaceid": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Converting VIF {"id": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "address": "fa:16:3e:d5:5a:b2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1b4262-1c", "ovs_interfaceid": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:5a:b2,bridge_name='br-int',has_traffic_filtering=True,id=7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2,network=Network(01af390a-7f78-4062-bb05-a7cc50446933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b1b4262-1c') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.objects.instance [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lazy-loading 'pci_devices' on Instance uuid c00b64bd-8011-4609-8953-315f1e655930 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:47:19 user nova-compute[75672]:   <uuid>c00b64bd-8011-4609-8953-315f1e655930</uuid>
Nov 30 12:47:19 user nova-compute[75672]:   <name>instance-00000025</name>
Nov 30 12:47:19 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:47:19 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:47:19 user nova-compute[75672]:   <metadata>
Nov 30 12:47:19 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:47:19 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:47:19 user nova-compute[75672]:       <nova:name>tempest-ServersNegativeTestJSON-server-506734386</nova:name>
Nov 30 12:47:19 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:47:19</nova:creationTime>
Nov 30 12:47:19 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:47:19 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:47:19 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:47:19 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:47:19 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:47:19 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:47:19 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:47:19 user nova-compute[75672]:       <nova:owner>
Nov 30 12:47:19 user nova-compute[75672]:         <nova:user uuid="aa04e80eda5248478efbdcc04f68d79f">tempest-ServersNegativeTestJSON-69784533-project-member</nova:user>
Nov 30 12:47:19 user nova-compute[75672]:         <nova:project uuid="e5a515a90e05403281db278fd0da0516">tempest-ServersNegativeTestJSON-69784533</nova:project>
Nov 30 12:47:19 user nova-compute[75672]:       </nova:owner>
Nov 30 12:47:19 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:47:19 user nova-compute[75672]:       <nova:ports>
Nov 30 12:47:19 user nova-compute[75672]:         <nova:port uuid="7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2">
Nov 30 12:47:19 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 12:47:19 user nova-compute[75672]:         </nova:port>
Nov 30 12:47:19 user nova-compute[75672]:       </nova:ports>
Nov 30 12:47:19 user nova-compute[75672]:     </nova:instance>
Nov 30 12:47:19 user nova-compute[75672]:   </metadata>
Nov 30 12:47:19 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:47:19 user nova-compute[75672]:     <system>
Nov 30 12:47:19 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:47:19 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:47:19 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:47:19 user nova-compute[75672]:       <entry name="serial">c00b64bd-8011-4609-8953-315f1e655930</entry>
Nov 30 12:47:19 user nova-compute[75672]:       <entry name="uuid">c00b64bd-8011-4609-8953-315f1e655930</entry>
Nov 30 12:47:19 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:47:19 user nova-compute[75672]:     </system>
Nov 30 12:47:19 user nova-compute[75672]:   </sysinfo>
Nov 30 12:47:19 user nova-compute[75672]:   <os>
Nov 30 12:47:19 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:47:19 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:47:19 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:47:19 user nova-compute[75672]:   </os>
Nov 30 12:47:19 user nova-compute[75672]:   <features>
Nov 30 12:47:19 user nova-compute[75672]:     <acpi/>
Nov 30 12:47:19 user nova-compute[75672]:     <apic/>
Nov 30 12:47:19 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:47:19 user nova-compute[75672]:   </features>
Nov 30 12:47:19 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:47:19 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:47:19 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:47:19 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:47:19 user nova-compute[75672]:   </clock>
Nov 30 12:47:19 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:47:19 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:47:19 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:47:19 user nova-compute[75672]:   </cpu>
Nov 30 12:47:19 user nova-compute[75672]:   <devices>
Nov 30 12:47:19 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:47:19 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:47:19 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk"/>
Nov 30 12:47:19 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:47:19 user nova-compute[75672]:     </disk>
Nov 30 12:47:19 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:47:19 user nova-compute[75672]:       <mac address="fa:16:3e:d5:5a:b2"/>
Nov 30 12:47:19 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:47:19 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:47:19 user nova-compute[75672]:       <target dev="tap7b1b4262-1c"/>
Nov 30 12:47:19 user nova-compute[75672]:     </interface>
Nov 30 12:47:19 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:47:19 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/console.log" append="off"/>
Nov 30 12:47:19 user nova-compute[75672]:     </serial>
Nov 30 12:47:19 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:47:19 user nova-compute[75672]:     <video>
Nov 30 12:47:19 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:47:19 user nova-compute[75672]:     </video>
Nov 30 12:47:19 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:47:19 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:47:19 user nova-compute[75672]:     </rng>
Nov 30 12:47:19 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:47:19 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:47:19 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:47:19 user nova-compute[75672]:     </memballoon>
Nov 30 12:47:19 user nova-compute[75672]:   </devices>
Nov 30 12:47:19 user nova-compute[75672]: </domain>
Nov 30 12:47:19 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:47:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-506734386',display_name='tempest-ServersNegativeTestJSON-server-506734386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-506734386',id=37,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5a515a90e05403281db278fd0da0516',ramdisk_id='',reservation_id='r-1ms9zekp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-69784533',owner_user_name='tempest-ServersNegativeTestJSON-69784533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:47:17Z,user_data=None,user_id='aa04e80eda5248478efbdcc04f68d79f',uuid=c00b64bd-8011-4609-8953-315f1e655930,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "address": "fa:16:3e:d5:5a:b2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1b4262-1c", "ovs_interfaceid": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Converting VIF {"id": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "address": "fa:16:3e:d5:5a:b2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1b4262-1c", "ovs_interfaceid": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:5a:b2,bridge_name='br-int',has_traffic_filtering=True,id=7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2,network=Network(01af390a-7f78-4062-bb05-a7cc50446933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b1b4262-1c') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG os_vif [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:5a:b2,bridge_name='br-int',has_traffic_filtering=True,id=7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2,network=Network(01af390a-7f78-4062-bb05-a7cc50446933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b1b4262-1c') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c14867ca-b512-5d76-b75b-ba3adee9112e', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b1b4262-1c, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b1b4262-1c, col_values=(('qos', UUID('e9dfe384-961b-4fef-8508-0f2595a84f56')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b1b4262-1c, col_values=(('external_ids', {'iface-id': '7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:5a:b2', 'vm-uuid': 'c00b64bd-8011-4609-8953-315f1e655930'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:19 user nova-compute[75672]: INFO os_vif [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:5a:b2,bridge_name='br-int',has_traffic_filtering=True,id=7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2,network=Network(01af390a-7f78-4062-bb05-a7cc50446933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b1b4262-1c')
Nov 30 12:47:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.594s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:47:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] No VIF found with MAC fa:16:3e:d5:5a:b2, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:47:20 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Deleted allocation for migration e6561f04-9963-430b-88b5-66f4f4b3f9a4
Nov 30 12:47:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-65fb0781-e6dd-4295-a2bf-8bd70d4c1e84 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.772s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:20 user nova-compute[75672]: DEBUG nova.network.neutron [req-0bac2193-6e63-4900-99c0-0f4966db9632 req-1536e4bb-333d-4d93-bcef-ff17973ca279 service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Updated VIF entry in instance network info cache for port 7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:47:20 user nova-compute[75672]: DEBUG nova.network.neutron [req-0bac2193-6e63-4900-99c0-0f4966db9632 req-1536e4bb-333d-4d93-bcef-ff17973ca279 service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Updating instance_info_cache with network_info: [{"id": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "address": "fa:16:3e:d5:5a:b2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1b4262-1c", "ovs_interfaceid": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:47:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0bac2193-6e63-4900-99c0-0f4966db9632 req-1536e4bb-333d-4d93-bcef-ff17973ca279 service nova] Releasing lock "refresh_cache-c00b64bd-8011-4609-8953-315f1e655930" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:47:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:47:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] COPY block job progress, current cursor: 74514432 final cursor: 75563008 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:47:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:47:21 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 12:47:21 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:47:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0wpkr4t2/ef36a75bb57f4cdab78ea4a4a1ac43da.delta /opt/stack/data/nova/instances/snapshots/tmp0wpkr4t2/ef36a75bb57f4cdab78ea4a4a1ac43da {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0wpkr4t2/ef36a75bb57f4cdab78ea4a4a1ac43da.delta /opt/stack/data/nova/instances/snapshots/tmp0wpkr4t2/ef36a75bb57f4cdab78ea4a4a1ac43da" returned: 0 in 0.670s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:22 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Snapshot extracted, beginning image upload
Nov 30 12:47:22 user nova-compute[75672]: DEBUG nova.compute.manager [req-6744b80c-b971-4b19-874c-4439ca45f057 req-e386ffb1-12a9-4e88-8883-ac798c787dda service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Received event network-vif-plugged-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6744b80c-b971-4b19-874c-4439ca45f057 req-e386ffb1-12a9-4e88-8883-ac798c787dda service nova] Acquiring lock "c00b64bd-8011-4609-8953-315f1e655930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6744b80c-b971-4b19-874c-4439ca45f057 req-e386ffb1-12a9-4e88-8883-ac798c787dda service nova] Lock "c00b64bd-8011-4609-8953-315f1e655930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6744b80c-b971-4b19-874c-4439ca45f057 req-e386ffb1-12a9-4e88-8883-ac798c787dda service nova] Lock "c00b64bd-8011-4609-8953-315f1e655930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:22 user nova-compute[75672]: DEBUG nova.compute.manager [req-6744b80c-b971-4b19-874c-4439ca45f057 req-e386ffb1-12a9-4e88-8883-ac798c787dda service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] No waiting events found dispatching network-vif-plugged-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:47:22 user nova-compute[75672]: WARNING nova.compute.manager [req-6744b80c-b971-4b19-874c-4439ca45f057 req-e386ffb1-12a9-4e88-8883-ac798c787dda service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Received unexpected event network-vif-plugged-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 for instance with vm_state building and task_state spawning.
Nov 30 12:47:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:24 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:47:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:47:24 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: c00b64bd-8011-4609-8953-315f1e655930] Instance spawned successfully.
Nov 30 12:47:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:47:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:47:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:47:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:47:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:47:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:47:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:47:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-6a13320b-feee-437d-9c6a-2b6b70f35522 req-a3bb85c8-064b-48db-b019-40b806f5fafa service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Received event network-vif-plugged-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6a13320b-feee-437d-9c6a-2b6b70f35522 req-a3bb85c8-064b-48db-b019-40b806f5fafa service nova] Acquiring lock "c00b64bd-8011-4609-8953-315f1e655930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6a13320b-feee-437d-9c6a-2b6b70f35522 req-a3bb85c8-064b-48db-b019-40b806f5fafa service nova] Lock "c00b64bd-8011-4609-8953-315f1e655930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6a13320b-feee-437d-9c6a-2b6b70f35522 req-a3bb85c8-064b-48db-b019-40b806f5fafa service nova] Lock "c00b64bd-8011-4609-8953-315f1e655930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:24 user nova-compute[75672]: DEBUG nova.compute.manager [req-6a13320b-feee-437d-9c6a-2b6b70f35522 req-a3bb85c8-064b-48db-b019-40b806f5fafa service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] No waiting events found dispatching network-vif-plugged-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:47:24 user nova-compute[75672]: WARNING nova.compute.manager [req-6a13320b-feee-437d-9c6a-2b6b70f35522 req-a3bb85c8-064b-48db-b019-40b806f5fafa service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Received unexpected event network-vif-plugged-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 for instance with vm_state building and task_state spawning.
Nov 30 12:47:24 user nova-compute[75672]: INFO nova.compute.manager [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Took 7.67 seconds to spawn the instance on the hypervisor.
Nov 30 12:47:24 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:47:24 user nova-compute[75672]: INFO nova.compute.manager [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Took 8.57 seconds to build instance.
Nov 30 12:47:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2e411f5c-82bc-450f-a73f-9da244741e80 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "c00b64bd-8011-4609-8953-315f1e655930" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.702s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:25 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Snapshot image upload complete
Nov 30 12:47:25 user nova-compute[75672]: INFO nova.compute.manager [None req-34443ffe-811d-491b-b8b2-ad4d273240af tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Took 6.50 seconds to snapshot the instance on the hypervisor.
Nov 30 12:47:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:36 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:47:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:38 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:47:38 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:47:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:47:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:47:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:47:39 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Updating instance_info_cache with network_info: [{"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:47:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-62555959-6271-47e1-920c-b6333de4cca4" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:47:39 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:47:39 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:47:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:47:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:47:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:47:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:42 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:47:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:47:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:47:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:47:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:47:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:47:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7518MB free_disk=25.09394073486328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 62555959-6271-47e1-920c-b6333de4cca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 87744aef-7e32-475b-907e-e30702d083bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f5851479-d09b-4d84-9553-2b09646f2b4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance eb96c0c6-bcda-45b2-a7a5-308471a5003c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance c00b64bd-8011-4609-8953-315f1e655930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:47:46 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing inventories for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 12:47:47 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating ProviderTree inventory for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 12:47:47 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating inventory in ProviderTree for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 12:47:47 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing aggregate associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, aggregates: None {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 12:47:47 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing trait associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 12:47:47 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:47:47 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:47:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:47:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.817s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:47:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 12:47:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] There are 0 instances to clean {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 12:47:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:49 user nova-compute[75672]: DEBUG nova.compute.manager [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:47:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:49 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:47:49 user nova-compute[75672]: INFO nova.compute.claims [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Claim successful on node user
Nov 30 12:47:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG nova.network.neutron [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:47:50 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:47:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG nova.policy [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aec8237a0eb47fc891389705f0cc270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78ee16221704ff48f3ce5ff927aad62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:47:50 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Creating image(s)
Nov 30 12:47:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "/opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "/opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.209s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk 1073741824" returned: 0 in 0.064s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:50 user nova-compute[75672]: DEBUG nova.network.neutron [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Successfully created port: 2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.201s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Cannot resize image /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Ensure instance console log exists: /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_power_states {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:47:51 user nova-compute[75672]: WARNING nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 62555959-6271-47e1-920c-b6333de4cca4 {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid d5a6266a-af9e-4050-bba8-92eae9ac28bf {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 50ef3313-795a-4797-9a3e-5e85f61d7631 {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid f5851479-d09b-4d84-9553-2b09646f2b4f {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 47ac940e-edbd-4732-ac04-e242709ee894 {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 87744aef-7e32-475b-907e-e30702d083bf {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid eb96c0c6-bcda-45b2-a7a5-308471a5003c {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid c00b64bd-8011-4609-8953-315f1e655930 {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "62555959-6271-47e1-920c-b6333de4cca4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "62555959-6271-47e1-920c-b6333de4cca4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "50ef3313-795a-4797-9a3e-5e85f61d7631" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "f5851479-d09b-4d84-9553-2b09646f2b4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "47ac940e-edbd-4732-ac04-e242709ee894" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "87744aef-7e32-475b-907e-e30702d083bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "c00b64bd-8011-4609-8953-315f1e655930" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "c00b64bd-8011-4609-8953-315f1e655930" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "62555959-6271-47e1-920c-b6333de4cca4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "87744aef-7e32-475b-907e-e30702d083bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "47ac940e-edbd-4732-ac04-e242709ee894" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "c00b64bd-8011-4609-8953-315f1e655930" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.network.neutron [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Successfully updated port: 2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "refresh_cache-a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquired lock "refresh_cache-a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.network.neutron [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.network.neutron [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-eb7574ee-65e4-4bd4-8182-4ce12e6bf38f req-902f9761-ff6b-4ed3-98aa-35a56756a9d9 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Received event network-changed-2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-eb7574ee-65e4-4bd4-8182-4ce12e6bf38f req-902f9761-ff6b-4ed3-98aa-35a56756a9d9 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Refreshing instance network info cache due to event network-changed-2bec6ecb-cf05-4ca4-bfe8-352f139903de. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:47:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-eb7574ee-65e4-4bd4-8182-4ce12e6bf38f req-902f9761-ff6b-4ed3-98aa-35a56756a9d9 service nova] Acquiring lock "refresh_cache-a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.network.neutron [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Updating instance_info_cache with network_info: [{"id": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "address": "fa:16:3e:a2:c8:b8", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec6ecb-cf", "ovs_interfaceid": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Releasing lock "refresh_cache-a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.compute.manager [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Instance network_info: |[{"id": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "address": "fa:16:3e:a2:c8:b8", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec6ecb-cf", "ovs_interfaceid": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-eb7574ee-65e4-4bd4-8182-4ce12e6bf38f req-902f9761-ff6b-4ed3-98aa-35a56756a9d9 service nova] Acquired lock "refresh_cache-a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.network.neutron [req-eb7574ee-65e4-4bd4-8182-4ce12e6bf38f req-902f9761-ff6b-4ed3-98aa-35a56756a9d9 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Refreshing network info cache for port 2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Start _get_guest_xml network_info=[{"id": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "address": "fa:16:3e:a2:c8:b8", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec6ecb-cf", "ovs_interfaceid": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:47:52 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:47:52 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-151961309',display_name='tempest-TestStampPattern-server-151961309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-151961309',id=38,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuijQmPQJraElz60vaRaG/e8nrlOXht9CJYkW2bgFzbRFpEhWL7TMKFRy/q/cr8dhtExqxBW2eC1142b+wZVginkATR2akVdepgzX/hlOLrLqJpXg6xSJ07bI2dQ6OD6A==',key_name='tempest-TestStampPattern-1531471902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ee16221704ff48f3ce5ff927aad62',ramdisk_id='',reservation_id='r-poodbyye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2034271615',owner_user_name='tempest-TestStampPattern-2034271615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:47:50Z,user_data=None,user_id='8aec8237a0eb47fc891389705f0cc270',uuid=a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "address": "fa:16:3e:a2:c8:b8", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec6ecb-cf", "ovs_interfaceid": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Converting VIF {"id": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "address": "fa:16:3e:a2:c8:b8", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec6ecb-cf", "ovs_interfaceid": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:c8:b8,bridge_name='br-int',has_traffic_filtering=True,id=2bec6ecb-cf05-4ca4-bfe8-352f139903de,network=Network(1bf9e732-dd63-4d07-adfa-89a3ffde5dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bec6ecb-cf') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.objects.instance [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lazy-loading 'pci_devices' on Instance uuid a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:47:52 user nova-compute[75672]:   <uuid>a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df</uuid>
Nov 30 12:47:52 user nova-compute[75672]:   <name>instance-00000026</name>
Nov 30 12:47:52 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:47:52 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:47:52 user nova-compute[75672]:   <metadata>
Nov 30 12:47:52 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:47:52 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:47:52 user nova-compute[75672]:       <nova:name>tempest-TestStampPattern-server-151961309</nova:name>
Nov 30 12:47:52 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:47:52</nova:creationTime>
Nov 30 12:47:52 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:47:52 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:47:52 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:47:52 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:47:52 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:47:52 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:47:52 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:47:52 user nova-compute[75672]:       <nova:owner>
Nov 30 12:47:52 user nova-compute[75672]:         <nova:user uuid="8aec8237a0eb47fc891389705f0cc270">tempest-TestStampPattern-2034271615-project-member</nova:user>
Nov 30 12:47:52 user nova-compute[75672]:         <nova:project uuid="f78ee16221704ff48f3ce5ff927aad62">tempest-TestStampPattern-2034271615</nova:project>
Nov 30 12:47:52 user nova-compute[75672]:       </nova:owner>
Nov 30 12:47:52 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:47:52 user nova-compute[75672]:       <nova:ports>
Nov 30 12:47:52 user nova-compute[75672]:         <nova:port uuid="2bec6ecb-cf05-4ca4-bfe8-352f139903de">
Nov 30 12:47:52 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 12:47:52 user nova-compute[75672]:         </nova:port>
Nov 30 12:47:52 user nova-compute[75672]:       </nova:ports>
Nov 30 12:47:52 user nova-compute[75672]:     </nova:instance>
Nov 30 12:47:52 user nova-compute[75672]:   </metadata>
Nov 30 12:47:52 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:47:52 user nova-compute[75672]:     <system>
Nov 30 12:47:52 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:47:52 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:47:52 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:47:52 user nova-compute[75672]:       <entry name="serial">a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df</entry>
Nov 30 12:47:52 user nova-compute[75672]:       <entry name="uuid">a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df</entry>
Nov 30 12:47:52 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:47:52 user nova-compute[75672]:     </system>
Nov 30 12:47:52 user nova-compute[75672]:   </sysinfo>
Nov 30 12:47:52 user nova-compute[75672]:   <os>
Nov 30 12:47:52 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:47:52 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:47:52 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:47:52 user nova-compute[75672]:   </os>
Nov 30 12:47:52 user nova-compute[75672]:   <features>
Nov 30 12:47:52 user nova-compute[75672]:     <acpi/>
Nov 30 12:47:52 user nova-compute[75672]:     <apic/>
Nov 30 12:47:52 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:47:52 user nova-compute[75672]:   </features>
Nov 30 12:47:52 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:47:52 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:47:52 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:47:52 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:47:52 user nova-compute[75672]:   </clock>
Nov 30 12:47:52 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:47:52 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:47:52 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:47:52 user nova-compute[75672]:   </cpu>
Nov 30 12:47:52 user nova-compute[75672]:   <devices>
Nov 30 12:47:52 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:47:52 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:47:52 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk"/>
Nov 30 12:47:52 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:47:52 user nova-compute[75672]:     </disk>
Nov 30 12:47:52 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:47:52 user nova-compute[75672]:       <mac address="fa:16:3e:a2:c8:b8"/>
Nov 30 12:47:52 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:47:52 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:47:52 user nova-compute[75672]:       <target dev="tap2bec6ecb-cf"/>
Nov 30 12:47:52 user nova-compute[75672]:     </interface>
Nov 30 12:47:52 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:47:52 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/console.log" append="off"/>
Nov 30 12:47:52 user nova-compute[75672]:     </serial>
Nov 30 12:47:52 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:47:52 user nova-compute[75672]:     <video>
Nov 30 12:47:52 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:47:52 user nova-compute[75672]:     </video>
Nov 30 12:47:52 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:47:52 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:47:52 user nova-compute[75672]:     </rng>
Nov 30 12:47:52 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:47:52 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:47:52 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:47:52 user nova-compute[75672]:     </memballoon>
Nov 30 12:47:52 user nova-compute[75672]:   </devices>
Nov 30 12:47:52 user nova-compute[75672]: </domain>
Nov 30 12:47:52 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-151961309',display_name='tempest-TestStampPattern-server-151961309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-151961309',id=38,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuijQmPQJraElz60vaRaG/e8nrlOXht9CJYkW2bgFzbRFpEhWL7TMKFRy/q/cr8dhtExqxBW2eC1142b+wZVginkATR2akVdepgzX/hlOLrLqJpXg6xSJ07bI2dQ6OD6A==',key_name='tempest-TestStampPattern-1531471902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ee16221704ff48f3ce5ff927aad62',ramdisk_id='',reservation_id='r-poodbyye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2034271615',owner_user_name='tempest-TestStampPattern-2034271615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:47:50Z,user_data=None,user_id='8aec8237a0eb47fc891389705f0cc270',uuid=a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "address": "fa:16:3e:a2:c8:b8", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec6ecb-cf", "ovs_interfaceid": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Converting VIF {"id": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "address": "fa:16:3e:a2:c8:b8", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec6ecb-cf", "ovs_interfaceid": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:c8:b8,bridge_name='br-int',has_traffic_filtering=True,id=2bec6ecb-cf05-4ca4-bfe8-352f139903de,network=Network(1bf9e732-dd63-4d07-adfa-89a3ffde5dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bec6ecb-cf') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG os_vif [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:c8:b8,bridge_name='br-int',has_traffic_filtering=True,id=2bec6ecb-cf05-4ca4-bfe8-352f139903de,network=Network(1bf9e732-dd63-4d07-adfa-89a3ffde5dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bec6ecb-cf') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ff7e721-3673-590d-b336-0e3446f1fb4b', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bec6ecb-cf, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bec6ecb-cf, col_values=(('qos', UUID('9de9e9bd-001c-4b31-8ac4-db987826f31b')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bec6ecb-cf, col_values=(('external_ids', {'iface-id': '2bec6ecb-cf05-4ca4-bfe8-352f139903de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:c8:b8', 'vm-uuid': 'a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:52 user nova-compute[75672]: INFO os_vif [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:c8:b8,bridge_name='br-int',has_traffic_filtering=True,id=2bec6ecb-cf05-4ca4-bfe8-352f139903de,network=Network(1bf9e732-dd63-4d07-adfa-89a3ffde5dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bec6ecb-cf')
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] No VIF found with MAC fa:16:3e:a2:c8:b8, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.network.neutron [req-eb7574ee-65e4-4bd4-8182-4ce12e6bf38f req-902f9761-ff6b-4ed3-98aa-35a56756a9d9 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Updated VIF entry in instance network info cache for port 2bec6ecb-cf05-4ca4-bfe8-352f139903de. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG nova.network.neutron [req-eb7574ee-65e4-4bd4-8182-4ce12e6bf38f req-902f9761-ff6b-4ed3-98aa-35a56756a9d9 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Updating instance_info_cache with network_info: [{"id": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "address": "fa:16:3e:a2:c8:b8", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec6ecb-cf", "ovs_interfaceid": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:47:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-eb7574ee-65e4-4bd4-8182-4ce12e6bf38f req-902f9761-ff6b-4ed3-98aa-35a56756a9d9 service nova] Releasing lock "refresh_cache-a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:47:53 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:47:53 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75672) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 12:47:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-7588d41b-884d-4e88-8734-1482d1171d4d req-2c537b79-fc5b-4249-8b26-ed0acdad5b33 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Received event network-vif-plugged-2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7588d41b-884d-4e88-8734-1482d1171d4d req-2c537b79-fc5b-4249-8b26-ed0acdad5b33 service nova] Acquiring lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7588d41b-884d-4e88-8734-1482d1171d4d req-2c537b79-fc5b-4249-8b26-ed0acdad5b33 service nova] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7588d41b-884d-4e88-8734-1482d1171d4d req-2c537b79-fc5b-4249-8b26-ed0acdad5b33 service nova] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-7588d41b-884d-4e88-8734-1482d1171d4d req-2c537b79-fc5b-4249-8b26-ed0acdad5b33 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] No waiting events found dispatching network-vif-plugged-2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:47:54 user nova-compute[75672]: WARNING nova.compute.manager [req-7588d41b-884d-4e88-8734-1482d1171d4d req-2c537b79-fc5b-4249-8b26-ed0acdad5b33 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Received unexpected event network-vif-plugged-2bec6ecb-cf05-4ca4-bfe8-352f139903de for instance with vm_state building and task_state spawning.
Nov 30 12:47:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:47:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:47:55 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Instance spawned successfully.
Nov 30 12:47:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:47:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:47:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:47:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:47:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:47:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:47:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:47:56 user nova-compute[75672]: INFO nova.compute.manager [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 30 12:47:56 user nova-compute[75672]: DEBUG nova.compute.manager [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:47:56 user nova-compute[75672]: DEBUG nova.compute.manager [req-5dfdd021-2a08-4238-a025-37037fd3d28a req-174c9458-b4fc-43ba-bcbb-c4640dd48aea service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Received event network-vif-plugged-2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5dfdd021-2a08-4238-a025-37037fd3d28a req-174c9458-b4fc-43ba-bcbb-c4640dd48aea service nova] Acquiring lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5dfdd021-2a08-4238-a025-37037fd3d28a req-174c9458-b4fc-43ba-bcbb-c4640dd48aea service nova] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5dfdd021-2a08-4238-a025-37037fd3d28a req-174c9458-b4fc-43ba-bcbb-c4640dd48aea service nova] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:56 user nova-compute[75672]: DEBUG nova.compute.manager [req-5dfdd021-2a08-4238-a025-37037fd3d28a req-174c9458-b4fc-43ba-bcbb-c4640dd48aea service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] No waiting events found dispatching network-vif-plugged-2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:47:56 user nova-compute[75672]: WARNING nova.compute.manager [req-5dfdd021-2a08-4238-a025-37037fd3d28a req-174c9458-b4fc-43ba-bcbb-c4640dd48aea service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Received unexpected event network-vif-plugged-2bec6ecb-cf05-4ca4-bfe8-352f139903de for instance with vm_state building and task_state spawning.
Nov 30 12:47:56 user nova-compute[75672]: INFO nova.compute.manager [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Took 6.53 seconds to build instance.
Nov 30 12:47:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-392a70bc-2f63-48d0-a6f7-b8051cc5b805 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.651s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.629s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:56 user nova-compute[75672]: INFO nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 30 12:47:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "62555959-6271-47e1-920c-b6333de4cca4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "62555959-6271-47e1-920c-b6333de4cca4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "62555959-6271-47e1-920c-b6333de4cca4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:57 user nova-compute[75672]: INFO nova.compute.manager [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Terminating instance
Nov 30 12:47:57 user nova-compute[75672]: DEBUG nova.compute.manager [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:47:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Instance destroyed successfully.
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.objects.instance [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'resources' on Instance uuid 62555959-6271-47e1-920c-b6333de4cca4 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-197576731',display_name='tempest-ServerRescueNegativeTestJSON-server-197576731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-197576731',id=2,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:33:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='601d2f3e56844b68b3a0c71f8a7f5454',ramdisk_id='',reservation_id='r-n98vn0nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-928198583',owner_user_name='tempest-ServerRescueNegativeTestJSON-928198583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:33:44Z,user_data=None,user_id='61c6bf770dfe4eadba28f371b29f1d79',uuid=62555959-6271-47e1-920c-b6333de4cca4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converting VIF {"id": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "address": "fa:16:3e:63:41:41", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb326ae3-46", "ovs_interfaceid": "eb326ae3-464f-42bf-8e4d-ca951d6115a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:41:41,bridge_name='br-int',has_traffic_filtering=True,id=eb326ae3-464f-42bf-8e4d-ca951d6115a0,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb326ae3-46') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG os_vif [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:41:41,bridge_name='br-int',has_traffic_filtering=True,id=eb326ae3-464f-42bf-8e4d-ca951d6115a0,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb326ae3-46') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb326ae3-46, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e75ac0a-5375-43a3-9db6-80f623e530fc) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:47:58 user nova-compute[75672]: INFO os_vif [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:41:41,bridge_name='br-int',has_traffic_filtering=True,id=eb326ae3-464f-42bf-8e4d-ca951d6115a0,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb326ae3-46')
Nov 30 12:47:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Deleting instance files /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4_del
Nov 30 12:47:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Deletion of /opt/stack/data/nova/instances/62555959-6271-47e1-920c-b6333de4cca4_del complete
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-34f72824-a21e-406e-b98c-75d7821d3431 req-c9bccd8f-71c2-4793-93ae-6a24f5b9f195 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received event network-vif-unplugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-34f72824-a21e-406e-b98c-75d7821d3431 req-c9bccd8f-71c2-4793-93ae-6a24f5b9f195 service nova] Acquiring lock "62555959-6271-47e1-920c-b6333de4cca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-34f72824-a21e-406e-b98c-75d7821d3431 req-c9bccd8f-71c2-4793-93ae-6a24f5b9f195 service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-34f72824-a21e-406e-b98c-75d7821d3431 req-c9bccd8f-71c2-4793-93ae-6a24f5b9f195 service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-34f72824-a21e-406e-b98c-75d7821d3431 req-c9bccd8f-71c2-4793-93ae-6a24f5b9f195 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] No waiting events found dispatching network-vif-unplugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-34f72824-a21e-406e-b98c-75d7821d3431 req-c9bccd8f-71c2-4793-93ae-6a24f5b9f195 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received event network-vif-unplugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-34f72824-a21e-406e-b98c-75d7821d3431 req-c9bccd8f-71c2-4793-93ae-6a24f5b9f195 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received event network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-34f72824-a21e-406e-b98c-75d7821d3431 req-c9bccd8f-71c2-4793-93ae-6a24f5b9f195 service nova] Acquiring lock "62555959-6271-47e1-920c-b6333de4cca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-34f72824-a21e-406e-b98c-75d7821d3431 req-c9bccd8f-71c2-4793-93ae-6a24f5b9f195 service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-34f72824-a21e-406e-b98c-75d7821d3431 req-c9bccd8f-71c2-4793-93ae-6a24f5b9f195 service nova] Lock "62555959-6271-47e1-920c-b6333de4cca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-34f72824-a21e-406e-b98c-75d7821d3431 req-c9bccd8f-71c2-4793-93ae-6a24f5b9f195 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] No waiting events found dispatching network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:47:58 user nova-compute[75672]: WARNING nova.compute.manager [req-34f72824-a21e-406e-b98c-75d7821d3431 req-c9bccd8f-71c2-4793-93ae-6a24f5b9f195 service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received unexpected event network-vif-plugged-eb326ae3-464f-42bf-8e4d-ca951d6115a0 for instance with vm_state rescued and task_state deleting.
Nov 30 12:47:58 user nova-compute[75672]: INFO nova.compute.manager [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 30 12:47:58 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 62555959-6271-47e1-920c-b6333de4cca4] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:47:58 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Took 0.57 seconds to deallocate network for instance.
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-00257136-1b33-43c4-9b09-5e56ec0a3e2b req-1280d72f-172d-459b-9708-af3cbaa3ac4b service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Received event network-vif-deleted-eb326ae3-464f-42bf-8e4d-ca951d6115a0 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:47:58 user nova-compute[75672]: INFO nova.compute.manager [req-00257136-1b33-43c4-9b09-5e56ec0a3e2b req-1280d72f-172d-459b-9708-af3cbaa3ac4b service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Neutron deleted interface eb326ae3-464f-42bf-8e4d-ca951d6115a0; detaching it from the instance and deleting it from the info cache
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.network.neutron [req-00257136-1b33-43c4-9b09-5e56ec0a3e2b req-1280d72f-172d-459b-9708-af3cbaa3ac4b service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-00257136-1b33-43c4-9b09-5e56ec0a3e2b req-1280d72f-172d-459b-9708-af3cbaa3ac4b service nova] [instance: 62555959-6271-47e1-920c-b6333de4cca4] Detach interface failed, port_id=eb326ae3-464f-42bf-8e4d-ca951d6115a0, reason: Instance 62555959-6271-47e1-920c-b6333de4cca4 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:47:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:47:59 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:47:59 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:47:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:47:59 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Deleted allocations for instance 62555959-6271-47e1-920c-b6333de4cca4
Nov 30 12:47:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-15b1f4d6-5087-4a76-af1e-f487d128a319 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "62555959-6271-47e1-920c-b6333de4cca4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.260s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:48:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:19 user nova-compute[75672]: DEBUG nova.compute.manager [req-dae0d011-d28c-4ad3-8b46-fb50751e4d50 req-150a7851-3f13-4f1f-b804-a4f286c9256d service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Received event network-changed-0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:48:19 user nova-compute[75672]: DEBUG nova.compute.manager [req-dae0d011-d28c-4ad3-8b46-fb50751e4d50 req-150a7851-3f13-4f1f-b804-a4f286c9256d service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Refreshing instance network info cache due to event network-changed-0a9fb28e-1985-4953-ae9f-308edfdb62a1. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:48:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dae0d011-d28c-4ad3-8b46-fb50751e4d50 req-150a7851-3f13-4f1f-b804-a4f286c9256d service nova] Acquiring lock "refresh_cache-eb96c0c6-bcda-45b2-a7a5-308471a5003c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:48:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dae0d011-d28c-4ad3-8b46-fb50751e4d50 req-150a7851-3f13-4f1f-b804-a4f286c9256d service nova] Acquired lock "refresh_cache-eb96c0c6-bcda-45b2-a7a5-308471a5003c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:48:19 user nova-compute[75672]: DEBUG nova.network.neutron [req-dae0d011-d28c-4ad3-8b46-fb50751e4d50 req-150a7851-3f13-4f1f-b804-a4f286c9256d service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Refreshing network info cache for port 0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:48:20 user nova-compute[75672]: DEBUG nova.network.neutron [req-dae0d011-d28c-4ad3-8b46-fb50751e4d50 req-150a7851-3f13-4f1f-b804-a4f286c9256d service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Updated VIF entry in instance network info cache for port 0a9fb28e-1985-4953-ae9f-308edfdb62a1. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:48:20 user nova-compute[75672]: DEBUG nova.network.neutron [req-dae0d011-d28c-4ad3-8b46-fb50751e4d50 req-150a7851-3f13-4f1f-b804-a4f286c9256d service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Updating instance_info_cache with network_info: [{"id": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "address": "fa:16:3e:6e:b2:35", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9fb28e-19", "ovs_interfaceid": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:48:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dae0d011-d28c-4ad3-8b46-fb50751e4d50 req-150a7851-3f13-4f1f-b804-a4f286c9256d service nova] Releasing lock "refresh_cache-eb96c0c6-bcda-45b2-a7a5-308471a5003c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:48:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:20 user nova-compute[75672]: INFO nova.compute.manager [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Terminating instance
Nov 30 12:48:20 user nova-compute[75672]: DEBUG nova.compute.manager [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:48:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:21 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Instance destroyed successfully.
Nov 30 12:48:21 user nova-compute[75672]: DEBUG nova.objects.instance [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lazy-loading 'resources' on Instance uuid eb96c0c6-bcda-45b2-a7a5-308471a5003c {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-882577862',display_name='tempest-TestVolumeBootPattern-server-882577862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-882577862',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/tiWnKVjyQ+YQ0wPEgFpD4sUWbk2GMRtR0fUhMrrhWzqEfZseqSV3bBKpPI9FNVcBh3EJSPDcri0dXJ24ST3AlMd1Z9vj5ezFGg5LMAjAiHzircmeHJyIgzk+4EYWw6A==',key_name='tempest-TestVolumeBootPattern-1453287901',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:46:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-u41yb8zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:46:48Z,user_data=None,user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=eb96c0c6-bcda-45b2-a7a5-308471a5003c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "address": "fa:16:3e:6e:b2:35", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9fb28e-19", "ovs_interfaceid": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "address": "fa:16:3e:6e:b2:35", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9fb28e-19", "ovs_interfaceid": "0a9fb28e-1985-4953-ae9f-308edfdb62a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:b2:35,bridge_name='br-int',has_traffic_filtering=True,id=0a9fb28e-1985-4953-ae9f-308edfdb62a1,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a9fb28e-19') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_vif [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:b2:35,bridge_name='br-int',has_traffic_filtering=True,id=0a9fb28e-1985-4953-ae9f-308edfdb62a1,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a9fb28e-19') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a9fb28e-19, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1572db6-7630-4f6d-b60b-fcfc19ac2578) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:48:21 user nova-compute[75672]: INFO os_vif [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:b2:35,bridge_name='br-int',has_traffic_filtering=True,id=0a9fb28e-1985-4953-ae9f-308edfdb62a1,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a9fb28e-19')
Nov 30 12:48:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viUPLGdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:48:21 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad45ac0-81b5-4520-aa75-f18f9175655b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:48:21 user nova-compute[75672]: No targets found.
Nov 30 12:48:21 user nova-compute[75672]: iSNS:
Nov 30 12:48:21 user nova-compute[75672]: No targets found.
Nov 30 12:48:21 user nova-compute[75672]: STATIC:
Nov 30 12:48:21 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016
Nov 30 12:48:21 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:48:21 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:48:21 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:48:21 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:48:21 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:48:21 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf
Nov 30 12:48:21 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:48:21 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:48:21 user nova-compute[75672]: FIRMWARE:
Nov 30 12:48:21 user nova-compute[75672]: No targets found.
Nov 30 12:48:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:48:21 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:48:21 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a5e800-e19f-4a1d-a3d4-b4dd9ac7d72d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8589c933-dd73-4065-9d20-a56b1d632350]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:48:21 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:48:21 user nova-compute[75672]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:48:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:48:21 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:48:21 user nova-compute[75672]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:48:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd4297400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e134776d-9a7b-4933-87e6-f4808ada167e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3caf88f-3a24-4c09-9435-4ff8de92a28d]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97101cb-196e-42db-917c-250608e8de65]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd73bad-88f2-4ec0-a800-5d85824a8f84]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5e55b528-2317f233741204af', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5e55b528', '/dev/disk/by-id/scsi-23233313766323333') {{(pid=86963) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b824afd3-b3c3-4e8f-b245-5f4c3ad1c6cf]: (4, None) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.113s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5be6f5-de6d-4382-957f-0b31b66fbdd0]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43e3fcc-0173-4786-a8ba-5aafa661c266]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260]
Nov 30 12:48:21 user nova-compute[75672]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260] successful.
Nov 30 12:48:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4be23f-62b8-4199-ac0c-50fdae394416]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== disconnect_volume: return (440ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:48:21 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Deleting instance files /opt/stack/data/nova/instances/eb96c0c6-bcda-45b2-a7a5-308471a5003c_del
Nov 30 12:48:21 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Deletion of /opt/stack/data/nova/instances/eb96c0c6-bcda-45b2-a7a5-308471a5003c_del complete
Nov 30 12:48:21 user nova-compute[75672]: INFO nova.compute.manager [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-0c5580af-9719-4207-9923-1f78e69effb9 req-d6f3ca58-9f8d-45b0-8752-d32bd1d68da6 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Received event network-vif-unplugged-0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c5580af-9719-4207-9923-1f78e69effb9 req-d6f3ca58-9f8d-45b0-8752-d32bd1d68da6 service nova] Acquiring lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c5580af-9719-4207-9923-1f78e69effb9 req-d6f3ca58-9f8d-45b0-8752-d32bd1d68da6 service nova] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c5580af-9719-4207-9923-1f78e69effb9 req-d6f3ca58-9f8d-45b0-8752-d32bd1d68da6 service nova] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-0c5580af-9719-4207-9923-1f78e69effb9 req-d6f3ca58-9f8d-45b0-8752-d32bd1d68da6 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] No waiting events found dispatching network-vif-unplugged-0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-0c5580af-9719-4207-9923-1f78e69effb9 req-d6f3ca58-9f8d-45b0-8752-d32bd1d68da6 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Received event network-vif-unplugged-0a9fb28e-1985-4953-ae9f-308edfdb62a1 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-0c5580af-9719-4207-9923-1f78e69effb9 req-d6f3ca58-9f8d-45b0-8752-d32bd1d68da6 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Received event network-vif-plugged-0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c5580af-9719-4207-9923-1f78e69effb9 req-d6f3ca58-9f8d-45b0-8752-d32bd1d68da6 service nova] Acquiring lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c5580af-9719-4207-9923-1f78e69effb9 req-d6f3ca58-9f8d-45b0-8752-d32bd1d68da6 service nova] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c5580af-9719-4207-9923-1f78e69effb9 req-d6f3ca58-9f8d-45b0-8752-d32bd1d68da6 service nova] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-0c5580af-9719-4207-9923-1f78e69effb9 req-d6f3ca58-9f8d-45b0-8752-d32bd1d68da6 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] No waiting events found dispatching network-vif-plugged-0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:48:21 user nova-compute[75672]: WARNING nova.compute.manager [req-0c5580af-9719-4207-9923-1f78e69effb9 req-d6f3ca58-9f8d-45b0-8752-d32bd1d68da6 service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Received unexpected event network-vif-plugged-0a9fb28e-1985-4953-ae9f-308edfdb62a1 for instance with vm_state active and task_state deleting.
Nov 30 12:48:22 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:48:22 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Took 0.81 seconds to deallocate network for instance.
Nov 30 12:48:23 user nova-compute[75672]: INFO nova.compute.manager [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Took 0.77 seconds to detach 1 volumes for instance.
Nov 30 12:48:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:23 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:48:23 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:48:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:23 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Deleted allocations for instance eb96c0c6-bcda-45b2-a7a5-308471a5003c
Nov 30 12:48:23 user nova-compute[75672]: DEBUG nova.compute.manager [req-b1f20895-4aac-4968-8946-eb92a794a3c8 req-e866e02f-7ddd-41f3-86d0-b5b278af825d service nova] [instance: eb96c0c6-bcda-45b2-a7a5-308471a5003c] Received event network-vif-deleted-0a9fb28e-1985-4953-ae9f-308edfdb62a1 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:48:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-478be14f-2f3d-438b-bf07-0ffb6651f7fe tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "eb96c0c6-bcda-45b2-a7a5-308471a5003c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.498s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:38 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:48:38 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:48:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:48:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:48:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:48:39 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updating instance_info_cache with network_info: [{"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:48:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-d5a6266a-af9e-4050-bba8-92eae9ac28bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:48:39 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:48:39 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:48:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:48:43 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:48:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:48:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:48:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:48:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:48:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:48:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:48:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7688MB free_disk=25.07168197631836GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 87744aef-7e32-475b-907e-e30702d083bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f5851479-d09b-4d84-9553-2b09646f2b4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance c00b64bd-8011-4609-8953-315f1e655930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:48:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.713s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:47 user nova-compute[75672]: INFO nova.compute.manager [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Terminating instance
Nov 30 12:48:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-c1009904-cff6-429d-855c-b832dc6d1712 req-3781a562-28a9-4a89-bc48-2cd8b7f22d88 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-vif-unplugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c1009904-cff6-429d-855c-b832dc6d1712 req-3781a562-28a9-4a89-bc48-2cd8b7f22d88 service nova] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c1009904-cff6-429d-855c-b832dc6d1712 req-3781a562-28a9-4a89-bc48-2cd8b7f22d88 service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c1009904-cff6-429d-855c-b832dc6d1712 req-3781a562-28a9-4a89-bc48-2cd8b7f22d88 service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG nova.compute.manager [req-c1009904-cff6-429d-855c-b832dc6d1712 req-3781a562-28a9-4a89-bc48-2cd8b7f22d88 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] No waiting events found dispatching network-vif-unplugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG nova.compute.manager [req-c1009904-cff6-429d-855c-b832dc6d1712 req-3781a562-28a9-4a89-bc48-2cd8b7f22d88 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-vif-unplugged-fbe1de56-aab3-47e7-914b-e51e070c8679 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:48:48 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Instance destroyed successfully.
Nov 30 12:48:48 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lazy-loading 'resources' on Instance uuid 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-599375833',display_name='tempest-ServerRescueNegativeTestJSON-server-599375833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-599375833',id=1,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:36:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='601d2f3e56844b68b3a0c71f8a7f5454',ramdisk_id='',reservation_id='r-3q5auhoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-928198583',owner_user_name='tempest-ServerRescueNegativeTestJSON-928198583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:38:23Z,user_data=None,user_id='61c6bf770dfe4eadba28f371b29f1d79',uuid=76aeb1d1-590a-44b3-b4fd-c9ebdedf603b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converting VIF {"id": "fbe1de56-aab3-47e7-914b-e51e070c8679", "address": "fa:16:3e:01:69:fe", "network": {"id": "da4954ea-af19-445a-aa8e-b5ccae85b7c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1994190664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "601d2f3e56844b68b3a0c71f8a7f5454", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe1de56-aa", "ovs_interfaceid": "fbe1de56-aab3-47e7-914b-e51e070c8679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:69:fe,bridge_name='br-int',has_traffic_filtering=True,id=fbe1de56-aab3-47e7-914b-e51e070c8679,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe1de56-aa') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG os_vif [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:69:fe,bridge_name='br-int',has_traffic_filtering=True,id=fbe1de56-aab3-47e7-914b-e51e070c8679,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe1de56-aa') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbe1de56-aa, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d46c5cf-b476-47f9-83ab-ca7e8c697743) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:48 user nova-compute[75672]: INFO os_vif [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:69:fe,bridge_name='br-int',has_traffic_filtering=True,id=fbe1de56-aab3-47e7-914b-e51e070c8679,network=Network(da4954ea-af19-445a-aa8e-b5ccae85b7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe1de56-aa')
Nov 30 12:48:48 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Deleting instance files /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b_del
Nov 30 12:48:48 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Deletion of /opt/stack/data/nova/instances/76aeb1d1-590a-44b3-b4fd-c9ebdedf603b_del complete
Nov 30 12:48:48 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:48:48 user nova-compute[75672]: INFO nova.compute.manager [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 30 12:48:48 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:48:48 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:48:49 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:48:49 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Took 0.48 seconds to deallocate network for instance.
Nov 30 12:48:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-4829c4fc-d5c0-40aa-a7e4-a183492636bb req-7c306d42-0973-4a92-ac27-e047ac0d0efa service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-vif-deleted-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:48:49 user nova-compute[75672]: INFO nova.compute.manager [req-4829c4fc-d5c0-40aa-a7e4-a183492636bb req-7c306d42-0973-4a92-ac27-e047ac0d0efa service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Neutron deleted interface fbe1de56-aab3-47e7-914b-e51e070c8679; detaching it from the instance and deleting it from the info cache
Nov 30 12:48:49 user nova-compute[75672]: DEBUG nova.network.neutron [req-4829c4fc-d5c0-40aa-a7e4-a183492636bb req-7c306d42-0973-4a92-ac27-e047ac0d0efa service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:48:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-4829c4fc-d5c0-40aa-a7e4-a183492636bb req-7c306d42-0973-4a92-ac27-e047ac0d0efa service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Detach interface failed, port_id=fbe1de56-aab3-47e7-914b-e51e070c8679, reason: Instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:48:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:49 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:48:49 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:48:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:49 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Deleted allocations for instance 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b
Nov 30 12:48:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d8d6346e-58a8-4bb5-876e-769849813744 tempest-ServerRescueNegativeTestJSON-928198583 tempest-ServerRescueNegativeTestJSON-928198583-project-member] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.934s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:50 user nova-compute[75672]: DEBUG nova.compute.manager [req-ce986874-df2e-42fb-9243-3e3a1fb853d2 req-c31f9f77-eb48-4dcc-a2c9-df71aba5c5a4 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:48:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ce986874-df2e-42fb-9243-3e3a1fb853d2 req-c31f9f77-eb48-4dcc-a2c9-df71aba5c5a4 service nova] Acquiring lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ce986874-df2e-42fb-9243-3e3a1fb853d2 req-c31f9f77-eb48-4dcc-a2c9-df71aba5c5a4 service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ce986874-df2e-42fb-9243-3e3a1fb853d2 req-c31f9f77-eb48-4dcc-a2c9-df71aba5c5a4 service nova] Lock "76aeb1d1-590a-44b3-b4fd-c9ebdedf603b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:50 user nova-compute[75672]: DEBUG nova.compute.manager [req-ce986874-df2e-42fb-9243-3e3a1fb853d2 req-c31f9f77-eb48-4dcc-a2c9-df71aba5c5a4 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] No waiting events found dispatching network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:48:50 user nova-compute[75672]: WARNING nova.compute.manager [req-ce986874-df2e-42fb-9243-3e3a1fb853d2 req-c31f9f77-eb48-4dcc-a2c9-df71aba5c5a4 service nova] [instance: 76aeb1d1-590a-44b3-b4fd-c9ebdedf603b] Received unexpected event network-vif-plugged-fbe1de56-aab3-47e7-914b-e51e070c8679 for instance with vm_state deleted and task_state None.
Nov 30 12:48:52 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:48:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:56 user nova-compute[75672]: INFO nova.compute.manager [None req-fd8aa682-d030-4343-9c4e-50ff085940c0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Unrescuing
Nov 30 12:48:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fd8aa682-d030-4343-9c4e-50ff085940c0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:48:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fd8aa682-d030-4343-9c4e-50ff085940c0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquired lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:48:56 user nova-compute[75672]: DEBUG nova.network.neutron [None req-fd8aa682-d030-4343-9c4e-50ff085940c0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:48:57 user nova-compute[75672]: DEBUG nova.network.neutron [None req-fd8aa682-d030-4343-9c4e-50ff085940c0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Updating instance_info_cache with network_info: [{"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:48:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fd8aa682-d030-4343-9c4e-50ff085940c0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Releasing lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:48:57 user nova-compute[75672]: DEBUG nova.objects.instance [None req-fd8aa682-d030-4343-9c4e-50ff085940c0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'flavor' on Instance uuid 47ac940e-edbd-4732-ac04-e242709ee894 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:48:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-c721dabd-3e51-46ee-97ca-08cafecb81e0 req-cb792a7f-e216-4591-8fe8-e762ee5ae2cf service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-unplugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:48:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c721dabd-3e51-46ee-97ca-08cafecb81e0 req-cb792a7f-e216-4591-8fe8-e762ee5ae2cf service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c721dabd-3e51-46ee-97ca-08cafecb81e0 req-cb792a7f-e216-4591-8fe8-e762ee5ae2cf service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c721dabd-3e51-46ee-97ca-08cafecb81e0 req-cb792a7f-e216-4591-8fe8-e762ee5ae2cf service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-c721dabd-3e51-46ee-97ca-08cafecb81e0 req-cb792a7f-e216-4591-8fe8-e762ee5ae2cf service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-unplugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:48:57 user nova-compute[75672]: WARNING nova.compute.manager [req-c721dabd-3e51-46ee-97ca-08cafecb81e0 req-cb792a7f-e216-4591-8fe8-e762ee5ae2cf service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-unplugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:48:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:57 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Instance destroyed successfully.
Nov 30 12:48:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:48:59 user nova-compute[75672]: WARNING nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:48:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:48:59 user nova-compute[75672]: WARNING nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:48:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:48:59 user nova-compute[75672]: WARNING nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:48:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-unplugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-unplugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:48:59 user nova-compute[75672]: WARNING nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-unplugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:48:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:48:59 user nova-compute[75672]: WARNING nova.compute.manager [req-73b10aa2-49d1-4402-a457-fe514a45bd88 req-f4b9c207-3526-4265-a410-63824264f612 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:48:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:48:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:01 user nova-compute[75672]: DEBUG nova.compute.manager [req-ad7ed2d6-900d-49e0-ac91-de64816242bb req-d314a63d-6bbf-4649-90ba-7add4634e137 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:49:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ad7ed2d6-900d-49e0-ac91-de64816242bb req-d314a63d-6bbf-4649-90ba-7add4634e137 service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ad7ed2d6-900d-49e0-ac91-de64816242bb req-d314a63d-6bbf-4649-90ba-7add4634e137 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ad7ed2d6-900d-49e0-ac91-de64816242bb req-d314a63d-6bbf-4649-90ba-7add4634e137 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:01 user nova-compute[75672]: DEBUG nova.compute.manager [req-ad7ed2d6-900d-49e0-ac91-de64816242bb req-d314a63d-6bbf-4649-90ba-7add4634e137 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:49:01 user nova-compute[75672]: WARNING nova.compute.manager [req-ad7ed2d6-900d-49e0-ac91-de64816242bb req-d314a63d-6bbf-4649-90ba-7add4634e137 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:49:01 user nova-compute[75672]: DEBUG nova.compute.manager [req-ad7ed2d6-900d-49e0-ac91-de64816242bb req-d314a63d-6bbf-4649-90ba-7add4634e137 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:49:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ad7ed2d6-900d-49e0-ac91-de64816242bb req-d314a63d-6bbf-4649-90ba-7add4634e137 service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ad7ed2d6-900d-49e0-ac91-de64816242bb req-d314a63d-6bbf-4649-90ba-7add4634e137 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ad7ed2d6-900d-49e0-ac91-de64816242bb req-d314a63d-6bbf-4649-90ba-7add4634e137 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:01 user nova-compute[75672]: DEBUG nova.compute.manager [req-ad7ed2d6-900d-49e0-ac91-de64816242bb req-d314a63d-6bbf-4649-90ba-7add4634e137 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:49:01 user nova-compute[75672]: WARNING nova.compute.manager [req-ad7ed2d6-900d-49e0-ac91-de64816242bb req-d314a63d-6bbf-4649-90ba-7add4634e137 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:49:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:01 user nova-compute[75672]: DEBUG nova.compute.manager [None req-fd8aa682-d030-4343-9c4e-50ff085940c0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:49:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "f0dc7673-5c82-47db-a820-0e8438db7092" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "f0dc7673-5c82-47db-a820-0e8438db7092" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:49:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:07 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:49:07 user nova-compute[75672]: INFO nova.compute.claims [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Claim successful on node user
Nov 30 12:49:07 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:49:07 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:49:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:49:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:49:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:49:07 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:49:07 user nova-compute[75672]: DEBUG nova.policy [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa04e80eda5248478efbdcc04f68d79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a515a90e05403281db278fd0da0516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:49:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:49:08 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Creating image(s)
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "/opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "/opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.168s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.169s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk 1073741824" returned: 0 in 0.052s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Successfully created port: 749ca2b5-8eda-45a1-b8ec-ba9817f8265f {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Cannot resize image /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Ensure instance console log exists: /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Successfully updated port: 749ca2b5-8eda-45a1-b8ec-ba9817f8265f {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "refresh_cache-f0dc7673-5c82-47db-a820-0e8438db7092" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquired lock "refresh_cache-f0dc7673-5c82-47db-a820-0e8438db7092" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-8a1994a6-629a-491d-89f9-2203bd4b2516 req-48bbc781-0e85-45a8-a584-4ba715cd60ed service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Received event network-changed-749ca2b5-8eda-45a1-b8ec-ba9817f8265f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-8a1994a6-629a-491d-89f9-2203bd4b2516 req-48bbc781-0e85-45a8-a584-4ba715cd60ed service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Refreshing instance network info cache due to event network-changed-749ca2b5-8eda-45a1-b8ec-ba9817f8265f. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8a1994a6-629a-491d-89f9-2203bd4b2516 req-48bbc781-0e85-45a8-a584-4ba715cd60ed service nova] Acquiring lock "refresh_cache-f0dc7673-5c82-47db-a820-0e8438db7092" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.network.neutron [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Updating instance_info_cache with network_info: [{"id": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "address": "fa:16:3e:34:1f:e2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749ca2b5-8e", "ovs_interfaceid": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Releasing lock "refresh_cache-f0dc7673-5c82-47db-a820-0e8438db7092" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Instance network_info: |[{"id": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "address": "fa:16:3e:34:1f:e2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749ca2b5-8e", "ovs_interfaceid": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8a1994a6-629a-491d-89f9-2203bd4b2516 req-48bbc781-0e85-45a8-a584-4ba715cd60ed service nova] Acquired lock "refresh_cache-f0dc7673-5c82-47db-a820-0e8438db7092" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-8a1994a6-629a-491d-89f9-2203bd4b2516 req-48bbc781-0e85-45a8-a584-4ba715cd60ed service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Refreshing network info cache for port 749ca2b5-8eda-45a1-b8ec-ba9817f8265f {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Start _get_guest_xml network_info=[{"id": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "address": "fa:16:3e:34:1f:e2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749ca2b5-8e", "ovs_interfaceid": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:49:09 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:49:09 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-312464970',display_name='tempest-ServersNegativeTestJSON-server-312464970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-312464970',id=39,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5a515a90e05403281db278fd0da0516',ramdisk_id='',reservation_id='r-iuz2r9zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-69784533',owner_user_name='tempest-ServersNegativeTestJSON-69784533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:49:08Z,user_data=None,user_id='aa04e80eda5248478efbdcc04f68d79f',uuid=f0dc7673-5c82-47db-a820-0e8438db7092,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "address": "fa:16:3e:34:1f:e2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749ca2b5-8e", "ovs_interfaceid": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Converting VIF {"id": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "address": "fa:16:3e:34:1f:e2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749ca2b5-8e", "ovs_interfaceid": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:1f:e2,bridge_name='br-int',has_traffic_filtering=True,id=749ca2b5-8eda-45a1-b8ec-ba9817f8265f,network=Network(01af390a-7f78-4062-bb05-a7cc50446933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749ca2b5-8e') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.objects.instance [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lazy-loading 'pci_devices' on Instance uuid f0dc7673-5c82-47db-a820-0e8438db7092 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:49:09 user nova-compute[75672]:   <uuid>f0dc7673-5c82-47db-a820-0e8438db7092</uuid>
Nov 30 12:49:09 user nova-compute[75672]:   <name>instance-00000027</name>
Nov 30 12:49:09 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:49:09 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:49:09 user nova-compute[75672]:   <metadata>
Nov 30 12:49:09 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:49:09 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:49:09 user nova-compute[75672]:       <nova:name>tempest-ServersNegativeTestJSON-server-312464970</nova:name>
Nov 30 12:49:09 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:49:09</nova:creationTime>
Nov 30 12:49:09 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:49:09 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:49:09 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:49:09 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:49:09 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:49:09 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:49:09 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:49:09 user nova-compute[75672]:       <nova:owner>
Nov 30 12:49:09 user nova-compute[75672]:         <nova:user uuid="aa04e80eda5248478efbdcc04f68d79f">tempest-ServersNegativeTestJSON-69784533-project-member</nova:user>
Nov 30 12:49:09 user nova-compute[75672]:         <nova:project uuid="e5a515a90e05403281db278fd0da0516">tempest-ServersNegativeTestJSON-69784533</nova:project>
Nov 30 12:49:09 user nova-compute[75672]:       </nova:owner>
Nov 30 12:49:09 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:49:09 user nova-compute[75672]:       <nova:ports>
Nov 30 12:49:09 user nova-compute[75672]:         <nova:port uuid="749ca2b5-8eda-45a1-b8ec-ba9817f8265f">
Nov 30 12:49:09 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 12:49:09 user nova-compute[75672]:         </nova:port>
Nov 30 12:49:09 user nova-compute[75672]:       </nova:ports>
Nov 30 12:49:09 user nova-compute[75672]:     </nova:instance>
Nov 30 12:49:09 user nova-compute[75672]:   </metadata>
Nov 30 12:49:09 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:49:09 user nova-compute[75672]:     <system>
Nov 30 12:49:09 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:49:09 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:49:09 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:49:09 user nova-compute[75672]:       <entry name="serial">f0dc7673-5c82-47db-a820-0e8438db7092</entry>
Nov 30 12:49:09 user nova-compute[75672]:       <entry name="uuid">f0dc7673-5c82-47db-a820-0e8438db7092</entry>
Nov 30 12:49:09 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:49:09 user nova-compute[75672]:     </system>
Nov 30 12:49:09 user nova-compute[75672]:   </sysinfo>
Nov 30 12:49:09 user nova-compute[75672]:   <os>
Nov 30 12:49:09 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:49:09 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:49:09 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:49:09 user nova-compute[75672]:   </os>
Nov 30 12:49:09 user nova-compute[75672]:   <features>
Nov 30 12:49:09 user nova-compute[75672]:     <acpi/>
Nov 30 12:49:09 user nova-compute[75672]:     <apic/>
Nov 30 12:49:09 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:49:09 user nova-compute[75672]:   </features>
Nov 30 12:49:09 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:49:09 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:49:09 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:49:09 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:49:09 user nova-compute[75672]:   </clock>
Nov 30 12:49:09 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:49:09 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:49:09 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:49:09 user nova-compute[75672]:   </cpu>
Nov 30 12:49:09 user nova-compute[75672]:   <devices>
Nov 30 12:49:09 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:49:09 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:49:09 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk"/>
Nov 30 12:49:09 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:49:09 user nova-compute[75672]:     </disk>
Nov 30 12:49:09 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:49:09 user nova-compute[75672]:       <mac address="fa:16:3e:34:1f:e2"/>
Nov 30 12:49:09 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:49:09 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:49:09 user nova-compute[75672]:       <target dev="tap749ca2b5-8e"/>
Nov 30 12:49:09 user nova-compute[75672]:     </interface>
Nov 30 12:49:09 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:49:09 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/console.log" append="off"/>
Nov 30 12:49:09 user nova-compute[75672]:     </serial>
Nov 30 12:49:09 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:49:09 user nova-compute[75672]:     <video>
Nov 30 12:49:09 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:49:09 user nova-compute[75672]:     </video>
Nov 30 12:49:09 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:49:09 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:49:09 user nova-compute[75672]:     </rng>
Nov 30 12:49:09 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:49:09 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:49:09 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:49:09 user nova-compute[75672]:     </memballoon>
Nov 30 12:49:09 user nova-compute[75672]:   </devices>
Nov 30 12:49:09 user nova-compute[75672]: </domain>
Nov 30 12:49:09 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-312464970',display_name='tempest-ServersNegativeTestJSON-server-312464970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-312464970',id=39,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5a515a90e05403281db278fd0da0516',ramdisk_id='',reservation_id='r-iuz2r9zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-69784533',owner_user_name='tempest-ServersNegativeTestJSON-69784533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:49:08Z,user_data=None,user_id='aa04e80eda5248478efbdcc04f68d79f',uuid=f0dc7673-5c82-47db-a820-0e8438db7092,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "address": "fa:16:3e:34:1f:e2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749ca2b5-8e", "ovs_interfaceid": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Converting VIF {"id": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "address": "fa:16:3e:34:1f:e2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749ca2b5-8e", "ovs_interfaceid": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:1f:e2,bridge_name='br-int',has_traffic_filtering=True,id=749ca2b5-8eda-45a1-b8ec-ba9817f8265f,network=Network(01af390a-7f78-4062-bb05-a7cc50446933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749ca2b5-8e') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG os_vif [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:1f:e2,bridge_name='br-int',has_traffic_filtering=True,id=749ca2b5-8eda-45a1-b8ec-ba9817f8265f,network=Network(01af390a-7f78-4062-bb05-a7cc50446933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749ca2b5-8e') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fa3c745-dbb0-5d3d-a11c-527f95f0d779', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap749ca2b5-8e, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap749ca2b5-8e, col_values=(('qos', UUID('e738c566-cd0c-4e7d-bac9-5b5bbc5b4672')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap749ca2b5-8e, col_values=(('external_ids', {'iface-id': '749ca2b5-8eda-45a1-b8ec-ba9817f8265f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:1f:e2', 'vm-uuid': 'f0dc7673-5c82-47db-a820-0e8438db7092'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:09 user nova-compute[75672]: INFO os_vif [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:1f:e2,bridge_name='br-int',has_traffic_filtering=True,id=749ca2b5-8eda-45a1-b8ec-ba9817f8265f,network=Network(01af390a-7f78-4062-bb05-a7cc50446933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749ca2b5-8e')
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] No VIF found with MAC fa:16:3e:34:1f:e2, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-8a1994a6-629a-491d-89f9-2203bd4b2516 req-48bbc781-0e85-45a8-a584-4ba715cd60ed service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Updated VIF entry in instance network info cache for port 749ca2b5-8eda-45a1-b8ec-ba9817f8265f. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-8a1994a6-629a-491d-89f9-2203bd4b2516 req-48bbc781-0e85-45a8-a584-4ba715cd60ed service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Updating instance_info_cache with network_info: [{"id": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "address": "fa:16:3e:34:1f:e2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749ca2b5-8e", "ovs_interfaceid": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:49:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8a1994a6-629a-491d-89f9-2203bd4b2516 req-48bbc781-0e85-45a8-a584-4ba715cd60ed service nova] Releasing lock "refresh_cache-f0dc7673-5c82-47db-a820-0e8438db7092" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:49:10 user nova-compute[75672]: INFO nova.compute.manager [None req-a37d6f05-b874-42bb-9b8c-60c19b8bdf4d tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Get console output
Nov 30 12:49:10 user nova-compute[75672]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "87744aef-7e32-475b-907e-e30702d083bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG nova.objects.instance [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lazy-loading 'flavor' on Instance uuid 87744aef-7e32-475b-907e-e30702d083bf {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "87744aef-7e32-475b-907e-e30702d083bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "87744aef-7e32-475b-907e-e30702d083bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:10 user nova-compute[75672]: INFO nova.compute.manager [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Attaching volume f9a189e3-52ee-40ba-9fcd-a0d0e5612188 to /dev/vdb
Nov 30 12:49:10 user nova-compute[75672]: DEBUG os_brick.utils [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[56548d69-295b-4fe6-afed-854480dd9f27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c78857-85d6-46f3-a41c-b7bd2a293d55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.051s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edfbddb-5a9c-489f-b2d3-ca8fe567bec3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[652f522a-b40e-43c0-99d6-4091f7285f26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:49:10 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:49:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[51263e56-66cb-40a6-8d89-683955021f09]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG os_brick.utils [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updating existing volume attachment record: 1a47f437-f738-4481-a4cf-0fa09be912b4 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-dd23627d-ca23-4999-a3f3-bc5c2fbd9b51 req-89dc5d37-a04c-4d7b-8465-837ca94f508b service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Received event network-vif-plugged-749ca2b5-8eda-45a1-b8ec-ba9817f8265f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:49:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dd23627d-ca23-4999-a3f3-bc5c2fbd9b51 req-89dc5d37-a04c-4d7b-8465-837ca94f508b service nova] Acquiring lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dd23627d-ca23-4999-a3f3-bc5c2fbd9b51 req-89dc5d37-a04c-4d7b-8465-837ca94f508b service nova] Lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dd23627d-ca23-4999-a3f3-bc5c2fbd9b51 req-89dc5d37-a04c-4d7b-8465-837ca94f508b service nova] Lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-dd23627d-ca23-4999-a3f3-bc5c2fbd9b51 req-89dc5d37-a04c-4d7b-8465-837ca94f508b service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] No waiting events found dispatching network-vif-plugged-749ca2b5-8eda-45a1-b8ec-ba9817f8265f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:49:11 user nova-compute[75672]: WARNING nova.compute.manager [req-dd23627d-ca23-4999-a3f3-bc5c2fbd9b51 req-89dc5d37-a04c-4d7b-8465-837ca94f508b service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Received unexpected event network-vif-plugged-749ca2b5-8eda-45a1-b8ec-ba9817f8265f for instance with vm_state building and task_state spawning.
Nov 30 12:49:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "498d231e-d0be-4ea5-9024-669a978b8292" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "498d231e-d0be-4ea5-9024-669a978b8292" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:49:12 user nova-compute[75672]: INFO nova.compute.claims [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Claim successful on node user
Nov 30 12:49:12 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:49:12 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:49:12 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG nova.policy [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '924cf8ff73154f8fadb371175a0d8fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513644b3a140400dbdf6b07e8e727dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:49:12 user nova-compute[75672]: INFO nova.virt.block_device [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Booting with volume 3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf at /dev/vda
Nov 30 12:49:12 user nova-compute[75672]: DEBUG os_brick.utils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2638ec49-90c5-4775-bc05-923e1f2bbe24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[069fe2dd-8bb8-4378-b161-dee08125038a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[624b3c25-253d-4e5a-b5be-8160d33e67eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd44df1-2644-497e-9eba-edfe66577606]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:49:13 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:49:13 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[38902fca-2556-4542-8ac9-03dd03a9d7d1]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG os_brick.utils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Updating existing volume attachment record: 1c86c3c5-ec91-443d-a3d3-6a50c823b995 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:49:13 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Instance spawned successfully.
Nov 30 12:49:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:49:13 user nova-compute[75672]: INFO nova.compute.manager [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 30 12:49:13 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-a3d0365a-2588-4ad8-b685-c8c9a7e87aa4 req-daad4b5e-73a4-4f9d-80f2-bf370de28cf2 service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Received event network-vif-plugged-749ca2b5-8eda-45a1-b8ec-ba9817f8265f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a3d0365a-2588-4ad8-b685-c8c9a7e87aa4 req-daad4b5e-73a4-4f9d-80f2-bf370de28cf2 service nova] Acquiring lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a3d0365a-2588-4ad8-b685-c8c9a7e87aa4 req-daad4b5e-73a4-4f9d-80f2-bf370de28cf2 service nova] Lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a3d0365a-2588-4ad8-b685-c8c9a7e87aa4 req-daad4b5e-73a4-4f9d-80f2-bf370de28cf2 service nova] Lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-a3d0365a-2588-4ad8-b685-c8c9a7e87aa4 req-daad4b5e-73a4-4f9d-80f2-bf370de28cf2 service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] No waiting events found dispatching network-vif-plugged-749ca2b5-8eda-45a1-b8ec-ba9817f8265f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:49:13 user nova-compute[75672]: WARNING nova.compute.manager [req-a3d0365a-2588-4ad8-b685-c8c9a7e87aa4 req-daad4b5e-73a4-4f9d-80f2-bf370de28cf2 service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Received unexpected event network-vif-plugged-749ca2b5-8eda-45a1-b8ec-ba9817f8265f for instance with vm_state building and task_state spawning.
Nov 30 12:49:13 user nova-compute[75672]: INFO nova.compute.manager [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Took 6.00 seconds to build instance.
Nov 30 12:49:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1c7bf68a-f5a1-4a88-a499-466b4fa3305d tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "f0dc7673-5c82-47db-a820-0e8438db7092" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.145s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:13 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Successfully created port: 015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:49:14 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Successfully updated port: 015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:49:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "refresh_cache-498d231e-d0be-4ea5-9024-669a978b8292" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:49:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquired lock "refresh_cache-498d231e-d0be-4ea5-9024-669a978b8292" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:49:14 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:49:14 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:49:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:14 user nova-compute[75672]: DEBUG nova.network.neutron [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Updating instance_info_cache with network_info: [{"id": "015af49e-5605-48da-a8bc-472fe731e91a", "address": "fa:16:3e:ae:be:e3", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015af49e-56", "ovs_interfaceid": "015af49e-5605-48da-a8bc-472fe731e91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:49:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Releasing lock "refresh_cache-498d231e-d0be-4ea5-9024-669a978b8292" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:49:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Instance network_info: |[{"id": "015af49e-5605-48da-a8bc-472fe731e91a", "address": "fa:16:3e:ae:be:e3", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015af49e-56", "ovs_interfaceid": "015af49e-5605-48da-a8bc-472fe731e91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:49:15 user nova-compute[75672]: DEBUG nova.compute.manager [req-fbdc5ec9-849c-4d98-8564-8f5987afcbeb req-f032aee3-46e0-400e-afd0-986d509d3022 service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Received event network-changed-015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:49:15 user nova-compute[75672]: DEBUG nova.compute.manager [req-fbdc5ec9-849c-4d98-8564-8f5987afcbeb req-f032aee3-46e0-400e-afd0-986d509d3022 service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Refreshing instance network info cache due to event network-changed-015af49e-5605-48da-a8bc-472fe731e91a. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:49:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fbdc5ec9-849c-4d98-8564-8f5987afcbeb req-f032aee3-46e0-400e-afd0-986d509d3022 service nova] Acquiring lock "refresh_cache-498d231e-d0be-4ea5-9024-669a978b8292" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:49:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fbdc5ec9-849c-4d98-8564-8f5987afcbeb req-f032aee3-46e0-400e-afd0-986d509d3022 service nova] Acquired lock "refresh_cache-498d231e-d0be-4ea5-9024-669a978b8292" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:49:15 user nova-compute[75672]: DEBUG nova.network.neutron [req-fbdc5ec9-849c-4d98-8564-8f5987afcbeb req-f032aee3-46e0-400e-afd0-986d509d3022 service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Refreshing network info cache for port 015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:49:16 user nova-compute[75672]: DEBUG nova.network.neutron [req-fbdc5ec9-849c-4d98-8564-8f5987afcbeb req-f032aee3-46e0-400e-afd0-986d509d3022 service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Updated VIF entry in instance network info cache for port 015af49e-5605-48da-a8bc-472fe731e91a. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:49:16 user nova-compute[75672]: DEBUG nova.network.neutron [req-fbdc5ec9-849c-4d98-8564-8f5987afcbeb req-f032aee3-46e0-400e-afd0-986d509d3022 service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Updating instance_info_cache with network_info: [{"id": "015af49e-5605-48da-a8bc-472fe731e91a", "address": "fa:16:3e:ae:be:e3", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015af49e-56", "ovs_interfaceid": "015af49e-5605-48da-a8bc-472fe731e91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:49:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fbdc5ec9-849c-4d98-8564-8f5987afcbeb req-f032aee3-46e0-400e-afd0-986d509d3022 service nova] Releasing lock "refresh_cache-498d231e-d0be-4ea5-9024-669a978b8292" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:49:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbqhJALj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:49:20 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.010s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:49:20 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:49:20 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9787566-08ec-402a-8c31-da5bac47a080]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:49:20 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d55e32b-ffc8-4815-98cc-d15e47662a1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188] added
Nov 30 12:49:20 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4c687e-6979-4e2f-9fde-61bb5e9183d6]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b5066f-8528-402b-a6f9-5b4a2834760e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbqhJALj {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbqhJALj" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca30601-638e-4fa9-8163-6e0dba569794]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QbqhJALj'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b898f54b-33b2-4db5-a025-21318da4d186]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08a01de-a2d6-40ed-a1b6-c809b84a5473]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:49:20 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:49:20 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:49:20 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:49:20 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc320e1e-98ad-4e24-b599-f5c4823ee60d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188, portal: 172.16.0.220,3260]
Nov 30 12:49:20 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188, portal: 172.16.0.220,3260] successful.
Nov 30 12:49:20 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b54fd0c-5632-4679-87d0-3b4dbdc66fec]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c366270c-bb2d-4a7d-ba81-bf57f385574f]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:49:20 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:49:20 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:49:20 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:49:20 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:49:20 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:49:20 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[08291755-a921-462c-a787-b64e0a39b76a]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:49:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbqhJALj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:49:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:49:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26530336665626466', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:49:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530336665626466', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:49:21 user nova-compute[75672]: DEBUG nova.objects.instance [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lazy-loading 'flavor' on Instance uuid 87744aef-7e32-475b-907e-e30702d083bf {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:49:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:49:21 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:49:21 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 12:49:21 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:49:21 user nova-compute[75672]:   <serial>f9a189e3-52ee-40ba-9fcd-a0d0e5612188</serial>
Nov 30 12:49:21 user nova-compute[75672]: </disk>
Nov 30 12:49:21 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:49:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:49:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] No VIF found with MAC fa:16:3e:2f:73:38, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-488b37a2-4828-4dca-9031-bcbf5d1df464 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "87744aef-7e32-475b-907e-e30702d083bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.673s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:49:22 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Creating image(s)
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Ensure instance console log exists: /opt/stack/data/nova/instances/498d231e-d0be-4ea5-9024-669a978b8292/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Start _get_guest_xml network_info=[{"id": "015af49e-5605-48da-a8bc-472fe731e91a", "address": "fa:16:3e:ae:be:e3", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015af49e-56", "ovs_interfaceid": "015af49e-5605-48da-a8bc-472fe731e91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1c86c3c5-ec91-443d-a3d3-6a50c823b995', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viUPLGdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '498d231e-d0be-4ea5-9024-669a978b8292', 'attached_at': '', 'detached_at': '', 'volume_id': '3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf', 'serial': '3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:49:22 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:49:22 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viUPLGdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:49:22 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:49:22 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:49:22 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e81be4-e85d-4d7b-8b06-d391b86ddaa8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:49:22 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b214e3e-49bf-4ddc-a02d-a32e7924d76c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf] added
Nov 30 12:49:22 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d90e77-d3ae-458a-b73d-0464a483b50b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:22 user nova-compute[75672]: INFO nova.compute.manager [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Rescuing
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquired lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG nova.network.neutron [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12a6246-353c-4f4e-9c6b-69f47d8cd308]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v viUPLGdj {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v viUPLGdj" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[30807d19-aa50-4476-b069-ecc1676c995c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'viUPLGdj'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[21eef1e5-8368-4266-9715-74b461700428]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41720c8-40c8-42d9-aff0-69c87284796c]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:49:22 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:49:22 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:49:22 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:49:22 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:49:22 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:49:22 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f462cb-f959-41f8-957e-fa2994cb3de2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260]
Nov 30 12:49:22 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260] successful.
Nov 30 12:49:22 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b2f1f4-92fb-45fc-b98c-ed7d6fb9a754]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd840729-6580-4cf6-b8bc-4aec4f9a3d46]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:49:22 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:49:22 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:49:22 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:49:22 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:49:22 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:49:22 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:49:22 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:49:22 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e8d915-2f52-4b82-9b4e-bdefd87c8016]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:49:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viUPLGdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.network.neutron [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updating instance_info_cache with network_info: [{"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Releasing lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.compute.manager [req-a4f9438b-e4a7-4dce-b2a8-1d705bcf43cd req-8c3c44ef-c8d6-432c-9f78-b922f7cf624c service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-vif-unplugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a4f9438b-e4a7-4dce-b2a8-1d705bcf43cd req-8c3c44ef-c8d6-432c-9f78-b922f7cf624c service nova] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a4f9438b-e4a7-4dce-b2a8-1d705bcf43cd req-8c3c44ef-c8d6-432c-9f78-b922f7cf624c service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a4f9438b-e4a7-4dce-b2a8-1d705bcf43cd req-8c3c44ef-c8d6-432c-9f78-b922f7cf624c service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.compute.manager [req-a4f9438b-e4a7-4dce-b2a8-1d705bcf43cd req-8c3c44ef-c8d6-432c-9f78-b922f7cf624c service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] No waiting events found dispatching network-vif-unplugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:49:23 user nova-compute[75672]: WARNING nova.compute.manager [req-a4f9438b-e4a7-4dce-b2a8-1d705bcf43cd req-8c3c44ef-c8d6-432c-9f78-b922f7cf624c service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received unexpected event network-vif-unplugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 for instance with vm_state active and task_state rescuing.
Nov 30 12:49:23 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Instance destroyed successfully.
Nov 30 12:49:23 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Attempting a stable device rescue
Nov 30 12:49:23 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23233313766323333', 'path': '/dev/sdc'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233313766323333', 'path': '/dev/sdc'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2033127066',display_name='tempest-TestVolumeBootPattern-server-2033127066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2033127066',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/tiWnKVjyQ+YQ0wPEgFpD4sUWbk2GMRtR0fUhMrrhWzqEfZseqSV3bBKpPI9FNVcBh3EJSPDcri0dXJ24ST3AlMd1Z9vj5ezFGg5LMAjAiHzircmeHJyIgzk+4EYWw6A==',key_name='tempest-TestVolumeBootPattern-1453287901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-az5lqqp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:49:13Z,user_data=None,user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=498d231e-d0be-4ea5-9024-669a978b8292,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "015af49e-5605-48da-a8bc-472fe731e91a", "address": "fa:16:3e:ae:be:e3", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015af49e-56", "ovs_interfaceid": "015af49e-5605-48da-a8bc-472fe731e91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "015af49e-5605-48da-a8bc-472fe731e91a", "address": "fa:16:3e:ae:be:e3", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015af49e-56", "ovs_interfaceid": "015af49e-5605-48da-a8bc-472fe731e91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:be:e3,bridge_name='br-int',has_traffic_filtering=True,id=015af49e-5605-48da-a8bc-472fe731e91a,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015af49e-56') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.objects.instance [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lazy-loading 'pci_devices' on Instance uuid 498d231e-d0be-4ea5-9024-669a978b8292 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:49:23 user nova-compute[75672]:   <uuid>498d231e-d0be-4ea5-9024-669a978b8292</uuid>
Nov 30 12:49:23 user nova-compute[75672]:   <name>instance-00000028</name>
Nov 30 12:49:23 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:49:23 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:49:23 user nova-compute[75672]:   <metadata>
Nov 30 12:49:23 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:49:23 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:49:23 user nova-compute[75672]:       <nova:name>tempest-TestVolumeBootPattern-server-2033127066</nova:name>
Nov 30 12:49:23 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:49:22</nova:creationTime>
Nov 30 12:49:23 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:49:23 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:49:23 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:49:23 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:49:23 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:49:23 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:49:23 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:49:23 user nova-compute[75672]:       <nova:owner>
Nov 30 12:49:23 user nova-compute[75672]:         <nova:user uuid="924cf8ff73154f8fadb371175a0d8fc4">tempest-TestVolumeBootPattern-1743139468-project-member</nova:user>
Nov 30 12:49:23 user nova-compute[75672]:         <nova:project uuid="513644b3a140400dbdf6b07e8e727dd4">tempest-TestVolumeBootPattern-1743139468</nova:project>
Nov 30 12:49:23 user nova-compute[75672]:       </nova:owner>
Nov 30 12:49:23 user nova-compute[75672]:       <nova:ports>
Nov 30 12:49:23 user nova-compute[75672]:         <nova:port uuid="015af49e-5605-48da-a8bc-472fe731e91a">
Nov 30 12:49:23 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 12:49:23 user nova-compute[75672]:         </nova:port>
Nov 30 12:49:23 user nova-compute[75672]:       </nova:ports>
Nov 30 12:49:23 user nova-compute[75672]:     </nova:instance>
Nov 30 12:49:23 user nova-compute[75672]:   </metadata>
Nov 30 12:49:23 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:49:23 user nova-compute[75672]:     <system>
Nov 30 12:49:23 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:49:23 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:49:23 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:49:23 user nova-compute[75672]:       <entry name="serial">498d231e-d0be-4ea5-9024-669a978b8292</entry>
Nov 30 12:49:23 user nova-compute[75672]:       <entry name="uuid">498d231e-d0be-4ea5-9024-669a978b8292</entry>
Nov 30 12:49:23 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:49:23 user nova-compute[75672]:     </system>
Nov 30 12:49:23 user nova-compute[75672]:   </sysinfo>
Nov 30 12:49:23 user nova-compute[75672]:   <os>
Nov 30 12:49:23 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:49:23 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:49:23 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:49:23 user nova-compute[75672]:   </os>
Nov 30 12:49:23 user nova-compute[75672]:   <features>
Nov 30 12:49:23 user nova-compute[75672]:     <acpi/>
Nov 30 12:49:23 user nova-compute[75672]:     <apic/>
Nov 30 12:49:23 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:49:23 user nova-compute[75672]:   </features>
Nov 30 12:49:23 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:49:23 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:49:23 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:49:23 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:49:23 user nova-compute[75672]:   </clock>
Nov 30 12:49:23 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:49:23 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:49:23 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:49:23 user nova-compute[75672]:   </cpu>
Nov 30 12:49:23 user nova-compute[75672]:   <devices>
Nov 30 12:49:23 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:49:23 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:49:23 user nova-compute[75672]:       <source dev="/dev/sdc"/>
Nov 30 12:49:23 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:49:23 user nova-compute[75672]:       <serial>3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf</serial>
Nov 30 12:49:23 user nova-compute[75672]:     </disk>
Nov 30 12:49:23 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:49:23 user nova-compute[75672]:       <mac address="fa:16:3e:ae:be:e3"/>
Nov 30 12:49:23 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:49:23 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:49:23 user nova-compute[75672]:       <target dev="tap015af49e-56"/>
Nov 30 12:49:23 user nova-compute[75672]:     </interface>
Nov 30 12:49:23 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:49:23 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/498d231e-d0be-4ea5-9024-669a978b8292/console.log" append="off"/>
Nov 30 12:49:23 user nova-compute[75672]:     </serial>
Nov 30 12:49:23 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:49:23 user nova-compute[75672]:     <video>
Nov 30 12:49:23 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:49:23 user nova-compute[75672]:     </video>
Nov 30 12:49:23 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:49:23 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:49:23 user nova-compute[75672]:     </rng>
Nov 30 12:49:23 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:49:23 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:49:23 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:49:23 user nova-compute[75672]:     </memballoon>
Nov 30 12:49:23 user nova-compute[75672]:   </devices>
Nov 30 12:49:23 user nova-compute[75672]: </domain>
Nov 30 12:49:23 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2033127066',display_name='tempest-TestVolumeBootPattern-server-2033127066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2033127066',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/tiWnKVjyQ+YQ0wPEgFpD4sUWbk2GMRtR0fUhMrrhWzqEfZseqSV3bBKpPI9FNVcBh3EJSPDcri0dXJ24ST3AlMd1Z9vj5ezFGg5LMAjAiHzircmeHJyIgzk+4EYWw6A==',key_name='tempest-TestVolumeBootPattern-1453287901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-az5lqqp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:49:13Z,user_data=None,user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=498d231e-d0be-4ea5-9024-669a978b8292,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "015af49e-5605-48da-a8bc-472fe731e91a", "address": "fa:16:3e:ae:be:e3", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015af49e-56", "ovs_interfaceid": "015af49e-5605-48da-a8bc-472fe731e91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "015af49e-5605-48da-a8bc-472fe731e91a", "address": "fa:16:3e:ae:be:e3", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015af49e-56", "ovs_interfaceid": "015af49e-5605-48da-a8bc-472fe731e91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:be:e3,bridge_name='br-int',has_traffic_filtering=True,id=015af49e-5605-48da-a8bc-472fe731e91a,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015af49e-56') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG os_vif [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:be:e3,bridge_name='br-int',has_traffic_filtering=True,id=015af49e-5605-48da-a8bc-472fe731e91a,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015af49e-56') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75672) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b9a5f55-c365-5e76-89b8-b425c6545707', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Instance directory exists: not creating {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Nov 30 12:49:23 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Creating image(s)
Nov 30 12:49:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "/opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "/opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "/opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG nova.objects.instance [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lazy-loading 'trusted_certs' on Instance uuid 87744aef-7e32-475b-907e-e30702d083bf {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap015af49e-56, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap015af49e-56, col_values=(('qos', UUID('1fdd888d-9d53-4664-89c9-44404a321490')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:49:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap015af49e-56, col_values=(('external_ids', {'iface-id': '015af49e-5605-48da-a8bc-472fe731e91a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:be:e3', 'vm-uuid': '498d231e-d0be-4ea5-9024-669a978b8292'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:49:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "3b2c432575e4670c01f2042260debefcfd7582ed" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "3b2c432575e4670c01f2042260debefcfd7582ed" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:49:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:24 user nova-compute[75672]: INFO os_vif [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:be:e3,bridge_name='br-int',has_traffic_filtering=True,id=015af49e-5605-48da-a8bc-472fe731e91a,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015af49e-56')
Nov 30 12:49:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:49:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] No VIF found with MAC fa:16:3e:ae:be:e3, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed.part --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed.part --force-share --output=json" returned: 0 in 0.171s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG nova.virt.images [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] 6058af1d-0f89-4446-9510-dfd3431822de was qcow2, converting to raw {{(pid=75672) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed.part /opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed.converted {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG nova.compute.manager [req-ac5bad23-13fd-4360-b53d-a5c75cc91085 req-95fca2a0-2b28-4582-bddc-5d484bc81731 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ac5bad23-13fd-4360-b53d-a5c75cc91085 req-95fca2a0-2b28-4582-bddc-5d484bc81731 service nova] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ac5bad23-13fd-4360-b53d-a5c75cc91085 req-95fca2a0-2b28-4582-bddc-5d484bc81731 service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ac5bad23-13fd-4360-b53d-a5c75cc91085 req-95fca2a0-2b28-4582-bddc-5d484bc81731 service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG nova.compute.manager [req-ac5bad23-13fd-4360-b53d-a5c75cc91085 req-95fca2a0-2b28-4582-bddc-5d484bc81731 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] No waiting events found dispatching network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:49:25 user nova-compute[75672]: WARNING nova.compute.manager [req-ac5bad23-13fd-4360-b53d-a5c75cc91085 req-95fca2a0-2b28-4582-bddc-5d484bc81731 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received unexpected event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 for instance with vm_state active and task_state rescuing.
Nov 30 12:49:25 user nova-compute[75672]: DEBUG nova.compute.manager [req-f284d97e-fcfd-4e44-88c4-3a8b185b8758 req-bcc74a33-a593-474f-a0c3-491309edccec service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Received event network-vif-plugged-015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f284d97e-fcfd-4e44-88c4-3a8b185b8758 req-bcc74a33-a593-474f-a0c3-491309edccec service nova] Acquiring lock "498d231e-d0be-4ea5-9024-669a978b8292-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f284d97e-fcfd-4e44-88c4-3a8b185b8758 req-bcc74a33-a593-474f-a0c3-491309edccec service nova] Lock "498d231e-d0be-4ea5-9024-669a978b8292-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f284d97e-fcfd-4e44-88c4-3a8b185b8758 req-bcc74a33-a593-474f-a0c3-491309edccec service nova] Lock "498d231e-d0be-4ea5-9024-669a978b8292-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:25 user nova-compute[75672]: DEBUG nova.compute.manager [req-f284d97e-fcfd-4e44-88c4-3a8b185b8758 req-bcc74a33-a593-474f-a0c3-491309edccec service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] No waiting events found dispatching network-vif-plugged-015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:49:25 user nova-compute[75672]: WARNING nova.compute.manager [req-f284d97e-fcfd-4e44-88c4-3a8b185b8758 req-bcc74a33-a593-474f-a0c3-491309edccec service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Received unexpected event network-vif-plugged-015af49e-5605-48da-a8bc-472fe731e91a for instance with vm_state building and task_state spawning.
Nov 30 12:49:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed.part /opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed.converted" returned: 0 in 0.703s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed.converted --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "3b2c432575e4670c01f2042260debefcfd7582ed" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.238s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "3b2c432575e4670c01f2042260debefcfd7582ed" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "3b2c432575e4670c01f2042260debefcfd7582ed" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed --force-share --output=json" returned: 0 in 0.186s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed,backing_fmt=raw /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.rescue {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed,backing_fmt=raw /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.rescue" returned: 0 in 0.136s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "3b2c432575e4670c01f2042260debefcfd7582ed" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.objects.instance [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lazy-loading 'migration_context' on Instance uuid 87744aef-7e32-475b-907e-e30702d083bf {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.objects.base [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Object Instance<87744aef-7e32-475b-907e-e30702d083bf> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Start _get_guest_xml network_info=[{"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "vif_mac": "fa:16:3e:2f:73:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6058af1d-0f89-4446-9510-dfd3431822de', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1a47f437-f738-4481-a4cf-0fa09be912b4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbqhJALj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '87744aef-7e32-475b-907e-e30702d083bf', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9a189e3-52ee-40ba-9fcd-a0d0e5612188', 'serial': 'f9a189e3-52ee-40ba-9fcd-a0d0e5612188'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.objects.instance [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lazy-loading 'resources' on Instance uuid 87744aef-7e32-475b-907e-e30702d083bf {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.objects.base [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Object Instance<87744aef-7e32-475b-907e-e30702d083bf> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.objects.instance [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lazy-loading 'numa_topology' on Instance uuid 87744aef-7e32-475b-907e-e30702d083bf {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.objects.base [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Object Instance<87744aef-7e32-475b-907e-e30702d083bf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:49:26 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:49:26 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.objects.instance [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lazy-loading 'vcpu_model' on Instance uuid 87744aef-7e32-475b-907e-e30702d083bf {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.objects.base [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Object Instance<87744aef-7e32-475b-907e-e30702d083bf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbqhJALj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:49:26 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:49:26 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:49:26 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1994a52-f701-43f9-b923-158402763d97]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QbqhJALj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 12:49:26 user nova-compute[75672]: node.name = iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188
Nov 30 12:49:26 user nova-compute[75672]: node.tpgt = -1
Nov 30 12:49:26 user nova-compute[75672]: node.startup = automatic
Nov 30 12:49:26 user nova-compute[75672]: node.leading_login = No
Nov 30 12:49:26 user nova-compute[75672]: iface.iscsi_ifacename = default
Nov 30 12:49:26 user nova-compute[75672]: iface.net_ifacename = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.ipaddress = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.prefix_len = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.hwaddress = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.transport_name = tcp
Nov 30 12:49:26 user nova-compute[75672]: iface.initiatorname = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.state = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.vlan_id = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.vlan_priority = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.vlan_state = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.iface_num = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.mtu = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.port = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.bootproto = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.subnet_mask = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.gateway = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.dhcp_alt_client_id = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.dhcp_dns = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.dhcp_learn_iqn = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.dhcp_vendor_id_state = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.dhcp_vendor_id = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.dhcp_slp_da = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.fragmentation = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.gratuitous_arp = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.incoming_forwarding = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.tos_state = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.tos = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.ttl = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.delayed_ack = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.tcp_nagle = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.tcp_wsf_state = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.tcp_wsf = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.tcp_timer_scale = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.tcp_timestamp = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.redirect = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.def_task_mgmt_timeout = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.header_digest = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.data_digest = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.immediate_data = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.initial_r2t = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.data_seq_inorder = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.data_pdu_inorder = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.erl = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.max_receive_data_len = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.first_burst_len = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.max_outstanding_r2t = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.max_burst_len = 0
Nov 30 12:49:26 user nova-compute[75672]: iface.chap_auth = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.bidi_chap = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.strict_login_compliance = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.discovery_auth = <empty>
Nov 30 12:49:26 user nova-compute[75672]: iface.discovery_logout = <empty>
Nov 30 12:49:26 user nova-compute[75672]: node.discovery_address = <empty>
Nov 30 12:49:26 user nova-compute[75672]: node.discovery_port = 0
Nov 30 12:49:26 user nova-compute[75672]: node.discovery_type = static
Nov 30 12:49:26 user nova-compute[75672]: node.session.initial_cmdsn = 0
Nov 30 12:49:26 user nova-compute[75672]: node.session.initial_login_retry_max = 8
Nov 30 12:49:26 user nova-compute[75672]: node.session.xmit_thread_priority = -20
Nov 30 12:49:26 user nova-compute[75672]: node.session.cmds_max = 128
Nov 30 12:49:26 user nova-compute[75672]: node.session.queue_depth = 32
Nov 30 12:49:26 user nova-compute[75672]: node.session.nr_sessions = 1
Nov 30 12:49:26 user nova-compute[75672]: node.session.auth.authmethod = CHAP
Nov 30 12:49:26 user nova-compute[75672]: node.session.auth.username = QbqhJALj
Nov 30 12:49:26 user nova-compute[75672]: node.session.auth.password = ***
Nov 30 12:49:26 user nova-compute[75672]: node.session.auth.username_in = <empty>
Nov 30 12:49:26 user nova-compute[75672]: node.session.auth.password_in = <empty>
Nov 30 12:49:26 user nova-compute[75672]: node.session.auth.chap_algs = MD5
Nov 30 12:49:26 user nova-compute[75672]: node.session.timeo.replacement_timeout = 120
Nov 30 12:49:26 user nova-compute[75672]: node.session.err_timeo.abort_timeout = 15
Nov 30 12:49:26 user nova-compute[75672]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 12:49:26 user nova-compute[75672]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 12:49:26 user nova-compute[75672]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 12:49:26 user nova-compute[75672]: node.session.iscsi.FastAbort = Yes
Nov 30 12:49:26 user nova-compute[75672]: node.session.iscsi.InitialR2T = No
Nov 30 12:49:26 user nova-compute[75672]: node.session.iscsi.ImmediateData = Yes
Nov 30 12:49:26 user nova-compute[75672]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 12:49:26 user nova-compute[75672]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 12:49:26 user nova-compute[75672]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 12:49:26 user nova-compute[75672]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 12:49:26 user nova-compute[75672]: node.session.iscsi.MaxConnections = 1
Nov 30 12:49:26 user nova-compute[75672]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 12:49:26 user nova-compute[75672]: node.session.iscsi.ERL = 0
Nov 30 12:49:26 user nova-compute[75672]: node.session.scan = manual
Nov 30 12:49:26 user nova-compute[75672]: node.session.reopen_max = 0
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].address = 172.16.0.220
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].port = 3260
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].startup = manual
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].tcp.window_size = 524288
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].tcp.type_of_service = 0
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].timeo.logout_timeout = 15
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].timeo.login_timeout = 15
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].timeo.auth_timeout = 45
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].iscsi.DataDigest = None
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].iscsi.IFMarker = No
Nov 30 12:49:26 user nova-compute[75672]: node.conn[0].iscsi.OFMarker = No
Nov 30 12:49:26 user nova-compute[75672]: # END RECORD
Nov 30 12:49:26 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f739532-9b39-4c06-92f4-a712526d9f39]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff38f89-f1e8-4c76-9139-02c7f8d92820]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbqhJALj {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbqhJALj" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e15d5d4-7c52-40f1-bbff-87697598c05d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QbqhJALj'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95d1190-2b17-4bc1-9587-864fd727876e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e811949b-799f-44ea-86b0-5110d9af5b85]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:49:26 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:49:26 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:49:26 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:49:26 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:49:26 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:49:26 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:49:26 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:49:26 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.146s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] HCTL ('33', '0', '0', 0) found on session 43 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[709bddaf-bc4c-4ad1-9ebc-04002f8bfb3b]: (4, ('0 0 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Searching for a device in session 43 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbqhJALj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.170s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] <== connect_volume: return (171ms) {'type': 'block', 'scsi_wwn': '26530336665626466', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530336665626466', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1985842296',display_name='tempest-ServerStableDeviceRescueTest-server-1985842296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1985842296',id=35,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU4niv4fKwifKIbusrskjKw+QLKV7egXGWJ857PxXbYP3fg26Vzmu8p/sI061Q4sngY65sMaHhlDzQGbahnpFyqwvkTF2KQYtYaGXFjuu4zchSAXVVqtz2l6VqNailjUw==',key_name='tempest-keypair-1811480596',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:45:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a37bdd4c8e1345209fa532c6fd9496dd',ramdisk_id='',reservation_id='r-zhq3ccpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-752573724',owner_user_name='tempest-ServerStableDeviceRescueTest-752573724-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:47:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5019d84b3bb436f9125865467cbb702',uuid=87744aef-7e32-475b-907e-e30702d083bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "vif_mac": "fa:16:3e:2f:73:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Converting VIF {"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "vif_mac": "fa:16:3e:2f:73:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:73:38,bridge_name='br-int',has_traffic_filtering=True,id=fb7cf9cd-ce27-4327-97ad-1c2692de57e7,network=Network(10275d04-9a7c-40d7-9df0-3aa724a7b817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cf9cd-ce') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.objects.instance [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lazy-loading 'pci_devices' on Instance uuid 87744aef-7e32-475b-907e-e30702d083bf {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.objects.base [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Object Instance<87744aef-7e32-475b-907e-e30702d083bf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:49:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:49:26 user nova-compute[75672]:   <uuid>87744aef-7e32-475b-907e-e30702d083bf</uuid>
Nov 30 12:49:26 user nova-compute[75672]:   <name>instance-00000023</name>
Nov 30 12:49:26 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:49:26 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:49:26 user nova-compute[75672]:   <metadata>
Nov 30 12:49:26 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:49:26 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:49:26 user nova-compute[75672]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1985842296</nova:name>
Nov 30 12:49:26 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:49:26</nova:creationTime>
Nov 30 12:49:26 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:49:26 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:49:26 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:49:26 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:49:26 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:49:26 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:49:26 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:49:26 user nova-compute[75672]:       <nova:owner>
Nov 30 12:49:26 user nova-compute[75672]:         <nova:user uuid="e5019d84b3bb436f9125865467cbb702">tempest-ServerStableDeviceRescueTest-752573724-project-member</nova:user>
Nov 30 12:49:26 user nova-compute[75672]:         <nova:project uuid="a37bdd4c8e1345209fa532c6fd9496dd">tempest-ServerStableDeviceRescueTest-752573724</nova:project>
Nov 30 12:49:26 user nova-compute[75672]:       </nova:owner>
Nov 30 12:49:26 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:49:26 user nova-compute[75672]:       <nova:ports>
Nov 30 12:49:26 user nova-compute[75672]:         <nova:port uuid="fb7cf9cd-ce27-4327-97ad-1c2692de57e7">
Nov 30 12:49:26 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 12:49:26 user nova-compute[75672]:         </nova:port>
Nov 30 12:49:26 user nova-compute[75672]:       </nova:ports>
Nov 30 12:49:26 user nova-compute[75672]:     </nova:instance>
Nov 30 12:49:26 user nova-compute[75672]:   </metadata>
Nov 30 12:49:26 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:49:26 user nova-compute[75672]:     <system>
Nov 30 12:49:26 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:49:26 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:49:26 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:49:26 user nova-compute[75672]:       <entry name="serial">87744aef-7e32-475b-907e-e30702d083bf</entry>
Nov 30 12:49:26 user nova-compute[75672]:       <entry name="uuid">87744aef-7e32-475b-907e-e30702d083bf</entry>
Nov 30 12:49:26 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:49:26 user nova-compute[75672]:     </system>
Nov 30 12:49:26 user nova-compute[75672]:   </sysinfo>
Nov 30 12:49:26 user nova-compute[75672]:   <os>
Nov 30 12:49:26 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:49:26 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:49:26 user nova-compute[75672]:   </os>
Nov 30 12:49:26 user nova-compute[75672]:   <features>
Nov 30 12:49:26 user nova-compute[75672]:     <acpi/>
Nov 30 12:49:26 user nova-compute[75672]:     <apic/>
Nov 30 12:49:26 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:49:26 user nova-compute[75672]:   </features>
Nov 30 12:49:26 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:49:26 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:49:26 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:49:26 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:49:26 user nova-compute[75672]:   </clock>
Nov 30 12:49:26 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:49:26 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:49:26 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:49:26 user nova-compute[75672]:   </cpu>
Nov 30 12:49:26 user nova-compute[75672]:   <devices>
Nov 30 12:49:26 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:49:26 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:49:26 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk"/>
Nov 30 12:49:26 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:49:26 user nova-compute[75672]:     </disk>
Nov 30 12:49:26 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:49:26 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:49:26 user nova-compute[75672]:       <source dev="/dev/sdb"/>
Nov 30 12:49:26 user nova-compute[75672]:       <target dev="vdb" bus="virtio"/>
Nov 30 12:49:26 user nova-compute[75672]:       <serial>f9a189e3-52ee-40ba-9fcd-a0d0e5612188</serial>
Nov 30 12:49:26 user nova-compute[75672]:     </disk>
Nov 30 12:49:26 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:49:26 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:49:26 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.rescue"/>
Nov 30 12:49:26 user nova-compute[75672]:       <target dev="vdc" bus="virtio"/>
Nov 30 12:49:26 user nova-compute[75672]:       <boot order="1"/>
Nov 30 12:49:26 user nova-compute[75672]:     </disk>
Nov 30 12:49:26 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:49:26 user nova-compute[75672]:       <mac address="fa:16:3e:2f:73:38"/>
Nov 30 12:49:26 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:49:26 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:49:26 user nova-compute[75672]:       <target dev="tapfb7cf9cd-ce"/>
Nov 30 12:49:26 user nova-compute[75672]:     </interface>
Nov 30 12:49:26 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:49:26 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/console.log" append="off"/>
Nov 30 12:49:26 user nova-compute[75672]:     </serial>
Nov 30 12:49:26 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:49:26 user nova-compute[75672]:     <video>
Nov 30 12:49:26 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:49:26 user nova-compute[75672]:     </video>
Nov 30 12:49:26 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:49:26 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:49:26 user nova-compute[75672]:     </rng>
Nov 30 12:49:26 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:49:26 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:49:26 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:49:26 user nova-compute[75672]:     </memballoon>
Nov 30 12:49:26 user nova-compute[75672]:   </devices>
Nov 30 12:49:26 user nova-compute[75672]: </domain>
Nov 30 12:49:26 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:49:26 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Instance destroyed successfully.
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] No VIF found with MAC fa:16:3e:2f:73:38, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:49:27 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Instance spawned successfully.
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-a64eaeb9-4b9a-4de7-ae0d-8b706b53aeca req-a359a280-4f97-428c-a423-7bbbd94d233f service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Received event network-vif-plugged-015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a64eaeb9-4b9a-4de7-ae0d-8b706b53aeca req-a359a280-4f97-428c-a423-7bbbd94d233f service nova] Acquiring lock "498d231e-d0be-4ea5-9024-669a978b8292-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a64eaeb9-4b9a-4de7-ae0d-8b706b53aeca req-a359a280-4f97-428c-a423-7bbbd94d233f service nova] Lock "498d231e-d0be-4ea5-9024-669a978b8292-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a64eaeb9-4b9a-4de7-ae0d-8b706b53aeca req-a359a280-4f97-428c-a423-7bbbd94d233f service nova] Lock "498d231e-d0be-4ea5-9024-669a978b8292-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-a64eaeb9-4b9a-4de7-ae0d-8b706b53aeca req-a359a280-4f97-428c-a423-7bbbd94d233f service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] No waiting events found dispatching network-vif-plugged-015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:49:27 user nova-compute[75672]: WARNING nova.compute.manager [req-a64eaeb9-4b9a-4de7-ae0d-8b706b53aeca req-a359a280-4f97-428c-a423-7bbbd94d233f service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Received unexpected event network-vif-plugged-015af49e-5605-48da-a8bc-472fe731e91a for instance with vm_state building and task_state spawning.
Nov 30 12:49:27 user nova-compute[75672]: INFO nova.compute.manager [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 30 12:49:27 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:49:27 user nova-compute[75672]: INFO nova.compute.manager [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Took 15.52 seconds to build instance.
Nov 30 12:49:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a83ea2d5-c82c-420d-8b2e-5d1700445d8c tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "498d231e-d0be-4ea5-9024-669a978b8292" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.618s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:28 user nova-compute[75672]: DEBUG nova.compute.manager [req-b3820654-bc20-4224-9ce0-71748f90fcb2 req-4f7a409e-edce-47e6-98c9-3a658a89eb9c service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:49:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b3820654-bc20-4224-9ce0-71748f90fcb2 req-4f7a409e-edce-47e6-98c9-3a658a89eb9c service nova] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b3820654-bc20-4224-9ce0-71748f90fcb2 req-4f7a409e-edce-47e6-98c9-3a658a89eb9c service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b3820654-bc20-4224-9ce0-71748f90fcb2 req-4f7a409e-edce-47e6-98c9-3a658a89eb9c service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:28 user nova-compute[75672]: DEBUG nova.compute.manager [req-b3820654-bc20-4224-9ce0-71748f90fcb2 req-4f7a409e-edce-47e6-98c9-3a658a89eb9c service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] No waiting events found dispatching network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:49:28 user nova-compute[75672]: WARNING nova.compute.manager [req-b3820654-bc20-4224-9ce0-71748f90fcb2 req-4f7a409e-edce-47e6-98c9-3a658a89eb9c service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received unexpected event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 for instance with vm_state active and task_state rescuing.
Nov 30 12:49:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:30 user nova-compute[75672]: DEBUG nova.compute.manager [req-30cf9dbb-5755-4394-8e7e-b5a77764b5a7 req-4cea4009-254b-4efa-b56d-b1d1e72b78aa service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:49:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-30cf9dbb-5755-4394-8e7e-b5a77764b5a7 req-4cea4009-254b-4efa-b56d-b1d1e72b78aa service nova] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-30cf9dbb-5755-4394-8e7e-b5a77764b5a7 req-4cea4009-254b-4efa-b56d-b1d1e72b78aa service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-30cf9dbb-5755-4394-8e7e-b5a77764b5a7 req-4cea4009-254b-4efa-b56d-b1d1e72b78aa service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:30 user nova-compute[75672]: DEBUG nova.compute.manager [req-30cf9dbb-5755-4394-8e7e-b5a77764b5a7 req-4cea4009-254b-4efa-b56d-b1d1e72b78aa service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] No waiting events found dispatching network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:49:30 user nova-compute[75672]: WARNING nova.compute.manager [req-30cf9dbb-5755-4394-8e7e-b5a77764b5a7 req-4cea4009-254b-4efa-b56d-b1d1e72b78aa service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received unexpected event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 for instance with vm_state active and task_state rescuing.
Nov 30 12:49:30 user nova-compute[75672]: DEBUG nova.compute.manager [None req-5969a4a7-f3ab-4369-ad47-7c699c86781d tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:49:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:39 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:49:40 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:49:40 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:49:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:49:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:49:40 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:49:41 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Updating instance_info_cache with network_info: [{"id": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "address": "fa:16:3e:ce:b3:ac", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b67acff-06", "ovs_interfaceid": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:49:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:49:41 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-db464872-6754-4393-85f5-f2f7d4303186 req-ea6f6fc2-ee0f-49f0-86ff-90d954a41608 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Received event network-changed-2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-db464872-6754-4393-85f5-f2f7d4303186 req-ea6f6fc2-ee0f-49f0-86ff-90d954a41608 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Refreshing instance network info cache due to event network-changed-2bec6ecb-cf05-4ca4-bfe8-352f139903de. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-db464872-6754-4393-85f5-f2f7d4303186 req-ea6f6fc2-ee0f-49f0-86ff-90d954a41608 service nova] Acquiring lock "refresh_cache-a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-db464872-6754-4393-85f5-f2f7d4303186 req-ea6f6fc2-ee0f-49f0-86ff-90d954a41608 service nova] Acquired lock "refresh_cache-a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG nova.network.neutron [req-db464872-6754-4393-85f5-f2f7d4303186 req-ea6f6fc2-ee0f-49f0-86ff-90d954a41608 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Refreshing network info cache for port 2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG nova.network.neutron [req-db464872-6754-4393-85f5-f2f7d4303186 req-ea6f6fc2-ee0f-49f0-86ff-90d954a41608 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Updated VIF entry in instance network info cache for port 2bec6ecb-cf05-4ca4-bfe8-352f139903de. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG nova.network.neutron [req-db464872-6754-4393-85f5-f2f7d4303186 req-ea6f6fc2-ee0f-49f0-86ff-90d954a41608 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Updating instance_info_cache with network_info: [{"id": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "address": "fa:16:3e:a2:c8:b8", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec6ecb-cf", "ovs_interfaceid": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-db464872-6754-4393-85f5-f2f7d4303186 req-ea6f6fc2-ee0f-49f0-86ff-90d954a41608 service nova] Releasing lock "refresh_cache-a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG nova.objects.instance [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lazy-loading 'flavor' on Instance uuid a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:42 user nova-compute[75672]: INFO nova.compute.manager [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Attaching volume c470247f-680c-4821-ad85-9f75e279677b to /dev/vdb
Nov 30 12:49:42 user nova-compute[75672]: DEBUG os_brick.utils [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb8e96e-22fb-493c-8847-78fec8ea3521]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c5cc48-23aa-4c07-832f-d175599104ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3467f598-7bae-400a-b66c-1c725727ad57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9ef381-fa10-4787-8642-a45f9f030b8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:49:42 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:49:42 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aae4723-c224-4889-8b1a-2aa8285b59e6]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:49:42 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:49:43 user nova-compute[75672]: DEBUG os_brick.utils [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:49:43 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Updating existing volume attachment record: 96e8747f-d936-42c3-80b9-b7627411e470 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:49:43 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:49:43 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:49:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:49:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:49:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:49:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:49:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:49:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:49:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:49:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7678MB free_disk=24.96544647216797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:49:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 87744aef-7e32-475b-907e-e30702d083bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f5851479-d09b-4d84-9553-2b09646f2b4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance c00b64bd-8011-4609-8953-315f1e655930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f0dc7673-5c82-47db-a820-0e8438db7092 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 498d231e-d0be-4ea5-9024-669a978b8292 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:49:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:49 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:49:49 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:49:49 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:49:50 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:49:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:49:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqePVhUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:49:52 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:49:52 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:49:52 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[361f186e-a073-4f37-a461-802eccb576f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:49:52 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[587684b8-8b9b-4e3e-b987-88c4e424aaca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b] added
Nov 30 12:49:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[22161f0d-5433-45f8-bb88-0596d1e9a27f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b7875f-ab11-4839-b5d6-38bbe1718481]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WqePVhUY {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WqePVhUY" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb64d90-d089-43db-be72-e8f72c29a5d6]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WqePVhUY'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[76366279-b1ae-408c-87f4-238340632a8e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5045103a-cb36-4c38-a617-eb441db9dfed]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:49:52 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:49:52 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:49:52 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:49:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:49:52 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:49:52 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:49:52 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:49:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e48908e-3aaf-4916-bf02-d3988b531097]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b, portal: 172.16.0.220,3260]
Nov 30 12:49:52 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b, portal: 172.16.0.220,3260] successful.
Nov 30 12:49:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bd7643-49f4-4fa5-ab83-0efd9128bd9b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00485f9-75e6-4ab1-b5e8-6fd0474d96d5]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:49:52 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:49:52 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:49:52 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:49:52 user nova-compute[75672]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b (non-flash)
Nov 30 12:49:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:49:52 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:49:52 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:49:52 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:49:52 user nova-compute[75672]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b (non-flash)
Nov 30 12:49:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] HCTL ('37', '-', '-', 0) found on session 45 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a88503-2a8c-4fe1-a387-f0e6625b67cf]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:49:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqePVhUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:49:53 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:49:53 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:49:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:49:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23465363765636266', 'path': '/dev/sdf'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:49:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465363765636266', 'path': '/dev/sdf'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:49:53 user nova-compute[75672]: DEBUG nova.objects.instance [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lazy-loading 'flavor' on Instance uuid a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:49:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:49:53 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:49:53 user nova-compute[75672]:   <source dev="/dev/sdf"/>
Nov 30 12:49:53 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:49:53 user nova-compute[75672]:   <serial>c470247f-680c-4821-ad85-9f75e279677b</serial>
Nov 30 12:49:53 user nova-compute[75672]: </disk>
Nov 30 12:49:53 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:49:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:49:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:49:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] No VIF found with MAC fa:16:3e:a2:c8:b8, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:49:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ea86bda1-152c-4e2f-9262-edce04705131 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.635s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:49:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:49:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:49:56 user nova-compute[75672]: INFO nova.compute.manager [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Detaching volume c470247f-680c-4821-ad85-9f75e279677b
Nov 30 12:49:56 user nova-compute[75672]: INFO nova.virt.block_device [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Attempting to driver detach volume c470247f-680c-4821-ad85-9f75e279677b from mountpoint /dev/vdb
Nov 30 12:49:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Attempting to detach device vdb from instance a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:49:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:49:56 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:49:56 user nova-compute[75672]:   <source dev="/dev/sdf"/>
Nov 30 12:49:56 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:49:56 user nova-compute[75672]:   <serial>c470247f-680c-4821-ad85-9f75e279677b</serial>
Nov 30 12:49:56 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:49:56 user nova-compute[75672]: </disk>
Nov 30 12:49:56 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:49:56 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Successfully detached device vdb from instance a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df from the persistent domain config.
Nov 30 12:49:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:49:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:49:56 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:49:56 user nova-compute[75672]:   <source dev="/dev/sdf"/>
Nov 30 12:49:56 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:49:56 user nova-compute[75672]:   <serial>c470247f-680c-4821-ad85-9f75e279677b</serial>
Nov 30 12:49:56 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:49:56 user nova-compute[75672]: </disk>
Nov 30 12:49:56 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:49:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:49:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:49:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:50:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "f5851479-d09b-4d84-9553-2b09646f2b4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:10 user nova-compute[75672]: INFO nova.compute.manager [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Terminating instance
Nov 30 12:50:10 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:50:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-9ef84494-9c75-4b7c-8e90-56248f4a8f48 req-fa8f76a0-b257-4477-800f-63b1876adb77 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received event network-vif-unplugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9ef84494-9c75-4b7c-8e90-56248f4a8f48 req-fa8f76a0-b257-4477-800f-63b1876adb77 service nova] Acquiring lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9ef84494-9c75-4b7c-8e90-56248f4a8f48 req-fa8f76a0-b257-4477-800f-63b1876adb77 service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9ef84494-9c75-4b7c-8e90-56248f4a8f48 req-fa8f76a0-b257-4477-800f-63b1876adb77 service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-9ef84494-9c75-4b7c-8e90-56248f4a8f48 req-fa8f76a0-b257-4477-800f-63b1876adb77 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] No waiting events found dispatching network-vif-unplugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-9ef84494-9c75-4b7c-8e90-56248f4a8f48 req-fa8f76a0-b257-4477-800f-63b1876adb77 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received event network-vif-unplugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:50:11 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Instance destroyed successfully.
Nov 30 12:50:11 user nova-compute[75672]: DEBUG nova.objects.instance [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lazy-loading 'resources' on Instance uuid f5851479-d09b-4d84-9553-2b09646f2b4f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:43:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-580359070',display_name='tempest-ServerActionsTestOtherA-server-580359070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-580359070',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAGYYp9gmKcKQU/0AhKXIKN1vmmULr4112gYCMQNfGJmVLFUNJpr/fRLeXt2uFTxy9c+sqp7OE8Rgl3bMk88M8K66f/jnDNBbOBQMv+K2V48Kq8w3CudXAVm+CT4wTJ5Q==',key_name='tempest-keypair-1875335252',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:45:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-ekoofs5a',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=f5851479-d09b-4d84-9553-2b09646f2b4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "address": "fa:16:3e:c1:fb:6a", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c0b4e1-04", "ovs_interfaceid": "84c0b4e1-0414-45cb-a9db-88d4aa5bbf03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:fb:6a,bridge_name='br-int',has_traffic_filtering=True,id=84c0b4e1-0414-45cb-a9db-88d4aa5bbf03,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c0b4e1-04') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_vif [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:fb:6a,bridge_name='br-int',has_traffic_filtering=True,id=84c0b4e1-0414-45cb-a9db-88d4aa5bbf03,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c0b4e1-04') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84c0b4e1-04, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=582da6ec-ccee-4d45-9d43-d1922eef82fd) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:50:11 user nova-compute[75672]: INFO os_vif [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:fb:6a,bridge_name='br-int',has_traffic_filtering=True,id=84c0b4e1-0414-45cb-a9db-88d4aa5bbf03,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c0b4e1-04')
Nov 30 12:50:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNqFmylf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:50:11 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[427bc9e9-79c0-4313-a54f-522c5902fc7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:50:11 user nova-compute[75672]: No targets found.
Nov 30 12:50:11 user nova-compute[75672]: iSNS:
Nov 30 12:50:11 user nova-compute[75672]: No targets found.
Nov 30 12:50:11 user nova-compute[75672]: STATIC:
Nov 30 12:50:11 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016
Nov 30 12:50:11 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:50:11 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:50:11 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188
Nov 30 12:50:11 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:50:11 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:50:11 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:50:11 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:50:11 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:50:11 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf
Nov 30 12:50:11 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:50:11 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:50:11 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b
Nov 30 12:50:11 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:50:11 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:50:11 user nova-compute[75672]: FIRMWARE:
Nov 30 12:50:11 user nova-compute[75672]: No targets found.
Nov 30 12:50:11 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:50:11 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:50:11 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0759d3-856d-4d1f-8420-b0aaacbb1229]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5f5575-071f-4966-8f2f-7b933e493c27]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:50:11 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:50:11 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:50:11 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:50:11 user nova-compute[75672]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b (non-flash)
Nov 30 12:50:11 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:50:11 user nova-compute[75672]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 (non-flash)
Nov 30 12:50:11 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:50:11 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:50:11 user nova-compute[75672]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b (non-flash)
Nov 30 12:50:11 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd450e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016'): ({'sde'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Removing single pathed devices sde {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[322f8d62-09a8-45db-8f2d-a594b06d2fb5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f467ee1-73ca-465f-9170-0b895c9fc005]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Flushing IO for device /dev/sde {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[968c392a-89e2-4811-9b53-5984cfab9416]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6c9ad5-fe39-4607-b033-9ba694568250]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] SCSI volumes sde have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23436393036366633', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d5763dd0', '/dev/disk/by-id/scsi-1SCST_BIOd5763dd0-469066f35e152683') {{(pid=86963) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fff1e7-67ae-4d74-821b-7a5fe3775139]: (4, None) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0741e7fd-871c-4787-a121-84f00d9204d5]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd3b6c5-18c3-43f7-ac82-ea853d18b19a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260]
Nov 30 12:50:11 user nova-compute[75672]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016, portal: 172.16.0.220,3260] successful.
Nov 30 12:50:11 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a735a8-128e-4328-826b-f8450f2b4016 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f097d6c4-6bda-4179-89f0-c93de7259327]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] <== disconnect_volume: return (326ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:50:11 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Deleting instance files /opt/stack/data/nova/instances/f5851479-d09b-4d84-9553-2b09646f2b4f_del
Nov 30 12:50:11 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Deletion of /opt/stack/data/nova/instances/f5851479-d09b-4d84-9553-2b09646f2b4f_del complete
Nov 30 12:50:11 user nova-compute[75672]: INFO nova.compute.manager [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 30 12:50:11 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:50:11 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:50:13 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:50:13 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Took 1.16 seconds to deallocate network for instance.
Nov 30 12:50:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-5c3b35a7-3954-4142-8457-dc5415fa3f4e req-61b7e4a7-7621-406a-943f-ef7f15a1e1d0 service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received event network-vif-deleted-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:50:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-53231bb5-2c16-44c0-905f-ee0506e484f4 req-ff52f3c5-2fad-49db-8737-c9fbe0d2b4fd service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received event network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:50:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-53231bb5-2c16-44c0-905f-ee0506e484f4 req-ff52f3c5-2fad-49db-8737-c9fbe0d2b4fd service nova] Acquiring lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-53231bb5-2c16-44c0-905f-ee0506e484f4 req-ff52f3c5-2fad-49db-8737-c9fbe0d2b4fd service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-53231bb5-2c16-44c0-905f-ee0506e484f4 req-ff52f3c5-2fad-49db-8737-c9fbe0d2b4fd service nova] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-53231bb5-2c16-44c0-905f-ee0506e484f4 req-ff52f3c5-2fad-49db-8737-c9fbe0d2b4fd service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] No waiting events found dispatching network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:50:13 user nova-compute[75672]: WARNING nova.compute.manager [req-53231bb5-2c16-44c0-905f-ee0506e484f4 req-ff52f3c5-2fad-49db-8737-c9fbe0d2b4fd service nova] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Received unexpected event network-vif-plugged-84c0b4e1-0414-45cb-a9db-88d4aa5bbf03 for instance with vm_state active and task_state deleting.
Nov 30 12:50:13 user nova-compute[75672]: INFO nova.compute.manager [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Took 0.84 seconds to detach 1 volumes for instance.
Nov 30 12:50:13 user nova-compute[75672]: DEBUG nova.compute.manager [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: f5851479-d09b-4d84-9553-2b09646f2b4f] Deleting volume: 83a735a8-128e-4328-826b-f8450f2b4016 {{(pid=75672) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 12:50:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:14 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:50:14 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:50:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:14 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Deleted allocations for instance f5851479-d09b-4d84-9553-2b09646f2b4f
Nov 30 12:50:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-1f4b4158-b2a2-461c-8914-feb9232b78e7 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "f5851479-d09b-4d84-9553-2b09646f2b4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.836s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:16 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df is timed out.
Nov 30 12:50:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Successfully detached device vdb from instance a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df from the live domain config.
Nov 30 12:50:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqePVhUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:50:16 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:50:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cbb6c3-bfdd-4a85-9dd9-a3cf7838700c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:50:16 user nova-compute[75672]: No targets found.
Nov 30 12:50:16 user nova-compute[75672]: iSNS:
Nov 30 12:50:16 user nova-compute[75672]: No targets found.
Nov 30 12:50:16 user nova-compute[75672]: STATIC:
Nov 30 12:50:16 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188
Nov 30 12:50:16 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:50:16 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:50:16 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:50:16 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:50:16 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:50:16 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf
Nov 30 12:50:16 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:50:16 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:50:16 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b
Nov 30 12:50:16 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:50:16 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:50:16 user nova-compute[75672]: FIRMWARE:
Nov 30 12:50:16 user nova-compute[75672]: No targets found.
Nov 30 12:50:16 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:50:16 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:50:16 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f131c6-fd65-4915-8666-a189fc0f9afa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9cba95-59aa-498d-816c-14f20ddaaffb]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:50:16 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:50:16 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:50:16 user nova-compute[75672]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b (non-flash)
Nov 30 12:50:16 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:50:16 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:50:16 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:50:16 user nova-compute[75672]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b (non-flash)
Nov 30 12:50:16 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcf7e48550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b'): ({'sdf'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Removing single pathed devices sdf {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd36179-2527-4bd3-a624-0ef9e8ace012]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[829b5be3-5830-4182-8d60-a17c152d8149]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Flushing IO for device /dev/sdf {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:50:16 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e64a6d5-05df-4267-a763-3164a2e60973]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4506d7-3e81-4ed4-9beb-b54c8c0fefac]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] SCSI volumes sdf have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5916f0-c7ae-44eb-ba6b-ab4a468d1bce]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9465f3-454d-4d8c-be10-986fa1fd71bb]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b, portal: 172.16.0.220,3260]
Nov 30 12:50:17 user nova-compute[75672]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b, portal: 172.16.0.220,3260] successful.
Nov 30 12:50:17 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c470247f-680c-4821-ad85-9f75e279677b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[777ea571-0708-443f-8e2d-0596514dbc51]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] <== disconnect_volume: return (308ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG nova.objects.instance [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lazy-loading 'flavor' on Instance uuid a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:50:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-341b451b-8c63-41e3-875b-6268a48a273c tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.683s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:50:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:50:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:50:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:40 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:50:41 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:50:41 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:50:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:50:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:50:41 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:50:42 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Updating instance_info_cache with network_info: [{"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:50:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:50:42 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:50:43 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:50:43 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:50:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:50:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:50:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:50:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:50:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:50:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:50:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7979MB free_disk=24.95284652709961GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 87744aef-7e32-475b-907e-e30702d083bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance c00b64bd-8011-4609-8953-315f1e655930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f0dc7673-5c82-47db-a820-0e8438db7092 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 498d231e-d0be-4ea5-9024-669a978b8292 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:50:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:50:47 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:50:47 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:50:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:50:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:48 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:50:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:48 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:50:48 user nova-compute[75672]: INFO nova.compute.claims [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Claim successful on node user
Nov 30 12:50:48 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:50:49 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:50:49 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG nova.policy [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa5b3c989c934220a07aba162e68ea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47874c48ecea456eac7968640910afba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:50:49 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Creating image(s)
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "/opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "/opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "/opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.213s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk 1073741824" returned: 0 in 0.066s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Successfully created port: cbc241fa-0a2b-440a-a5f4-12868d7468da {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.182s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:50:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Cannot resize image /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Ensure instance console log exists: /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Successfully updated port: cbc241fa-0a2b-440a-a5f4-12868d7468da {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "refresh_cache-a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquired lock "refresh_cache-a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.compute.manager [req-bde10084-8772-47ec-a49f-a934bf3d74ad req-fc5539df-11b0-4e49-a9d5-4dd3b4b9eaca service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Received event network-changed-cbc241fa-0a2b-440a-a5f4-12868d7468da {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.compute.manager [req-bde10084-8772-47ec-a49f-a934bf3d74ad req-fc5539df-11b0-4e49-a9d5-4dd3b4b9eaca service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Refreshing instance network info cache due to event network-changed-cbc241fa-0a2b-440a-a5f4-12868d7468da. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bde10084-8772-47ec-a49f-a934bf3d74ad req-fc5539df-11b0-4e49-a9d5-4dd3b4b9eaca service nova] Acquiring lock "refresh_cache-a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.network.neutron [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Updating instance_info_cache with network_info: [{"id": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "address": "fa:16:3e:70:81:44", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc241fa-0a", "ovs_interfaceid": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Releasing lock "refresh_cache-a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Instance network_info: |[{"id": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "address": "fa:16:3e:70:81:44", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc241fa-0a", "ovs_interfaceid": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bde10084-8772-47ec-a49f-a934bf3d74ad req-fc5539df-11b0-4e49-a9d5-4dd3b4b9eaca service nova] Acquired lock "refresh_cache-a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.network.neutron [req-bde10084-8772-47ec-a49f-a934bf3d74ad req-fc5539df-11b0-4e49-a9d5-4dd3b4b9eaca service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Refreshing network info cache for port cbc241fa-0a2b-440a-a5f4-12868d7468da {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Start _get_guest_xml network_info=[{"id": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "address": "fa:16:3e:70:81:44", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc241fa-0a", "ovs_interfaceid": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:50:50 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:50:50 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:50:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1861567866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1861567866',id=41,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47874c48ecea456eac7968640910afba',ramdisk_id='',reservation_id='r-jxb05245',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-547265583',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:50:49Z,user_data=None,user_id='aa5b3c989c934220a07aba162e68ea87',uuid=a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "address": "fa:16:3e:70:81:44", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc241fa-0a", "ovs_interfaceid": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converting VIF {"id": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "address": "fa:16:3e:70:81:44", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc241fa-0a", "ovs_interfaceid": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:81:44,bridge_name='br-int',has_traffic_filtering=True,id=cbc241fa-0a2b-440a-a5f4-12868d7468da,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc241fa-0a') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:50:50 user nova-compute[75672]: DEBUG nova.objects.instance [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'pci_devices' on Instance uuid a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:50:51 user nova-compute[75672]:   <uuid>a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c</uuid>
Nov 30 12:50:51 user nova-compute[75672]:   <name>instance-00000029</name>
Nov 30 12:50:51 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:50:51 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:50:51 user nova-compute[75672]:   <metadata>
Nov 30 12:50:51 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:50:51 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:50:51 user nova-compute[75672]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1861567866</nova:name>
Nov 30 12:50:51 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:50:50</nova:creationTime>
Nov 30 12:50:51 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:50:51 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:50:51 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:50:51 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:50:51 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:50:51 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:50:51 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:50:51 user nova-compute[75672]:       <nova:owner>
Nov 30 12:50:51 user nova-compute[75672]:         <nova:user uuid="aa5b3c989c934220a07aba162e68ea87">tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member</nova:user>
Nov 30 12:50:51 user nova-compute[75672]:         <nova:project uuid="47874c48ecea456eac7968640910afba">tempest-ServerBootFromVolumeStableRescueTest-547265583</nova:project>
Nov 30 12:50:51 user nova-compute[75672]:       </nova:owner>
Nov 30 12:50:51 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:50:51 user nova-compute[75672]:       <nova:ports>
Nov 30 12:50:51 user nova-compute[75672]:         <nova:port uuid="cbc241fa-0a2b-440a-a5f4-12868d7468da">
Nov 30 12:50:51 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 12:50:51 user nova-compute[75672]:         </nova:port>
Nov 30 12:50:51 user nova-compute[75672]:       </nova:ports>
Nov 30 12:50:51 user nova-compute[75672]:     </nova:instance>
Nov 30 12:50:51 user nova-compute[75672]:   </metadata>
Nov 30 12:50:51 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:50:51 user nova-compute[75672]:     <system>
Nov 30 12:50:51 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:50:51 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:50:51 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:50:51 user nova-compute[75672]:       <entry name="serial">a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c</entry>
Nov 30 12:50:51 user nova-compute[75672]:       <entry name="uuid">a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c</entry>
Nov 30 12:50:51 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:50:51 user nova-compute[75672]:     </system>
Nov 30 12:50:51 user nova-compute[75672]:   </sysinfo>
Nov 30 12:50:51 user nova-compute[75672]:   <os>
Nov 30 12:50:51 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:50:51 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:50:51 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:50:51 user nova-compute[75672]:   </os>
Nov 30 12:50:51 user nova-compute[75672]:   <features>
Nov 30 12:50:51 user nova-compute[75672]:     <acpi/>
Nov 30 12:50:51 user nova-compute[75672]:     <apic/>
Nov 30 12:50:51 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:50:51 user nova-compute[75672]:   </features>
Nov 30 12:50:51 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:50:51 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:50:51 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:50:51 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:50:51 user nova-compute[75672]:   </clock>
Nov 30 12:50:51 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:50:51 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:50:51 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:50:51 user nova-compute[75672]:   </cpu>
Nov 30 12:50:51 user nova-compute[75672]:   <devices>
Nov 30 12:50:51 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:50:51 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:50:51 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk"/>
Nov 30 12:50:51 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:50:51 user nova-compute[75672]:     </disk>
Nov 30 12:50:51 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:50:51 user nova-compute[75672]:       <mac address="fa:16:3e:70:81:44"/>
Nov 30 12:50:51 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:50:51 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:50:51 user nova-compute[75672]:       <target dev="tapcbc241fa-0a"/>
Nov 30 12:50:51 user nova-compute[75672]:     </interface>
Nov 30 12:50:51 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:50:51 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/console.log" append="off"/>
Nov 30 12:50:51 user nova-compute[75672]:     </serial>
Nov 30 12:50:51 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:50:51 user nova-compute[75672]:     <video>
Nov 30 12:50:51 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:50:51 user nova-compute[75672]:     </video>
Nov 30 12:50:51 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:50:51 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:50:51 user nova-compute[75672]:     </rng>
Nov 30 12:50:51 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:50:51 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:50:51 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:50:51 user nova-compute[75672]:     </memballoon>
Nov 30 12:50:51 user nova-compute[75672]:   </devices>
Nov 30 12:50:51 user nova-compute[75672]: </domain>
Nov 30 12:50:51 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:50:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1861567866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1861567866',id=41,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47874c48ecea456eac7968640910afba',ramdisk_id='',reservation_id='r-jxb05245',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-547265583',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:50:49Z,user_data=None,user_id='aa5b3c989c934220a07aba162e68ea87',uuid=a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "address": "fa:16:3e:70:81:44", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc241fa-0a", "ovs_interfaceid": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converting VIF {"id": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "address": "fa:16:3e:70:81:44", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc241fa-0a", "ovs_interfaceid": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:81:44,bridge_name='br-int',has_traffic_filtering=True,id=cbc241fa-0a2b-440a-a5f4-12868d7468da,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc241fa-0a') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG os_vif [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:81:44,bridge_name='br-int',has_traffic_filtering=True,id=cbc241fa-0a2b-440a-a5f4-12868d7468da,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc241fa-0a') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16a6b408-79d6-595e-a89a-0c022e68ff85', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbc241fa-0a, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbc241fa-0a, col_values=(('qos', UUID('6426d85f-7553-49a8-b55c-0ce9837ad946')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbc241fa-0a, col_values=(('external_ids', {'iface-id': 'cbc241fa-0a2b-440a-a5f4-12868d7468da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:81:44', 'vm-uuid': 'a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:51 user nova-compute[75672]: INFO os_vif [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:81:44,bridge_name='br-int',has_traffic_filtering=True,id=cbc241fa-0a2b-440a-a5f4-12868d7468da,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc241fa-0a')
Nov 30 12:50:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] No VIF found with MAC fa:16:3e:70:81:44, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG nova.network.neutron [req-bde10084-8772-47ec-a49f-a934bf3d74ad req-fc5539df-11b0-4e49-a9d5-4dd3b4b9eaca service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Updated VIF entry in instance network info cache for port cbc241fa-0a2b-440a-a5f4-12868d7468da. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG nova.network.neutron [req-bde10084-8772-47ec-a49f-a934bf3d74ad req-fc5539df-11b0-4e49-a9d5-4dd3b4b9eaca service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Updating instance_info_cache with network_info: [{"id": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "address": "fa:16:3e:70:81:44", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc241fa-0a", "ovs_interfaceid": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bde10084-8772-47ec-a49f-a934bf3d74ad req-fc5539df-11b0-4e49-a9d5-4dd3b4b9eaca service nova] Releasing lock "refresh_cache-a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:50:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:50:51 user nova-compute[75672]: INFO nova.compute.manager [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] instance snapshotting
Nov 30 12:50:52 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Beginning live snapshot process
Nov 30 12:50:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json -f qcow2 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json -f qcow2 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG nova.compute.manager [req-cd05cbd8-3319-4bf7-a91a-10f595f26879 req-2e13985c-70f1-4961-92f7-6bab862c8c64 service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Received event network-vif-plugged-cbc241fa-0a2b-440a-a5f4-12868d7468da {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cd05cbd8-3319-4bf7-a91a-10f595f26879 req-2e13985c-70f1-4961-92f7-6bab862c8c64 service nova] Acquiring lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cd05cbd8-3319-4bf7-a91a-10f595f26879 req-2e13985c-70f1-4961-92f7-6bab862c8c64 service nova] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cd05cbd8-3319-4bf7-a91a-10f595f26879 req-2e13985c-70f1-4961-92f7-6bab862c8c64 service nova] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG nova.compute.manager [req-cd05cbd8-3319-4bf7-a91a-10f595f26879 req-2e13985c-70f1-4961-92f7-6bab862c8c64 service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] No waiting events found dispatching network-vif-plugged-cbc241fa-0a2b-440a-a5f4-12868d7468da {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:50:52 user nova-compute[75672]: WARNING nova.compute.manager [req-cd05cbd8-3319-4bf7-a91a-10f595f26879 req-2e13985c-70f1-4961-92f7-6bab862c8c64 service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Received unexpected event network-vif-plugged-cbc241fa-0a2b-440a-a5f4-12868d7468da for instance with vm_state building and task_state spawning.
Nov 30 12:50:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.197s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_54voh8m/a875304d9364403f9a29b9bd40e7134d.delta 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_54voh8m/a875304d9364403f9a29b9bd40e7134d.delta 1073741824" returned: 0 in 0.199s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:53 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 12:50:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:50:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:50:54 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 12:50:54 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:50:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_54voh8m/a875304d9364403f9a29b9bd40e7134d.delta /opt/stack/data/nova/instances/snapshots/tmp_54voh8m/a875304d9364403f9a29b9bd40e7134d {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:50:54 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:50:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-149f08d4-b558-4419-8582-ee715da00d63 req-555aec07-1e4f-4bab-9823-c191080dbc5b service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Received event network-vif-plugged-cbc241fa-0a2b-440a-a5f4-12868d7468da {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:50:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-149f08d4-b558-4419-8582-ee715da00d63 req-555aec07-1e4f-4bab-9823-c191080dbc5b service nova] Acquiring lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-149f08d4-b558-4419-8582-ee715da00d63 req-555aec07-1e4f-4bab-9823-c191080dbc5b service nova] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-149f08d4-b558-4419-8582-ee715da00d63 req-555aec07-1e4f-4bab-9823-c191080dbc5b service nova] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-149f08d4-b558-4419-8582-ee715da00d63 req-555aec07-1e4f-4bab-9823-c191080dbc5b service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] No waiting events found dispatching network-vif-plugged-cbc241fa-0a2b-440a-a5f4-12868d7468da {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:50:54 user nova-compute[75672]: WARNING nova.compute.manager [req-149f08d4-b558-4419-8582-ee715da00d63 req-555aec07-1e4f-4bab-9823-c191080dbc5b service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Received unexpected event network-vif-plugged-cbc241fa-0a2b-440a-a5f4-12868d7468da for instance with vm_state building and task_state spawning.
Nov 30 12:50:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_54voh8m/a875304d9364403f9a29b9bd40e7134d.delta /opt/stack/data/nova/instances/snapshots/tmp_54voh8m/a875304d9364403f9a29b9bd40e7134d" returned: 0 in 0.650s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:50:55 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Snapshot extracted, beginning image upload
Nov 30 12:50:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:50:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:50:55 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Instance spawned successfully.
Nov 30 12:50:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:50:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:50:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:50:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:50:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:50:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:50:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:50:55 user nova-compute[75672]: INFO nova.compute.manager [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 30 12:50:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:50:55 user nova-compute[75672]: INFO nova.compute.manager [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Took 6.74 seconds to build instance.
Nov 30 12:50:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ec38dee3-6104-4b23-8ee5-aaaaf181355f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.872s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "f0dc7673-5c82-47db-a820-0e8438db7092" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "f0dc7673-5c82-47db-a820-0e8438db7092" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:57 user nova-compute[75672]: INFO nova.compute.manager [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Terminating instance
Nov 30 12:50:57 user nova-compute[75672]: DEBUG nova.compute.manager [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:50:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-5b96ba17-19d9-4cdc-914e-567ad47ef3fe req-0773a32e-b79c-4de3-9200-f259d9f63258 service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Received event network-vif-unplugged-749ca2b5-8eda-45a1-b8ec-ba9817f8265f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:50:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5b96ba17-19d9-4cdc-914e-567ad47ef3fe req-0773a32e-b79c-4de3-9200-f259d9f63258 service nova] Acquiring lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5b96ba17-19d9-4cdc-914e-567ad47ef3fe req-0773a32e-b79c-4de3-9200-f259d9f63258 service nova] Lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5b96ba17-19d9-4cdc-914e-567ad47ef3fe req-0773a32e-b79c-4de3-9200-f259d9f63258 service nova] Lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-5b96ba17-19d9-4cdc-914e-567ad47ef3fe req-0773a32e-b79c-4de3-9200-f259d9f63258 service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] No waiting events found dispatching network-vif-unplugged-749ca2b5-8eda-45a1-b8ec-ba9817f8265f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:50:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-5b96ba17-19d9-4cdc-914e-567ad47ef3fe req-0773a32e-b79c-4de3-9200-f259d9f63258 service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Received event network-vif-unplugged-749ca2b5-8eda-45a1-b8ec-ba9817f8265f for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:50:57 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Snapshot image upload complete
Nov 30 12:50:57 user nova-compute[75672]: INFO nova.compute.manager [None req-7f0d2fb7-1f4c-480b-af62-f571c374bcec tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Took 5.83 seconds to snapshot the instance on the hypervisor.
Nov 30 12:50:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Instance destroyed successfully.
Nov 30 12:50:58 user nova-compute[75672]: DEBUG nova.objects.instance [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lazy-loading 'resources' on Instance uuid f0dc7673-5c82-47db-a820-0e8438db7092 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-312464970',display_name='tempest-ServersNegativeTestJSON-server-312464970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-312464970',id=39,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:49:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5a515a90e05403281db278fd0da0516',ramdisk_id='',reservation_id='r-iuz2r9zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-69784533',owner_user_name='tempest-ServersNegativeTestJSON-69784533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:49:13Z,user_data=None,user_id='aa04e80eda5248478efbdcc04f68d79f',uuid=f0dc7673-5c82-47db-a820-0e8438db7092,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "address": "fa:16:3e:34:1f:e2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749ca2b5-8e", "ovs_interfaceid": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Converting VIF {"id": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "address": "fa:16:3e:34:1f:e2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749ca2b5-8e", "ovs_interfaceid": "749ca2b5-8eda-45a1-b8ec-ba9817f8265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:1f:e2,bridge_name='br-int',has_traffic_filtering=True,id=749ca2b5-8eda-45a1-b8ec-ba9817f8265f,network=Network(01af390a-7f78-4062-bb05-a7cc50446933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749ca2b5-8e') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG os_vif [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:1f:e2,bridge_name='br-int',has_traffic_filtering=True,id=749ca2b5-8eda-45a1-b8ec-ba9817f8265f,network=Network(01af390a-7f78-4062-bb05-a7cc50446933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749ca2b5-8e') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap749ca2b5-8e, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e738c566-cd0c-4e7d-bac9-5b5bbc5b4672) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:50:58 user nova-compute[75672]: INFO os_vif [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:1f:e2,bridge_name='br-int',has_traffic_filtering=True,id=749ca2b5-8eda-45a1-b8ec-ba9817f8265f,network=Network(01af390a-7f78-4062-bb05-a7cc50446933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749ca2b5-8e')
Nov 30 12:50:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Deleting instance files /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092_del
Nov 30 12:50:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Deletion of /opt/stack/data/nova/instances/f0dc7673-5c82-47db-a820-0e8438db7092_del complete
Nov 30 12:50:58 user nova-compute[75672]: INFO nova.compute.manager [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 30 12:50:58 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:50:58 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Took 0.57 seconds to deallocate network for instance.
Nov 30 12:50:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:59 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:50:59 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:50:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:59 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Deleted allocations for instance f0dc7673-5c82-47db-a820-0e8438db7092
Nov 30 12:50:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ffd6e39b-d9b0-4f2d-90d5-92bd26d363d3 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "f0dc7673-5c82-47db-a820-0e8438db7092" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.055s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-c864c334-6f1f-401b-91ae-2f19af2e2d8b req-7a9d1040-8d73-49c6-a729-a7df1f3c256b service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Received event network-vif-plugged-749ca2b5-8eda-45a1-b8ec-ba9817f8265f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:50:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c864c334-6f1f-401b-91ae-2f19af2e2d8b req-7a9d1040-8d73-49c6-a729-a7df1f3c256b service nova] Acquiring lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:50:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c864c334-6f1f-401b-91ae-2f19af2e2d8b req-7a9d1040-8d73-49c6-a729-a7df1f3c256b service nova] Lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:50:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c864c334-6f1f-401b-91ae-2f19af2e2d8b req-7a9d1040-8d73-49c6-a729-a7df1f3c256b service nova] Lock "f0dc7673-5c82-47db-a820-0e8438db7092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:50:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-c864c334-6f1f-401b-91ae-2f19af2e2d8b req-7a9d1040-8d73-49c6-a729-a7df1f3c256b service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] No waiting events found dispatching network-vif-plugged-749ca2b5-8eda-45a1-b8ec-ba9817f8265f {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:50:59 user nova-compute[75672]: WARNING nova.compute.manager [req-c864c334-6f1f-401b-91ae-2f19af2e2d8b req-7a9d1040-8d73-49c6-a729-a7df1f3c256b service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Received unexpected event network-vif-plugged-749ca2b5-8eda-45a1-b8ec-ba9817f8265f for instance with vm_state deleted and task_state None.
Nov 30 12:50:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-c864c334-6f1f-401b-91ae-2f19af2e2d8b req-7a9d1040-8d73-49c6-a729-a7df1f3c256b service nova] [instance: f0dc7673-5c82-47db-a820-0e8438db7092] Received event network-vif-deleted-749ca2b5-8eda-45a1-b8ec-ba9817f8265f {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:00 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:51:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:00 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:51:00 user nova-compute[75672]: INFO nova.compute.claims [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Claim successful on node user
Nov 30 12:51:00 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:51:00 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:51:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:00 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:51:00 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:51:00 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:51:00 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:51:00 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:51:01 user nova-compute[75672]: DEBUG nova.policy [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aec8237a0eb47fc891389705f0cc270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78ee16221704ff48f3ce5ff927aad62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:51:01 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:51:01 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:51:01 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Creating image(s)
Nov 30 12:51:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "/opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "/opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "/opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "1a73065f6704064a36ac0c0fe3513221a2fda668" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "1a73065f6704064a36ac0c0fe3513221a2fda668" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668.part --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:02 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Successfully created port: c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:51:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668.part --force-share --output=json" returned: 0 in 0.246s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:02 user nova-compute[75672]: DEBUG nova.virt.images [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] ed053729-6d3f-4405-966f-b7cde14ec65e was qcow2, converting to raw {{(pid=75672) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 12:51:02 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:51:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668.part /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668.converted {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668.part /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668.converted" returned: 0 in 0.651s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668.converted --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Successfully updated port: c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "refresh_cache-24033f28-8bf7-4d04-ba4d-88537ad30f10" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquired lock "refresh_cache-24033f28-8bf7-4d04-ba4d-88537ad30f10" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG nova.compute.manager [req-5400a5c7-7eb4-46bc-93cf-7c3bc144a650 req-3eb0afd0-513b-4474-994f-cdfe4b85e157 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Received event network-changed-c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG nova.compute.manager [req-5400a5c7-7eb4-46bc-93cf-7c3bc144a650 req-3eb0afd0-513b-4474-994f-cdfe4b85e157 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Refreshing instance network info cache due to event network-changed-c949af34-396a-4e42-917f-e555edc66487. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5400a5c7-7eb4-46bc-93cf-7c3bc144a650 req-3eb0afd0-513b-4474-994f-cdfe4b85e157 service nova] Acquiring lock "refresh_cache-24033f28-8bf7-4d04-ba4d-88537ad30f10" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "1a73065f6704064a36ac0c0fe3513221a2fda668" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.329s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668 --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "1a73065f6704064a36ac0c0fe3513221a2fda668" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "1a73065f6704064a36ac0c0fe3513221a2fda668" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Updating instance_info_cache with network_info: [{"id": "c949af34-396a-4e42-917f-e555edc66487", "address": "fa:16:3e:65:e5:8b", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc949af34-39", "ovs_interfaceid": "c949af34-396a-4e42-917f-e555edc66487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Releasing lock "refresh_cache-24033f28-8bf7-4d04-ba4d-88537ad30f10" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Instance network_info: |[{"id": "c949af34-396a-4e42-917f-e555edc66487", "address": "fa:16:3e:65:e5:8b", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc949af34-39", "ovs_interfaceid": "c949af34-396a-4e42-917f-e555edc66487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5400a5c7-7eb4-46bc-93cf-7c3bc144a650 req-3eb0afd0-513b-4474-994f-cdfe4b85e157 service nova] Acquired lock "refresh_cache-24033f28-8bf7-4d04-ba4d-88537ad30f10" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG nova.network.neutron [req-5400a5c7-7eb4-46bc-93cf-7c3bc144a650 req-3eb0afd0-513b-4474-994f-cdfe4b85e157 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Refreshing network info cache for port c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668 --force-share --output=json" returned: 0 in 0.191s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668,backing_fmt=raw /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668,backing_fmt=raw /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk 1073741824" returned: 0 in 0.058s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "1a73065f6704064a36ac0c0fe3513221a2fda668" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668 --force-share --output=json" returned: 0 in 0.192s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Ensure instance console log exists: /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Start _get_guest_xml network_info=[{"id": "c949af34-396a-4e42-917f-e555edc66487", "address": "fa:16:3e:65:e5:8b", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc949af34-39", "ovs_interfaceid": "c949af34-396a-4e42-917f-e555edc66487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='65898f0c348e9ba961452b16b8fdb16b',container_format='bare',created_at=2023-11-30T12:50:52Z,direct_url=<?>,disk_format='qcow2',id=ed053729-6d3f-4405-966f-b7cde14ec65e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-939867178',owner='f78ee16221704ff48f3ce5ff927aad62',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T12:50:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'ed053729-6d3f-4405-966f-b7cde14ec65e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:51:04 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:51:04 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='65898f0c348e9ba961452b16b8fdb16b',container_format='bare',created_at=2023-11-30T12:50:52Z,direct_url=<?>,disk_format='qcow2',id=ed053729-6d3f-4405-966f-b7cde14ec65e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-939867178',owner='f78ee16221704ff48f3ce5ff927aad62',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T12:50:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1595541361',display_name='tempest-TestStampPattern-server-1595541361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1595541361',id=42,image_ref='ed053729-6d3f-4405-966f-b7cde14ec65e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuijQmPQJraElz60vaRaG/e8nrlOXht9CJYkW2bgFzbRFpEhWL7TMKFRy/q/cr8dhtExqxBW2eC1142b+wZVginkATR2akVdepgzX/hlOLrLqJpXg6xSJ07bI2dQ6OD6A==',key_name='tempest-TestStampPattern-1531471902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ee16221704ff48f3ce5ff927aad62',ramdisk_id='',reservation_id='r-u5647seb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df',image_min_disk='1',image_min_ram='0',image_owner_id='f78ee16221704ff48f3ce5ff927aad62',image_owner_project_name='tempest-TestStampPattern-2034271615',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2034271615-project-member',image_user_id='8aec8237a0eb47fc891389705f0cc270',network_allocated='True',owner_project_name='tempest-TestStampPattern-2034271615',owner_user_name='tempest-TestStampPattern-2034271615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:51:01Z,user_data=None,user_id='8aec8237a0eb47fc891389705f0cc270',uuid=24033f28-8bf7-4d04-ba4d-88537ad30f10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c949af34-396a-4e42-917f-e555edc66487", "address": "fa:16:3e:65:e5:8b", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc949af34-39", "ovs_interfaceid": "c949af34-396a-4e42-917f-e555edc66487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Converting VIF {"id": "c949af34-396a-4e42-917f-e555edc66487", "address": "fa:16:3e:65:e5:8b", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc949af34-39", "ovs_interfaceid": "c949af34-396a-4e42-917f-e555edc66487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:e5:8b,bridge_name='br-int',has_traffic_filtering=True,id=c949af34-396a-4e42-917f-e555edc66487,network=Network(1bf9e732-dd63-4d07-adfa-89a3ffde5dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc949af34-39') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lazy-loading 'pci_devices' on Instance uuid 24033f28-8bf7-4d04-ba4d-88537ad30f10 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:51:04 user nova-compute[75672]:   <uuid>24033f28-8bf7-4d04-ba4d-88537ad30f10</uuid>
Nov 30 12:51:04 user nova-compute[75672]:   <name>instance-0000002a</name>
Nov 30 12:51:04 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:51:04 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:51:04 user nova-compute[75672]:   <metadata>
Nov 30 12:51:04 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:51:04 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:51:04 user nova-compute[75672]:       <nova:name>tempest-TestStampPattern-server-1595541361</nova:name>
Nov 30 12:51:04 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:51:04</nova:creationTime>
Nov 30 12:51:04 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:51:04 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:51:04 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:51:04 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:51:04 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:51:04 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:51:04 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:51:04 user nova-compute[75672]:       <nova:owner>
Nov 30 12:51:04 user nova-compute[75672]:         <nova:user uuid="8aec8237a0eb47fc891389705f0cc270">tempest-TestStampPattern-2034271615-project-member</nova:user>
Nov 30 12:51:04 user nova-compute[75672]:         <nova:project uuid="f78ee16221704ff48f3ce5ff927aad62">tempest-TestStampPattern-2034271615</nova:project>
Nov 30 12:51:04 user nova-compute[75672]:       </nova:owner>
Nov 30 12:51:04 user nova-compute[75672]:       <nova:root type="image" uuid="ed053729-6d3f-4405-966f-b7cde14ec65e"/>
Nov 30 12:51:04 user nova-compute[75672]:       <nova:ports>
Nov 30 12:51:04 user nova-compute[75672]:         <nova:port uuid="c949af34-396a-4e42-917f-e555edc66487">
Nov 30 12:51:04 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 12:51:04 user nova-compute[75672]:         </nova:port>
Nov 30 12:51:04 user nova-compute[75672]:       </nova:ports>
Nov 30 12:51:04 user nova-compute[75672]:     </nova:instance>
Nov 30 12:51:04 user nova-compute[75672]:   </metadata>
Nov 30 12:51:04 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:51:04 user nova-compute[75672]:     <system>
Nov 30 12:51:04 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:51:04 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:51:04 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:51:04 user nova-compute[75672]:       <entry name="serial">24033f28-8bf7-4d04-ba4d-88537ad30f10</entry>
Nov 30 12:51:04 user nova-compute[75672]:       <entry name="uuid">24033f28-8bf7-4d04-ba4d-88537ad30f10</entry>
Nov 30 12:51:04 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:51:04 user nova-compute[75672]:     </system>
Nov 30 12:51:04 user nova-compute[75672]:   </sysinfo>
Nov 30 12:51:04 user nova-compute[75672]:   <os>
Nov 30 12:51:04 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:51:04 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:51:04 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:51:04 user nova-compute[75672]:   </os>
Nov 30 12:51:04 user nova-compute[75672]:   <features>
Nov 30 12:51:04 user nova-compute[75672]:     <acpi/>
Nov 30 12:51:04 user nova-compute[75672]:     <apic/>
Nov 30 12:51:04 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:51:04 user nova-compute[75672]:   </features>
Nov 30 12:51:04 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:51:04 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:51:04 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:51:04 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:51:04 user nova-compute[75672]:   </clock>
Nov 30 12:51:04 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:51:04 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:51:04 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:51:04 user nova-compute[75672]:   </cpu>
Nov 30 12:51:04 user nova-compute[75672]:   <devices>
Nov 30 12:51:04 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:51:04 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:51:04 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk"/>
Nov 30 12:51:04 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:51:04 user nova-compute[75672]:     </disk>
Nov 30 12:51:04 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:51:04 user nova-compute[75672]:       <mac address="fa:16:3e:65:e5:8b"/>
Nov 30 12:51:04 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:51:04 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:51:04 user nova-compute[75672]:       <target dev="tapc949af34-39"/>
Nov 30 12:51:04 user nova-compute[75672]:     </interface>
Nov 30 12:51:04 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:51:04 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/console.log" append="off"/>
Nov 30 12:51:04 user nova-compute[75672]:     </serial>
Nov 30 12:51:04 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:51:04 user nova-compute[75672]:     <video>
Nov 30 12:51:04 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:51:04 user nova-compute[75672]:     </video>
Nov 30 12:51:04 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:51:04 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:51:04 user nova-compute[75672]:     </rng>
Nov 30 12:51:04 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:51:04 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:51:04 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:51:04 user nova-compute[75672]:     </memballoon>
Nov 30 12:51:04 user nova-compute[75672]:   </devices>
Nov 30 12:51:04 user nova-compute[75672]: </domain>
Nov 30 12:51:04 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1595541361',display_name='tempest-TestStampPattern-server-1595541361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1595541361',id=42,image_ref='ed053729-6d3f-4405-966f-b7cde14ec65e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuijQmPQJraElz60vaRaG/e8nrlOXht9CJYkW2bgFzbRFpEhWL7TMKFRy/q/cr8dhtExqxBW2eC1142b+wZVginkATR2akVdepgzX/hlOLrLqJpXg6xSJ07bI2dQ6OD6A==',key_name='tempest-TestStampPattern-1531471902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ee16221704ff48f3ce5ff927aad62',ramdisk_id='',reservation_id='r-u5647seb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df',image_min_disk='1',image_min_ram='0',image_owner_id='f78ee16221704ff48f3ce5ff927aad62',image_owner_project_name='tempest-TestStampPattern-2034271615',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2034271615-project-member',image_user_id='8aec8237a0eb47fc891389705f0cc270',network_allocated='True',owner_project_name='tempest-TestStampPattern-2034271615',owner_user_name='tempest-TestStampPattern-2034271615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:51:01Z,user_data=None,user_id='8aec8237a0eb47fc891389705f0cc270',uuid=24033f28-8bf7-4d04-ba4d-88537ad30f10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c949af34-396a-4e42-917f-e555edc66487", "address": "fa:16:3e:65:e5:8b", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc949af34-39", "ovs_interfaceid": "c949af34-396a-4e42-917f-e555edc66487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Converting VIF {"id": "c949af34-396a-4e42-917f-e555edc66487", "address": "fa:16:3e:65:e5:8b", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc949af34-39", "ovs_interfaceid": "c949af34-396a-4e42-917f-e555edc66487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:e5:8b,bridge_name='br-int',has_traffic_filtering=True,id=c949af34-396a-4e42-917f-e555edc66487,network=Network(1bf9e732-dd63-4d07-adfa-89a3ffde5dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc949af34-39') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG os_vif [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e5:8b,bridge_name='br-int',has_traffic_filtering=True,id=c949af34-396a-4e42-917f-e555edc66487,network=Network(1bf9e732-dd63-4d07-adfa-89a3ffde5dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc949af34-39') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a74a378-3d1f-5c0c-af24-652990581da1', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc949af34-39, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc949af34-39, col_values=(('qos', UUID('51c88573-dbec-4f10-8ef9-77ebff539809')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc949af34-39, col_values=(('external_ids', {'iface-id': 'c949af34-396a-4e42-917f-e555edc66487', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:e5:8b', 'vm-uuid': '24033f28-8bf7-4d04-ba4d-88537ad30f10'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:04 user nova-compute[75672]: INFO os_vif [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e5:8b,bridge_name='br-int',has_traffic_filtering=True,id=c949af34-396a-4e42-917f-e555edc66487,network=Network(1bf9e732-dd63-4d07-adfa-89a3ffde5dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc949af34-39')
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] No VIF found with MAC fa:16:3e:65:e5:8b, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.network.neutron [req-5400a5c7-7eb4-46bc-93cf-7c3bc144a650 req-3eb0afd0-513b-4474-994f-cdfe4b85e157 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Updated VIF entry in instance network info cache for port c949af34-396a-4e42-917f-e555edc66487. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.network.neutron [req-5400a5c7-7eb4-46bc-93cf-7c3bc144a650 req-3eb0afd0-513b-4474-994f-cdfe4b85e157 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Updating instance_info_cache with network_info: [{"id": "c949af34-396a-4e42-917f-e555edc66487", "address": "fa:16:3e:65:e5:8b", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc949af34-39", "ovs_interfaceid": "c949af34-396a-4e42-917f-e555edc66487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-ce692fb9-7e67-4bdc-a132-1171e46e4c12 req-0c777a8f-0fb9-4364-b6be-ad75b26212d8 service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Received event network-changed-015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-ce692fb9-7e67-4bdc-a132-1171e46e4c12 req-0c777a8f-0fb9-4364-b6be-ad75b26212d8 service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Refreshing instance network info cache due to event network-changed-015af49e-5605-48da-a8bc-472fe731e91a. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ce692fb9-7e67-4bdc-a132-1171e46e4c12 req-0c777a8f-0fb9-4364-b6be-ad75b26212d8 service nova] Acquiring lock "refresh_cache-498d231e-d0be-4ea5-9024-669a978b8292" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ce692fb9-7e67-4bdc-a132-1171e46e4c12 req-0c777a8f-0fb9-4364-b6be-ad75b26212d8 service nova] Acquired lock "refresh_cache-498d231e-d0be-4ea5-9024-669a978b8292" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG nova.network.neutron [req-ce692fb9-7e67-4bdc-a132-1171e46e4c12 req-0c777a8f-0fb9-4364-b6be-ad75b26212d8 service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Refreshing network info cache for port 015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:51:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5400a5c7-7eb4-46bc-93cf-7c3bc144a650 req-3eb0afd0-513b-4474-994f-cdfe4b85e157 service nova] Releasing lock "refresh_cache-24033f28-8bf7-4d04-ba4d-88537ad30f10" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:51:05 user nova-compute[75672]: DEBUG nova.network.neutron [req-ce692fb9-7e67-4bdc-a132-1171e46e4c12 req-0c777a8f-0fb9-4364-b6be-ad75b26212d8 service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Updated VIF entry in instance network info cache for port 015af49e-5605-48da-a8bc-472fe731e91a. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:51:05 user nova-compute[75672]: DEBUG nova.network.neutron [req-ce692fb9-7e67-4bdc-a132-1171e46e4c12 req-0c777a8f-0fb9-4364-b6be-ad75b26212d8 service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Updating instance_info_cache with network_info: [{"id": "015af49e-5605-48da-a8bc-472fe731e91a", "address": "fa:16:3e:ae:be:e3", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015af49e-56", "ovs_interfaceid": "015af49e-5605-48da-a8bc-472fe731e91a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:51:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ce692fb9-7e67-4bdc-a132-1171e46e4c12 req-0c777a8f-0fb9-4364-b6be-ad75b26212d8 service nova] Releasing lock "refresh_cache-498d231e-d0be-4ea5-9024-669a978b8292" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:51:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-13551d42-508b-47cf-a564-b2ca8c56d4ac req-e6fb5245-ab7f-45a2-a99a-0d4b75924d51 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Received event network-vif-plugged-c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-13551d42-508b-47cf-a564-b2ca8c56d4ac req-e6fb5245-ab7f-45a2-a99a-0d4b75924d51 service nova] Acquiring lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-13551d42-508b-47cf-a564-b2ca8c56d4ac req-e6fb5245-ab7f-45a2-a99a-0d4b75924d51 service nova] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-13551d42-508b-47cf-a564-b2ca8c56d4ac req-e6fb5245-ab7f-45a2-a99a-0d4b75924d51 service nova] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-13551d42-508b-47cf-a564-b2ca8c56d4ac req-e6fb5245-ab7f-45a2-a99a-0d4b75924d51 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] No waiting events found dispatching network-vif-plugged-c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:51:06 user nova-compute[75672]: WARNING nova.compute.manager [req-13551d42-508b-47cf-a564-b2ca8c56d4ac req-e6fb5245-ab7f-45a2-a99a-0d4b75924d51 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Received unexpected event network-vif-plugged-c949af34-396a-4e42-917f-e555edc66487 for instance with vm_state building and task_state spawning.
Nov 30 12:51:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-13551d42-508b-47cf-a564-b2ca8c56d4ac req-e6fb5245-ab7f-45a2-a99a-0d4b75924d51 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Received event network-vif-plugged-c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-13551d42-508b-47cf-a564-b2ca8c56d4ac req-e6fb5245-ab7f-45a2-a99a-0d4b75924d51 service nova] Acquiring lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-13551d42-508b-47cf-a564-b2ca8c56d4ac req-e6fb5245-ab7f-45a2-a99a-0d4b75924d51 service nova] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-13551d42-508b-47cf-a564-b2ca8c56d4ac req-e6fb5245-ab7f-45a2-a99a-0d4b75924d51 service nova] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-13551d42-508b-47cf-a564-b2ca8c56d4ac req-e6fb5245-ab7f-45a2-a99a-0d4b75924d51 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] No waiting events found dispatching network-vif-plugged-c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:51:06 user nova-compute[75672]: WARNING nova.compute.manager [req-13551d42-508b-47cf-a564-b2ca8c56d4ac req-e6fb5245-ab7f-45a2-a99a-0d4b75924d51 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Received unexpected event network-vif-plugged-c949af34-396a-4e42-917f-e555edc66487 for instance with vm_state building and task_state spawning.
Nov 30 12:51:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:07 user nova-compute[75672]: INFO nova.compute.manager [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Terminating instance
Nov 30 12:51:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:51:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:08 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Instance destroyed successfully.
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lazy-loading 'resources' on Instance uuid d5a6266a-af9e-4050-bba8-92eae9ac28bf {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:31:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1491886481',display_name='tempest-ServerActionsTestOtherA-server-1491886481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1491886481',id=5,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAGYYp9gmKcKQU/0AhKXIKN1vmmULr4112gYCMQNfGJmVLFUNJpr/fRLeXt2uFTxy9c+sqp7OE8Rgl3bMk88M8K66f/jnDNBbOBQMv+K2V48Kq8w3CudXAVm+CT4wTJ5Q==',key_name='tempest-keypair-1875335252',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:32:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51606113e3d1460894fdc500924cb37a',ramdisk_id='',reservation_id='r-trekqyuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2076465849',owner_user_name='tempest-ServerActionsTestOtherA-2076465849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:32:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15791a052aef4d7a9bc79c97075cbdc9',uuid=d5a6266a-af9e-4050-bba8-92eae9ac28bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converting VIF {"id": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "address": "fa:16:3e:e3:3d:a3", "network": {"id": "bbf1f467-39ee-40a0-acd5-91e4761d624f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1973912560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51606113e3d1460894fdc500924cb37a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7513ca6e-ee", "ovs_interfaceid": "7513ca6e-ee52-47e2-a2cb-428f6013ca40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3d:a3,bridge_name='br-int',has_traffic_filtering=True,id=7513ca6e-ee52-47e2-a2cb-428f6013ca40,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7513ca6e-ee') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG os_vif [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3d:a3,bridge_name='br-int',has_traffic_filtering=True,id=7513ca6e-ee52-47e2-a2cb-428f6013ca40,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7513ca6e-ee') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7513ca6e-ee, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9aec4fad-08e0-4379-a576-fb1e6111d87d) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:51:08 user nova-compute[75672]: INFO os_vif [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3d:a3,bridge_name='br-int',has_traffic_filtering=True,id=7513ca6e-ee52-47e2-a2cb-428f6013ca40,network=Network(bbf1f467-39ee-40a0-acd5-91e4761d624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7513ca6e-ee')
Nov 30 12:51:08 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Deleting instance files /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf_del
Nov 30 12:51:08 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Deletion of /opt/stack/data/nova/instances/d5a6266a-af9e-4050-bba8-92eae9ac28bf_del complete
Nov 30 12:51:08 user nova-compute[75672]: INFO nova.compute.manager [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 30 12:51:08 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-c247aeae-7b3e-40aa-ab13-31656cafd9c8 req-71c71e45-0791-4422-a34b-274e9654c35b service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Received event network-vif-deleted-7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:08 user nova-compute[75672]: INFO nova.compute.manager [req-c247aeae-7b3e-40aa-ab13-31656cafd9c8 req-71c71e45-0791-4422-a34b-274e9654c35b service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Neutron deleted interface 7513ca6e-ee52-47e2-a2cb-428f6013ca40; detaching it from the instance and deleting it from the info cache
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.network.neutron [req-c247aeae-7b3e-40aa-ab13-31656cafd9c8 req-71c71e45-0791-4422-a34b-274e9654c35b service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:51:08 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Took 0.55 seconds to deallocate network for instance.
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-cc89ddad-a730-4910-b665-c41cd5313ae2 req-ca3249e8-5164-4ca0-8f7c-eedb9c34e9d2 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Received event network-vif-unplugged-7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cc89ddad-a730-4910-b665-c41cd5313ae2 req-ca3249e8-5164-4ca0-8f7c-eedb9c34e9d2 service nova] Acquiring lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cc89ddad-a730-4910-b665-c41cd5313ae2 req-ca3249e8-5164-4ca0-8f7c-eedb9c34e9d2 service nova] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cc89ddad-a730-4910-b665-c41cd5313ae2 req-ca3249e8-5164-4ca0-8f7c-eedb9c34e9d2 service nova] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-cc89ddad-a730-4910-b665-c41cd5313ae2 req-ca3249e8-5164-4ca0-8f7c-eedb9c34e9d2 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] No waiting events found dispatching network-vif-unplugged-7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-cc89ddad-a730-4910-b665-c41cd5313ae2 req-ca3249e8-5164-4ca0-8f7c-eedb9c34e9d2 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Received event network-vif-unplugged-7513ca6e-ee52-47e2-a2cb-428f6013ca40 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-cc89ddad-a730-4910-b665-c41cd5313ae2 req-ca3249e8-5164-4ca0-8f7c-eedb9c34e9d2 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Received event network-vif-plugged-7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cc89ddad-a730-4910-b665-c41cd5313ae2 req-ca3249e8-5164-4ca0-8f7c-eedb9c34e9d2 service nova] Acquiring lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cc89ddad-a730-4910-b665-c41cd5313ae2 req-ca3249e8-5164-4ca0-8f7c-eedb9c34e9d2 service nova] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cc89ddad-a730-4910-b665-c41cd5313ae2 req-ca3249e8-5164-4ca0-8f7c-eedb9c34e9d2 service nova] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-cc89ddad-a730-4910-b665-c41cd5313ae2 req-ca3249e8-5164-4ca0-8f7c-eedb9c34e9d2 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] No waiting events found dispatching network-vif-plugged-7513ca6e-ee52-47e2-a2cb-428f6013ca40 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:51:08 user nova-compute[75672]: WARNING nova.compute.manager [req-cc89ddad-a730-4910-b665-c41cd5313ae2 req-ca3249e8-5164-4ca0-8f7c-eedb9c34e9d2 service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Received unexpected event network-vif-plugged-7513ca6e-ee52-47e2-a2cb-428f6013ca40 for instance with vm_state active and task_state deleting.
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-c247aeae-7b3e-40aa-ab13-31656cafd9c8 req-71c71e45-0791-4422-a34b-274e9654c35b service nova] [instance: d5a6266a-af9e-4050-bba8-92eae9ac28bf] Detach interface failed, port_id=7513ca6e-ee52-47e2-a2cb-428f6013ca40, reason: Instance d5a6266a-af9e-4050-bba8-92eae9ac28bf could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:51:08 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Instance spawned successfully.
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:51:08 user nova-compute[75672]: INFO nova.compute.manager [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Took 7.85 seconds to spawn the instance on the hypervisor.
Nov 30 12:51:08 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:51:09 user nova-compute[75672]: INFO nova.compute.manager [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Took 8.71 seconds to build instance.
Nov 30 12:51:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7d970df-5d89-449b-adc1-5da8c98fce9e tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.955s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:09 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:51:09 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:51:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:09 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Deleted allocations for instance d5a6266a-af9e-4050-bba8-92eae9ac28bf
Nov 30 12:51:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e8b57e54-864f-4bdc-93cf-35bba98076b6 tempest-ServerActionsTestOtherA-2076465849 tempest-ServerActionsTestOtherA-2076465849-project-member] Lock "d5a6266a-af9e-4050-bba8-92eae9ac28bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.293s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:13 user nova-compute[75672]: INFO nova.compute.manager [None req-9665b509-e6ee-4d2b-bb0f-930ceed4c827 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Unrescuing
Nov 30 12:51:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9665b509-e6ee-4d2b-bb0f-930ceed4c827 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:51:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9665b509-e6ee-4d2b-bb0f-930ceed4c827 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquired lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:51:13 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9665b509-e6ee-4d2b-bb0f-930ceed4c827 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9665b509-e6ee-4d2b-bb0f-930ceed4c827 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updating instance_info_cache with network_info: [{"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9665b509-e6ee-4d2b-bb0f-930ceed4c827 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Releasing lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG nova.objects.instance [None req-9665b509-e6ee-4d2b-bb0f-930ceed4c827 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lazy-loading 'flavor' on Instance uuid 87744aef-7e32-475b-907e-e30702d083bf {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-b4f9b498-7798-426f-a92c-601e575f08fa req-157cc4e9-8004-4c60-90a6-a518e13265dd service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-vif-unplugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b4f9b498-7798-426f-a92c-601e575f08fa req-157cc4e9-8004-4c60-90a6-a518e13265dd service nova] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b4f9b498-7798-426f-a92c-601e575f08fa req-157cc4e9-8004-4c60-90a6-a518e13265dd service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b4f9b498-7798-426f-a92c-601e575f08fa req-157cc4e9-8004-4c60-90a6-a518e13265dd service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-b4f9b498-7798-426f-a92c-601e575f08fa req-157cc4e9-8004-4c60-90a6-a518e13265dd service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] No waiting events found dispatching network-vif-unplugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:51:14 user nova-compute[75672]: WARNING nova.compute.manager [req-b4f9b498-7798-426f-a92c-601e575f08fa req-157cc4e9-8004-4c60-90a6-a518e13265dd service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received unexpected event network-vif-unplugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:51:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-8c1f74e2-ea48-4359-84d2-c6a84d005219 req-b24c2d51-2d25-420c-b359-27e0ebfc7541 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-changed-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-8c1f74e2-ea48-4359-84d2-c6a84d005219 req-b24c2d51-2d25-420c-b359-27e0ebfc7541 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Refreshing instance network info cache due to event network-changed-fb7cf9cd-ce27-4327-97ad-1c2692de57e7. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8c1f74e2-ea48-4359-84d2-c6a84d005219 req-b24c2d51-2d25-420c-b359-27e0ebfc7541 service nova] Acquiring lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8c1f74e2-ea48-4359-84d2-c6a84d005219 req-b24c2d51-2d25-420c-b359-27e0ebfc7541 service nova] Acquired lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:51:14 user nova-compute[75672]: DEBUG nova.network.neutron [req-8c1f74e2-ea48-4359-84d2-c6a84d005219 req-b24c2d51-2d25-420c-b359-27e0ebfc7541 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Refreshing network info cache for port fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:51:15 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Instance destroyed successfully.
Nov 30 12:51:15 user nova-compute[75672]: DEBUG nova.network.neutron [req-8c1f74e2-ea48-4359-84d2-c6a84d005219 req-b24c2d51-2d25-420c-b359-27e0ebfc7541 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updated VIF entry in instance network info cache for port fb7cf9cd-ce27-4327-97ad-1c2692de57e7. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:51:15 user nova-compute[75672]: DEBUG nova.network.neutron [req-8c1f74e2-ea48-4359-84d2-c6a84d005219 req-b24c2d51-2d25-420c-b359-27e0ebfc7541 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updating instance_info_cache with network_info: [{"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:51:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8c1f74e2-ea48-4359-84d2-c6a84d005219 req-b24c2d51-2d25-420c-b359-27e0ebfc7541 service nova] Releasing lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG nova.compute.manager [req-c09210ac-c3ec-43aa-b90e-5367b7466254 req-6eed9b51-7631-4f0d-a904-7e93d010d546 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c09210ac-c3ec-43aa-b90e-5367b7466254 req-6eed9b51-7631-4f0d-a904-7e93d010d546 service nova] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c09210ac-c3ec-43aa-b90e-5367b7466254 req-6eed9b51-7631-4f0d-a904-7e93d010d546 service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c09210ac-c3ec-43aa-b90e-5367b7466254 req-6eed9b51-7631-4f0d-a904-7e93d010d546 service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG nova.compute.manager [req-c09210ac-c3ec-43aa-b90e-5367b7466254 req-6eed9b51-7631-4f0d-a904-7e93d010d546 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] No waiting events found dispatching network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:51:16 user nova-compute[75672]: WARNING nova.compute.manager [req-c09210ac-c3ec-43aa-b90e-5367b7466254 req-6eed9b51-7631-4f0d-a904-7e93d010d546 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received unexpected event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:51:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:51:16 user nova-compute[75672]: INFO nova.compute.claims [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Claim successful on node user
Nov 30 12:51:16 user nova-compute[75672]: DEBUG nova.compute.manager [req-193b8039-021f-468c-9ba4-1fb8d15969ee req-3d5a6323-18fe-44cf-9683-308cb5c82dba service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-changed-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG nova.compute.manager [req-193b8039-021f-468c-9ba4-1fb8d15969ee req-3d5a6323-18fe-44cf-9683-308cb5c82dba service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Refreshing instance network info cache due to event network-changed-fb7cf9cd-ce27-4327-97ad-1c2692de57e7. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-193b8039-021f-468c-9ba4-1fb8d15969ee req-3d5a6323-18fe-44cf-9683-308cb5c82dba service nova] Acquiring lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-193b8039-021f-468c-9ba4-1fb8d15969ee req-3d5a6323-18fe-44cf-9683-308cb5c82dba service nova] Acquired lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:51:16 user nova-compute[75672]: DEBUG nova.network.neutron [req-193b8039-021f-468c-9ba4-1fb8d15969ee req-3d5a6323-18fe-44cf-9683-308cb5c82dba service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Refreshing network info cache for port fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG nova.network.neutron [req-193b8039-021f-468c-9ba4-1fb8d15969ee req-3d5a6323-18fe-44cf-9683-308cb5c82dba service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updated VIF entry in instance network info cache for port fb7cf9cd-ce27-4327-97ad-1c2692de57e7. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG nova.network.neutron [req-193b8039-021f-468c-9ba4-1fb8d15969ee req-3d5a6323-18fe-44cf-9683-308cb5c82dba service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updating instance_info_cache with network_info: [{"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.700s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-193b8039-021f-468c-9ba4-1fb8d15969ee req-3d5a6323-18fe-44cf-9683-308cb5c82dba service nova] Releasing lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:51:17 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:51:17 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG nova.policy [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '924cf8ff73154f8fadb371175a0d8fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513644b3a140400dbdf6b07e8e727dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:51:17 user nova-compute[75672]: INFO nova.virt.block_device [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Booting with volume fa691601-e25e-4809-b28e-13a6e286166b at /dev/vda
Nov 30 12:51:17 user nova-compute[75672]: DEBUG os_brick.utils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67501ba-ad61-4707-ad89-62b5c631699e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc98170c-d676-4aa9-ba40-af84a18a8258]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bdacf7-d9f9-4222-80b7-d145b3b946ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d36b0ac-9961-47ed-af63-711b8cdb886d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:51:17 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:51:17 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6044764c-58fc-4b80-a2bc-ca2da11c4a39]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG os_brick.utils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:51:17 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Updating existing volume attachment record: 9ea013c3-a53c-4a6d-aaa8-c869180c3335 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:51:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:18 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Successfully created port: cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:51:18 user nova-compute[75672]: DEBUG nova.compute.manager [req-6e44e581-84f4-4f1c-95be-5480a735717f req-62c7334a-16be-4dee-b370-91f182fc7fb6 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6e44e581-84f4-4f1c-95be-5480a735717f req-62c7334a-16be-4dee-b370-91f182fc7fb6 service nova] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6e44e581-84f4-4f1c-95be-5480a735717f req-62c7334a-16be-4dee-b370-91f182fc7fb6 service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6e44e581-84f4-4f1c-95be-5480a735717f req-62c7334a-16be-4dee-b370-91f182fc7fb6 service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:18 user nova-compute[75672]: DEBUG nova.compute.manager [req-6e44e581-84f4-4f1c-95be-5480a735717f req-62c7334a-16be-4dee-b370-91f182fc7fb6 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] No waiting events found dispatching network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:51:18 user nova-compute[75672]: WARNING nova.compute.manager [req-6e44e581-84f4-4f1c-95be-5480a735717f req-62c7334a-16be-4dee-b370-91f182fc7fb6 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received unexpected event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:51:18 user nova-compute[75672]: DEBUG nova.compute.manager [req-6e44e581-84f4-4f1c-95be-5480a735717f req-62c7334a-16be-4dee-b370-91f182fc7fb6 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6e44e581-84f4-4f1c-95be-5480a735717f req-62c7334a-16be-4dee-b370-91f182fc7fb6 service nova] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6e44e581-84f4-4f1c-95be-5480a735717f req-62c7334a-16be-4dee-b370-91f182fc7fb6 service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:18 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6e44e581-84f4-4f1c-95be-5480a735717f req-62c7334a-16be-4dee-b370-91f182fc7fb6 service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:18 user nova-compute[75672]: DEBUG nova.compute.manager [req-6e44e581-84f4-4f1c-95be-5480a735717f req-62c7334a-16be-4dee-b370-91f182fc7fb6 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] No waiting events found dispatching network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:51:18 user nova-compute[75672]: WARNING nova.compute.manager [req-6e44e581-84f4-4f1c-95be-5480a735717f req-62c7334a-16be-4dee-b370-91f182fc7fb6 service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received unexpected event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:51:18 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9665b509-e6ee-4d2b-bb0f-930ceed4c827 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:51:19 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Successfully updated port: cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:51:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "refresh_cache-5cf89c9b-a2ba-4588-a2ea-67917b994afb" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:51:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquired lock "refresh_cache-5cf89c9b-a2ba-4588-a2ea-67917b994afb" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:51:19 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:51:19 user nova-compute[75672]: DEBUG nova.compute.manager [req-6f05cad1-dd30-479a-91d6-09cf2519589f req-2c034994-0210-4cb5-ac22-e8c17b67d302 service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Received event network-changed-cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:19 user nova-compute[75672]: DEBUG nova.compute.manager [req-6f05cad1-dd30-479a-91d6-09cf2519589f req-2c034994-0210-4cb5-ac22-e8c17b67d302 service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Refreshing instance network info cache due to event network-changed-cf838815-138a-4d8d-9280-f9312c7c10fc. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:51:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6f05cad1-dd30-479a-91d6-09cf2519589f req-2c034994-0210-4cb5-ac22-e8c17b67d302 service nova] Acquiring lock "refresh_cache-5cf89c9b-a2ba-4588-a2ea-67917b994afb" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:51:19 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:51:19 user nova-compute[75672]: DEBUG nova.network.neutron [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Updating instance_info_cache with network_info: [{"id": "cf838815-138a-4d8d-9280-f9312c7c10fc", "address": "fa:16:3e:df:ec:8b", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf838815-13", "ovs_interfaceid": "cf838815-138a-4d8d-9280-f9312c7c10fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:51:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Releasing lock "refresh_cache-5cf89c9b-a2ba-4588-a2ea-67917b994afb" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:51:19 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Instance network_info: |[{"id": "cf838815-138a-4d8d-9280-f9312c7c10fc", "address": "fa:16:3e:df:ec:8b", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf838815-13", "ovs_interfaceid": "cf838815-138a-4d8d-9280-f9312c7c10fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:51:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6f05cad1-dd30-479a-91d6-09cf2519589f req-2c034994-0210-4cb5-ac22-e8c17b67d302 service nova] Acquired lock "refresh_cache-5cf89c9b-a2ba-4588-a2ea-67917b994afb" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:51:19 user nova-compute[75672]: DEBUG nova.network.neutron [req-6f05cad1-dd30-479a-91d6-09cf2519589f req-2c034994-0210-4cb5-ac22-e8c17b67d302 service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Refreshing network info cache for port cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:51:20 user nova-compute[75672]: DEBUG nova.network.neutron [req-6f05cad1-dd30-479a-91d6-09cf2519589f req-2c034994-0210-4cb5-ac22-e8c17b67d302 service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Updated VIF entry in instance network info cache for port cf838815-138a-4d8d-9280-f9312c7c10fc. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:51:20 user nova-compute[75672]: DEBUG nova.network.neutron [req-6f05cad1-dd30-479a-91d6-09cf2519589f req-2c034994-0210-4cb5-ac22-e8c17b67d302 service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Updating instance_info_cache with network_info: [{"id": "cf838815-138a-4d8d-9280-f9312c7c10fc", "address": "fa:16:3e:df:ec:8b", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf838815-13", "ovs_interfaceid": "cf838815-138a-4d8d-9280-f9312c7c10fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:51:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6f05cad1-dd30-479a-91d6-09cf2519589f req-2c034994-0210-4cb5-ac22-e8c17b67d302 service nova] Releasing lock "refresh_cache-5cf89c9b-a2ba-4588-a2ea-67917b994afb" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:51:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:51:33 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Creating image(s)
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Ensure instance console log exists: /opt/stack/data/nova/instances/5cf89c9b-a2ba-4588-a2ea-67917b994afb/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Start _get_guest_xml network_info=[{"id": "cf838815-138a-4d8d-9280-f9312c7c10fc", "address": "fa:16:3e:df:ec:8b", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf838815-13", "ovs_interfaceid": "cf838815-138a-4d8d-9280-f9312c7c10fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '9ea013c3-a53c-4a6d-aaa8-c869180c3335', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zSeJdhxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5cf89c9b-a2ba-4588-a2ea-67917b994afb', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa691601-e25e-4809-b28e-13a6e286166b', 'serial': 'fa691601-e25e-4809-b28e-13a6e286166b'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:51:33 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:51:33 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zSeJdhxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:51:33 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:51:33 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:51:33 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:51:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0e8f56-6cce-4f41-bc15-9fe9e8880b1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:51:33 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeee78d-48a6-4002-804d-9fea84bd2e4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b] added
Nov 30 12:51:33 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[881237bb-ede2-44d9-a746-097a58d99ae4]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef723a7e-bd29-4d45-b892-a699807bc1b1]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zSeJdhxn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zSeJdhxn" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef73e8bf-4f08-4ba1-a779-9f1cbecae9c0]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zSeJdhxn'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3e17a3-4297-4e65-afd1-0038d424ed25]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[62477da8-b6bd-426d-9cf2-470582fec8a6]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:51:33 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:51:33 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:51:33 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:51:33 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:51:33 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:51:33 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[771e518a-709d-4db2-bfc5-042c4c2f4141]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b, portal: 172.16.0.220,3260]
Nov 30 12:51:33 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b, portal: 172.16.0.220,3260] successful.
Nov 30 12:51:33 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cc17d1-379f-4ccb-84db-8fe8adb29c97]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3d9629-c1e5-4c19-abe9-d0f65fcd8d63]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:51:33 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:51:33 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:51:33 user nova-compute[75672]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)
Nov 30 12:51:33 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:51:33 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:51:33 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:51:33 user nova-compute[75672]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)
Nov 30 12:51:33 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[777d5c89-fe9e-4b30-9d60-171f7e41030f]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:51:33 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: None {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zSeJdhxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23136326538646138', 'path': '/dev/sde'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136326538646138', 'path': '/dev/sde'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-500135060',display_name='tempest-TestVolumeBootPattern-server-500135060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-500135060',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/tiWnKVjyQ+YQ0wPEgFpD4sUWbk2GMRtR0fUhMrrhWzqEfZseqSV3bBKpPI9FNVcBh3EJSPDcri0dXJ24ST3AlMd1Z9vj5ezFGg5LMAjAiHzircmeHJyIgzk+4EYWw6A==',key_name='tempest-TestVolumeBootPattern-1453287901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-9vdyk083',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:51:18Z,user_data=None,user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=5cf89c9b-a2ba-4588-a2ea-67917b994afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf838815-138a-4d8d-9280-f9312c7c10fc", "address": "fa:16:3e:df:ec:8b", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf838815-13", "ovs_interfaceid": "cf838815-138a-4d8d-9280-f9312c7c10fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "cf838815-138a-4d8d-9280-f9312c7c10fc", "address": "fa:16:3e:df:ec:8b", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf838815-13", "ovs_interfaceid": "cf838815-138a-4d8d-9280-f9312c7c10fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=cf838815-138a-4d8d-9280-f9312c7c10fc,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf838815-13') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lazy-loading 'pci_devices' on Instance uuid 5cf89c9b-a2ba-4588-a2ea-67917b994afb {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:51:34 user nova-compute[75672]:   <uuid>5cf89c9b-a2ba-4588-a2ea-67917b994afb</uuid>
Nov 30 12:51:34 user nova-compute[75672]:   <name>instance-0000002b</name>
Nov 30 12:51:34 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:51:34 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:51:34 user nova-compute[75672]:   <metadata>
Nov 30 12:51:34 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:51:34 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:51:34 user nova-compute[75672]:       <nova:name>tempest-TestVolumeBootPattern-server-500135060</nova:name>
Nov 30 12:51:34 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:51:33</nova:creationTime>
Nov 30 12:51:34 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:51:34 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:51:34 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:51:34 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:51:34 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:51:34 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:51:34 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:51:34 user nova-compute[75672]:       <nova:owner>
Nov 30 12:51:34 user nova-compute[75672]:         <nova:user uuid="924cf8ff73154f8fadb371175a0d8fc4">tempest-TestVolumeBootPattern-1743139468-project-member</nova:user>
Nov 30 12:51:34 user nova-compute[75672]:         <nova:project uuid="513644b3a140400dbdf6b07e8e727dd4">tempest-TestVolumeBootPattern-1743139468</nova:project>
Nov 30 12:51:34 user nova-compute[75672]:       </nova:owner>
Nov 30 12:51:34 user nova-compute[75672]:       <nova:ports>
Nov 30 12:51:34 user nova-compute[75672]:         <nova:port uuid="cf838815-138a-4d8d-9280-f9312c7c10fc">
Nov 30 12:51:34 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 12:51:34 user nova-compute[75672]:         </nova:port>
Nov 30 12:51:34 user nova-compute[75672]:       </nova:ports>
Nov 30 12:51:34 user nova-compute[75672]:     </nova:instance>
Nov 30 12:51:34 user nova-compute[75672]:   </metadata>
Nov 30 12:51:34 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:51:34 user nova-compute[75672]:     <system>
Nov 30 12:51:34 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:51:34 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:51:34 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:51:34 user nova-compute[75672]:       <entry name="serial">5cf89c9b-a2ba-4588-a2ea-67917b994afb</entry>
Nov 30 12:51:34 user nova-compute[75672]:       <entry name="uuid">5cf89c9b-a2ba-4588-a2ea-67917b994afb</entry>
Nov 30 12:51:34 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:51:34 user nova-compute[75672]:     </system>
Nov 30 12:51:34 user nova-compute[75672]:   </sysinfo>
Nov 30 12:51:34 user nova-compute[75672]:   <os>
Nov 30 12:51:34 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:51:34 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:51:34 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:51:34 user nova-compute[75672]:   </os>
Nov 30 12:51:34 user nova-compute[75672]:   <features>
Nov 30 12:51:34 user nova-compute[75672]:     <acpi/>
Nov 30 12:51:34 user nova-compute[75672]:     <apic/>
Nov 30 12:51:34 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:51:34 user nova-compute[75672]:   </features>
Nov 30 12:51:34 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:51:34 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:51:34 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:51:34 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:51:34 user nova-compute[75672]:   </clock>
Nov 30 12:51:34 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:51:34 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:51:34 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:51:34 user nova-compute[75672]:   </cpu>
Nov 30 12:51:34 user nova-compute[75672]:   <devices>
Nov 30 12:51:34 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:51:34 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:51:34 user nova-compute[75672]:       <source dev="/dev/sde"/>
Nov 30 12:51:34 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:51:34 user nova-compute[75672]:       <serial>fa691601-e25e-4809-b28e-13a6e286166b</serial>
Nov 30 12:51:34 user nova-compute[75672]:     </disk>
Nov 30 12:51:34 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:51:34 user nova-compute[75672]:       <mac address="fa:16:3e:df:ec:8b"/>
Nov 30 12:51:34 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:51:34 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:51:34 user nova-compute[75672]:       <target dev="tapcf838815-13"/>
Nov 30 12:51:34 user nova-compute[75672]:     </interface>
Nov 30 12:51:34 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:51:34 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/5cf89c9b-a2ba-4588-a2ea-67917b994afb/console.log" append="off"/>
Nov 30 12:51:34 user nova-compute[75672]:     </serial>
Nov 30 12:51:34 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:51:34 user nova-compute[75672]:     <video>
Nov 30 12:51:34 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:51:34 user nova-compute[75672]:     </video>
Nov 30 12:51:34 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:51:34 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:51:34 user nova-compute[75672]:     </rng>
Nov 30 12:51:34 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:51:34 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:51:34 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:51:34 user nova-compute[75672]:     </memballoon>
Nov 30 12:51:34 user nova-compute[75672]:   </devices>
Nov 30 12:51:34 user nova-compute[75672]: </domain>
Nov 30 12:51:34 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-500135060',display_name='tempest-TestVolumeBootPattern-server-500135060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-500135060',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/tiWnKVjyQ+YQ0wPEgFpD4sUWbk2GMRtR0fUhMrrhWzqEfZseqSV3bBKpPI9FNVcBh3EJSPDcri0dXJ24ST3AlMd1Z9vj5ezFGg5LMAjAiHzircmeHJyIgzk+4EYWw6A==',key_name='tempest-TestVolumeBootPattern-1453287901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-9vdyk083',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:51:18Z,user_data=None,user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=5cf89c9b-a2ba-4588-a2ea-67917b994afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf838815-138a-4d8d-9280-f9312c7c10fc", "address": "fa:16:3e:df:ec:8b", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf838815-13", "ovs_interfaceid": "cf838815-138a-4d8d-9280-f9312c7c10fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "cf838815-138a-4d8d-9280-f9312c7c10fc", "address": "fa:16:3e:df:ec:8b", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf838815-13", "ovs_interfaceid": "cf838815-138a-4d8d-9280-f9312c7c10fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=cf838815-138a-4d8d-9280-f9312c7c10fc,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf838815-13') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG os_vif [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=cf838815-138a-4d8d-9280-f9312c7c10fc,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf838815-13') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70783eb3-6ce7-5f1f-be11-09b24d18c803', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf838815-13, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf838815-13, col_values=(('qos', UUID('9594537e-d340-43e8-a43b-85506503f239')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf838815-13, col_values=(('external_ids', {'iface-id': 'cf838815-138a-4d8d-9280-f9312c7c10fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:ec:8b', 'vm-uuid': '5cf89c9b-a2ba-4588-a2ea-67917b994afb'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:34 user nova-compute[75672]: INFO os_vif [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=cf838815-138a-4d8d-9280-f9312c7c10fc,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf838815-13')
Nov 30 12:51:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:51:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] No VIF found with MAC fa:16:3e:df:ec:8b, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:51:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-34d62daf-af6f-4ea8-b891-65eb79d32ec8 req-18deaa2a-6888-40fd-8c68-36aa11c42947 service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Received event network-vif-plugged-cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-34d62daf-af6f-4ea8-b891-65eb79d32ec8 req-18deaa2a-6888-40fd-8c68-36aa11c42947 service nova] Acquiring lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-34d62daf-af6f-4ea8-b891-65eb79d32ec8 req-18deaa2a-6888-40fd-8c68-36aa11c42947 service nova] Lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-34d62daf-af6f-4ea8-b891-65eb79d32ec8 req-18deaa2a-6888-40fd-8c68-36aa11c42947 service nova] Lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-34d62daf-af6f-4ea8-b891-65eb79d32ec8 req-18deaa2a-6888-40fd-8c68-36aa11c42947 service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] No waiting events found dispatching network-vif-plugged-cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:51:36 user nova-compute[75672]: WARNING nova.compute.manager [req-34d62daf-af6f-4ea8-b891-65eb79d32ec8 req-18deaa2a-6888-40fd-8c68-36aa11c42947 service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Received unexpected event network-vif-plugged-cf838815-138a-4d8d-9280-f9312c7c10fc for instance with vm_state building and task_state spawning.
Nov 30 12:51:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:37 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:51:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:51:37 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Instance spawned successfully.
Nov 30 12:51:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:51:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:51:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:51:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:51:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:51:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:51:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:51:38 user nova-compute[75672]: INFO nova.compute.manager [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 30 12:51:38 user nova-compute[75672]: DEBUG nova.compute.manager [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:51:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-6bcc489d-9de7-4c61-bf91-9e4b2878d4cd req-3a16832c-6063-4990-9ea4-5a3213d279b8 service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Received event network-vif-plugged-cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:51:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6bcc489d-9de7-4c61-bf91-9e4b2878d4cd req-3a16832c-6063-4990-9ea4-5a3213d279b8 service nova] Acquiring lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6bcc489d-9de7-4c61-bf91-9e4b2878d4cd req-3a16832c-6063-4990-9ea4-5a3213d279b8 service nova] Lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6bcc489d-9de7-4c61-bf91-9e4b2878d4cd req-3a16832c-6063-4990-9ea4-5a3213d279b8 service nova] Lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-6bcc489d-9de7-4c61-bf91-9e4b2878d4cd req-3a16832c-6063-4990-9ea4-5a3213d279b8 service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] No waiting events found dispatching network-vif-plugged-cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:51:38 user nova-compute[75672]: WARNING nova.compute.manager [req-6bcc489d-9de7-4c61-bf91-9e4b2878d4cd req-3a16832c-6063-4990-9ea4-5a3213d279b8 service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Received unexpected event network-vif-plugged-cf838815-138a-4d8d-9280-f9312c7c10fc for instance with vm_state building and task_state spawning.
Nov 30 12:51:38 user nova-compute[75672]: INFO nova.compute.manager [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Took 21.37 seconds to build instance.
Nov 30 12:51:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c7503fee-50fe-44ea-b9b3-4643e390eab0 tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.485s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:41 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:51:41 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:51:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:51:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:51:41 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:51:42 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updating instance_info_cache with network_info: [{"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:51:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-87744aef-7e32-475b-907e-e30702d083bf" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:51:42 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:51:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:51:43 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:51:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:43 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:51:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:51:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:51:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:51:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:51:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:51:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:51:46 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7936MB free_disk=24.82372283935547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "87744aef-7e32-475b-907e-e30702d083bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 87744aef-7e32-475b-907e-e30702d083bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance c00b64bd-8011-4609-8953-315f1e655930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 498d231e-d0be-4ea5-9024-669a978b8292 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 24033f28-8bf7-4d04-ba4d-88537ad30f10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 5cf89c9b-a2ba-4588-a2ea-67917b994afb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:51:46 user nova-compute[75672]: INFO nova.compute.manager [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Detaching volume f9a189e3-52ee-40ba-9fcd-a0d0e5612188
Nov 30 12:51:46 user nova-compute[75672]: INFO nova.virt.block_device [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Attempting to driver detach volume f9a189e3-52ee-40ba-9fcd-a0d0e5612188 from mountpoint /dev/vdb
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Attempting to detach device vdb from instance 87744aef-7e32-475b-907e-e30702d083bf from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:51:46 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:51:46 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 12:51:46 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:51:46 user nova-compute[75672]:   <serial>f9a189e3-52ee-40ba-9fcd-a0d0e5612188</serial>
Nov 30 12:51:46 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:51:46 user nova-compute[75672]: </disk>
Nov 30 12:51:46 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:51:46 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Successfully detached device vdb from instance 87744aef-7e32-475b-907e-e30702d083bf from the persistent domain config.
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87744aef-7e32-475b-907e-e30702d083bf from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:51:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:51:46 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:51:46 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 12:51:46 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:51:46 user nova-compute[75672]:   <serial>f9a189e3-52ee-40ba-9fcd-a0d0e5612188</serial>
Nov 30 12:51:46 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:51:46 user nova-compute[75672]: </disk>
Nov 30 12:51:46 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:51:47 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:51:47 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:51:47 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:51:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:51:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87744aef-7e32-475b-907e-e30702d083bf {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:51:48 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:51:48 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:51:48 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:51:49 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:51:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:52 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:51:52 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:51:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:55 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:51:56 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:51:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:51:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "cd6672f6-3d59-4311-b213-aee62517f868" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cd6672f6-3d59-4311-b213-aee62517f868" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:03 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:52:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:03 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:52:03 user nova-compute[75672]: INFO nova.compute.claims [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Claim successful on node user
Nov 30 12:52:04 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG nova.network.neutron [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:52:04 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:52:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:52:04 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Creating image(s)
Nov 30 12:52:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "/opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "/opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG nova.policy [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4204698d39994cf8aab1a59ddc16e387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eae82e7799446a4af16b2b239c2003f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.252s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk 1073741824" returned: 0 in 0.061s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.168s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG nova.network.neutron [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Successfully created port: c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Cannot resize image /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Ensure instance console log exists: /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG nova.network.neutron [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Successfully updated port: c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "refresh_cache-cd6672f6-3d59-4311-b213-aee62517f868" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquired lock "refresh_cache-cd6672f6-3d59-4311-b213-aee62517f868" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG nova.network.neutron [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-4eb94279-e261-47c1-84c2-cf0df83f9de2 req-7d09e2ad-3d18-4706-8640-8d3f37f27d5a service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Received event network-changed-c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-4eb94279-e261-47c1-84c2-cf0df83f9de2 req-7d09e2ad-3d18-4706-8640-8d3f37f27d5a service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Refreshing instance network info cache due to event network-changed-c1570a44-7d9b-4e09-9005-cd6fd016a602. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4eb94279-e261-47c1-84c2-cf0df83f9de2 req-7d09e2ad-3d18-4706-8640-8d3f37f27d5a service nova] Acquiring lock "refresh_cache-cd6672f6-3d59-4311-b213-aee62517f868" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:52:05 user nova-compute[75672]: DEBUG nova.network.neutron [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.network.neutron [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Updating instance_info_cache with network_info: [{"id": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "address": "fa:16:3e:99:4d:34", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1570a44-7d", "ovs_interfaceid": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Releasing lock "refresh_cache-cd6672f6-3d59-4311-b213-aee62517f868" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Instance network_info: |[{"id": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "address": "fa:16:3e:99:4d:34", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1570a44-7d", "ovs_interfaceid": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4eb94279-e261-47c1-84c2-cf0df83f9de2 req-7d09e2ad-3d18-4706-8640-8d3f37f27d5a service nova] Acquired lock "refresh_cache-cd6672f6-3d59-4311-b213-aee62517f868" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.network.neutron [req-4eb94279-e261-47c1-84c2-cf0df83f9de2 req-7d09e2ad-3d18-4706-8640-8d3f37f27d5a service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Refreshing network info cache for port c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Start _get_guest_xml network_info=[{"id": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "address": "fa:16:3e:99:4d:34", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1570a44-7d", "ovs_interfaceid": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:52:06 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:52:06 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:52:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-734764111',display_name='tempest-VolumesSnapshotTestJSON-instance-734764111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-734764111',id=44,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/4xtK336lut8V0nEdldL5nfRJsHz7EPtKCjLVdkmiKfWUPZwWZalAlWdrsSoabdI4VtF8XxFjnqfY+CRVoERanYpy0udpJnjIwokOrP37crXCjIDhvi3nYBQMnAvmDTQ==',key_name='tempest-keypair-1785605369',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eae82e7799446a4af16b2b239c2003f',ramdisk_id='',reservation_id='r-rspoyar9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-453020492',owner_user_name='tempest-VolumesSnapshotTestJSON-453020492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:52:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4204698d39994cf8aab1a59ddc16e387',uuid=cd6672f6-3d59-4311-b213-aee62517f868,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "address": "fa:16:3e:99:4d:34", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1570a44-7d", "ovs_interfaceid": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Converting VIF {"id": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "address": "fa:16:3e:99:4d:34", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1570a44-7d", "ovs_interfaceid": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:4d:34,bridge_name='br-int',has_traffic_filtering=True,id=c1570a44-7d9b-4e09-9005-cd6fd016a602,network=Network(fcb1c4a1-0917-4076-9739-0989986069ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1570a44-7d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.objects.instance [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lazy-loading 'pci_devices' on Instance uuid cd6672f6-3d59-4311-b213-aee62517f868 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:52:06 user nova-compute[75672]:   <uuid>cd6672f6-3d59-4311-b213-aee62517f868</uuid>
Nov 30 12:52:06 user nova-compute[75672]:   <name>instance-0000002c</name>
Nov 30 12:52:06 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:52:06 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:52:06 user nova-compute[75672]:   <metadata>
Nov 30 12:52:06 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:52:06 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:52:06 user nova-compute[75672]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-734764111</nova:name>
Nov 30 12:52:06 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:52:06</nova:creationTime>
Nov 30 12:52:06 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:52:06 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:52:06 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:52:06 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:52:06 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:52:06 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:52:06 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:52:06 user nova-compute[75672]:       <nova:owner>
Nov 30 12:52:06 user nova-compute[75672]:         <nova:user uuid="4204698d39994cf8aab1a59ddc16e387">tempest-VolumesSnapshotTestJSON-453020492-project-member</nova:user>
Nov 30 12:52:06 user nova-compute[75672]:         <nova:project uuid="9eae82e7799446a4af16b2b239c2003f">tempest-VolumesSnapshotTestJSON-453020492</nova:project>
Nov 30 12:52:06 user nova-compute[75672]:       </nova:owner>
Nov 30 12:52:06 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:52:06 user nova-compute[75672]:       <nova:ports>
Nov 30 12:52:06 user nova-compute[75672]:         <nova:port uuid="c1570a44-7d9b-4e09-9005-cd6fd016a602">
Nov 30 12:52:06 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 12:52:06 user nova-compute[75672]:         </nova:port>
Nov 30 12:52:06 user nova-compute[75672]:       </nova:ports>
Nov 30 12:52:06 user nova-compute[75672]:     </nova:instance>
Nov 30 12:52:06 user nova-compute[75672]:   </metadata>
Nov 30 12:52:06 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:52:06 user nova-compute[75672]:     <system>
Nov 30 12:52:06 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:52:06 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:52:06 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:52:06 user nova-compute[75672]:       <entry name="serial">cd6672f6-3d59-4311-b213-aee62517f868</entry>
Nov 30 12:52:06 user nova-compute[75672]:       <entry name="uuid">cd6672f6-3d59-4311-b213-aee62517f868</entry>
Nov 30 12:52:06 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:52:06 user nova-compute[75672]:     </system>
Nov 30 12:52:06 user nova-compute[75672]:   </sysinfo>
Nov 30 12:52:06 user nova-compute[75672]:   <os>
Nov 30 12:52:06 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:52:06 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:52:06 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:52:06 user nova-compute[75672]:   </os>
Nov 30 12:52:06 user nova-compute[75672]:   <features>
Nov 30 12:52:06 user nova-compute[75672]:     <acpi/>
Nov 30 12:52:06 user nova-compute[75672]:     <apic/>
Nov 30 12:52:06 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:52:06 user nova-compute[75672]:   </features>
Nov 30 12:52:06 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:52:06 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:52:06 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:52:06 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:52:06 user nova-compute[75672]:   </clock>
Nov 30 12:52:06 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:52:06 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:52:06 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:52:06 user nova-compute[75672]:   </cpu>
Nov 30 12:52:06 user nova-compute[75672]:   <devices>
Nov 30 12:52:06 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:52:06 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:52:06 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk"/>
Nov 30 12:52:06 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:52:06 user nova-compute[75672]:     </disk>
Nov 30 12:52:06 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:52:06 user nova-compute[75672]:       <mac address="fa:16:3e:99:4d:34"/>
Nov 30 12:52:06 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:52:06 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:52:06 user nova-compute[75672]:       <target dev="tapc1570a44-7d"/>
Nov 30 12:52:06 user nova-compute[75672]:     </interface>
Nov 30 12:52:06 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:52:06 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/console.log" append="off"/>
Nov 30 12:52:06 user nova-compute[75672]:     </serial>
Nov 30 12:52:06 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:52:06 user nova-compute[75672]:     <video>
Nov 30 12:52:06 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:52:06 user nova-compute[75672]:     </video>
Nov 30 12:52:06 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:52:06 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:52:06 user nova-compute[75672]:     </rng>
Nov 30 12:52:06 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:52:06 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:52:06 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:52:06 user nova-compute[75672]:     </memballoon>
Nov 30 12:52:06 user nova-compute[75672]:   </devices>
Nov 30 12:52:06 user nova-compute[75672]: </domain>
Nov 30 12:52:06 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:52:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-734764111',display_name='tempest-VolumesSnapshotTestJSON-instance-734764111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-734764111',id=44,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/4xtK336lut8V0nEdldL5nfRJsHz7EPtKCjLVdkmiKfWUPZwWZalAlWdrsSoabdI4VtF8XxFjnqfY+CRVoERanYpy0udpJnjIwokOrP37crXCjIDhvi3nYBQMnAvmDTQ==',key_name='tempest-keypair-1785605369',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eae82e7799446a4af16b2b239c2003f',ramdisk_id='',reservation_id='r-rspoyar9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-453020492',owner_user_name='tempest-VolumesSnapshotTestJSON-453020492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:52:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4204698d39994cf8aab1a59ddc16e387',uuid=cd6672f6-3d59-4311-b213-aee62517f868,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "address": "fa:16:3e:99:4d:34", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1570a44-7d", "ovs_interfaceid": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Converting VIF {"id": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "address": "fa:16:3e:99:4d:34", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1570a44-7d", "ovs_interfaceid": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:4d:34,bridge_name='br-int',has_traffic_filtering=True,id=c1570a44-7d9b-4e09-9005-cd6fd016a602,network=Network(fcb1c4a1-0917-4076-9739-0989986069ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1570a44-7d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG os_vif [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:4d:34,bridge_name='br-int',has_traffic_filtering=True,id=c1570a44-7d9b-4e09-9005-cd6fd016a602,network=Network(fcb1c4a1-0917-4076-9739-0989986069ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1570a44-7d') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a59efed5-5d4d-5f03-b8aa-d9e4632d1e55', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1570a44-7d, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1570a44-7d, col_values=(('qos', UUID('43ee6572-18f9-44e4-9176-a895e0950304')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1570a44-7d, col_values=(('external_ids', {'iface-id': 'c1570a44-7d9b-4e09-9005-cd6fd016a602', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:4d:34', 'vm-uuid': 'cd6672f6-3d59-4311-b213-aee62517f868'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:06 user nova-compute[75672]: INFO os_vif [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:4d:34,bridge_name='br-int',has_traffic_filtering=True,id=c1570a44-7d9b-4e09-9005-cd6fd016a602,network=Network(fcb1c4a1-0917-4076-9739-0989986069ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1570a44-7d')
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] No VIF found with MAC fa:16:3e:99:4d:34, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.network.neutron [req-4eb94279-e261-47c1-84c2-cf0df83f9de2 req-7d09e2ad-3d18-4706-8640-8d3f37f27d5a service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Updated VIF entry in instance network info cache for port c1570a44-7d9b-4e09-9005-cd6fd016a602. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG nova.network.neutron [req-4eb94279-e261-47c1-84c2-cf0df83f9de2 req-7d09e2ad-3d18-4706-8640-8d3f37f27d5a service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Updating instance_info_cache with network_info: [{"id": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "address": "fa:16:3e:99:4d:34", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1570a44-7d", "ovs_interfaceid": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:52:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4eb94279-e261-47c1-84c2-cf0df83f9de2 req-7d09e2ad-3d18-4706-8640-8d3f37f27d5a service nova] Releasing lock "refresh_cache-cd6672f6-3d59-4311-b213-aee62517f868" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:52:07 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 87744aef-7e32-475b-907e-e30702d083bf is timed out.
Nov 30 12:52:07 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Successfully detached device vdb from instance 87744aef-7e32-475b-907e-e30702d083bf from the live domain config.
Nov 30 12:52:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbqhJALj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:52:07 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4174b622-2e28-46f5-8e59-9dddd52d1d75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:52:07 user nova-compute[75672]: No targets found.
Nov 30 12:52:07 user nova-compute[75672]: iSNS:
Nov 30 12:52:07 user nova-compute[75672]: No targets found.
Nov 30 12:52:07 user nova-compute[75672]: STATIC:
Nov 30 12:52:07 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b
Nov 30 12:52:07 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:52:07 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:52:07 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188
Nov 30 12:52:07 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:52:07 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:52:07 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:52:07 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:52:07 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:52:07 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf
Nov 30 12:52:07 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:52:07 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:52:07 user nova-compute[75672]: FIRMWARE:
Nov 30 12:52:07 user nova-compute[75672]: No targets found.
Nov 30 12:52:07 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:52:07 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:52:07 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c924cd-b06d-4860-aeac-8520569859b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bad643d-a046-434d-8394-23fc6f62cf9b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:52:07 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:52:07 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:52:07 user nova-compute[75672]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)
Nov 30 12:52:07 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:52:07 user nova-compute[75672]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 (non-flash)
Nov 30 12:52:07 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:52:07 user nova-compute[75672]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)
Nov 30 12:52:07 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd4327130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a77fe8-0c71-42fd-bb47-c40dae3907ab]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1ae683-8646-492e-99c9-56e50d5f8186]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86144ac-0d66-4fec-b595-b9659f03a158]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[41909072-241d-42c6-9c57-edf3aac7d7d5]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[07866229-f042-4f03-ad93-53605a988b9c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cd1c97-8d9c-44f4-b327-42896c556e04]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188, portal: 172.16.0.220,3260]
Nov 30 12:52:07 user nova-compute[75672]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188, portal: 172.16.0.220,3260] successful.
Nov 30 12:52:07 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a189e3-52ee-40ba-9fcd-a0d0e5612188 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[02613d27-629f-41da-88cc-fd9a7223bdc9]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] <== disconnect_volume: return (332ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-a7f3198f-0113-442f-b176-b6dafdd12f48 req-323f8000-7977-48e8-9777-62de17b00580 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Received event network-vif-plugged-c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:52:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a7f3198f-0113-442f-b176-b6dafdd12f48 req-323f8000-7977-48e8-9777-62de17b00580 service nova] Acquiring lock "cd6672f6-3d59-4311-b213-aee62517f868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a7f3198f-0113-442f-b176-b6dafdd12f48 req-323f8000-7977-48e8-9777-62de17b00580 service nova] Lock "cd6672f6-3d59-4311-b213-aee62517f868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a7f3198f-0113-442f-b176-b6dafdd12f48 req-323f8000-7977-48e8-9777-62de17b00580 service nova] Lock "cd6672f6-3d59-4311-b213-aee62517f868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-a7f3198f-0113-442f-b176-b6dafdd12f48 req-323f8000-7977-48e8-9777-62de17b00580 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] No waiting events found dispatching network-vif-plugged-c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:52:08 user nova-compute[75672]: WARNING nova.compute.manager [req-a7f3198f-0113-442f-b176-b6dafdd12f48 req-323f8000-7977-48e8-9777-62de17b00580 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Received unexpected event network-vif-plugged-c1570a44-7d9b-4e09-9005-cd6fd016a602 for instance with vm_state building and task_state spawning.
Nov 30 12:52:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:08 user nova-compute[75672]: DEBUG nova.objects.instance [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lazy-loading 'flavor' on Instance uuid 87744aef-7e32-475b-907e-e30702d083bf {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:52:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-becf165f-ac82-4114-980a-104ef1a439cf tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "87744aef-7e32-475b-907e-e30702d083bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.975s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:10 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:52:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:52:10 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Instance spawned successfully.
Nov 30 12:52:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:52:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:52:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:52:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:52:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:52:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:52:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:52:10 user nova-compute[75672]: DEBUG nova.compute.manager [req-2aa02992-372a-4c7e-a6b4-4386e2f7ac22 req-639d981d-ee0e-46d7-80d0-92e21f73d1a6 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Received event network-vif-plugged-c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:52:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2aa02992-372a-4c7e-a6b4-4386e2f7ac22 req-639d981d-ee0e-46d7-80d0-92e21f73d1a6 service nova] Acquiring lock "cd6672f6-3d59-4311-b213-aee62517f868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2aa02992-372a-4c7e-a6b4-4386e2f7ac22 req-639d981d-ee0e-46d7-80d0-92e21f73d1a6 service nova] Lock "cd6672f6-3d59-4311-b213-aee62517f868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2aa02992-372a-4c7e-a6b4-4386e2f7ac22 req-639d981d-ee0e-46d7-80d0-92e21f73d1a6 service nova] Lock "cd6672f6-3d59-4311-b213-aee62517f868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:10 user nova-compute[75672]: DEBUG nova.compute.manager [req-2aa02992-372a-4c7e-a6b4-4386e2f7ac22 req-639d981d-ee0e-46d7-80d0-92e21f73d1a6 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] No waiting events found dispatching network-vif-plugged-c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:52:10 user nova-compute[75672]: WARNING nova.compute.manager [req-2aa02992-372a-4c7e-a6b4-4386e2f7ac22 req-639d981d-ee0e-46d7-80d0-92e21f73d1a6 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Received unexpected event network-vif-plugged-c1570a44-7d9b-4e09-9005-cd6fd016a602 for instance with vm_state building and task_state spawning.
Nov 30 12:52:10 user nova-compute[75672]: INFO nova.compute.manager [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 30 12:52:10 user nova-compute[75672]: DEBUG nova.compute.manager [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:52:10 user nova-compute[75672]: INFO nova.compute.manager [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Took 6.61 seconds to build instance.
Nov 30 12:52:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-95563131-2859-4f21-8035-58b7dd6cdff3 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cd6672f6-3d59-4311-b213-aee62517f868" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.715s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:52:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Acquiring lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:35 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:52:36 user nova-compute[75672]: INFO nova.compute.claims [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Claim successful on node user
Nov 30 12:52:36 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:52:36 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:52:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:52:36 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Creating image(s)
Nov 30 12:52:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "/opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "/opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG nova.policy [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1b93fcc33344132916806925c5f2886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614cd4f3e28445e96017eae9d962db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:36 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.305s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk 1073741824" returned: 0 in 0.061s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Cannot resize image /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Ensure instance console log exists: /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "87744aef-7e32-475b-907e-e30702d083bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Successfully created port: c15f3413-9806-48cf-8a63-0dc556eb7d8a {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:52:37 user nova-compute[75672]: INFO nova.compute.manager [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Terminating instance
Nov 30 12:52:37 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-36c90a9f-a199-4616-a630-2eb6cf432d40 req-b441bdcb-f197-4cab-9a31-2360549c96ba service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-vif-unplugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-36c90a9f-a199-4616-a630-2eb6cf432d40 req-b441bdcb-f197-4cab-9a31-2360549c96ba service nova] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-36c90a9f-a199-4616-a630-2eb6cf432d40 req-b441bdcb-f197-4cab-9a31-2360549c96ba service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-36c90a9f-a199-4616-a630-2eb6cf432d40 req-b441bdcb-f197-4cab-9a31-2360549c96ba service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-36c90a9f-a199-4616-a630-2eb6cf432d40 req-b441bdcb-f197-4cab-9a31-2360549c96ba service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] No waiting events found dispatching network-vif-unplugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:52:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-36c90a9f-a199-4616-a630-2eb6cf432d40 req-b441bdcb-f197-4cab-9a31-2360549c96ba service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-vif-unplugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Successfully updated port: c15f3413-9806-48cf-8a63-0dc556eb7d8a {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Acquiring lock "refresh_cache-9d7771dc-198f-4f4f-9083-60bea2dd80fe" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Acquired lock "refresh_cache-9d7771dc-198f-4f4f-9083-60bea2dd80fe" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-d54a1ee4-059b-41be-baf0-c185ac18770f req-a03c1d15-5d82-435b-8ef6-eaa98327dd0b service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Received event network-changed-c15f3413-9806-48cf-8a63-0dc556eb7d8a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-d54a1ee4-059b-41be-baf0-c185ac18770f req-a03c1d15-5d82-435b-8ef6-eaa98327dd0b service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Refreshing instance network info cache due to event network-changed-c15f3413-9806-48cf-8a63-0dc556eb7d8a. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d54a1ee4-059b-41be-baf0-c185ac18770f req-a03c1d15-5d82-435b-8ef6-eaa98327dd0b service nova] Acquiring lock "refresh_cache-9d7771dc-198f-4f4f-9083-60bea2dd80fe" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:52:38 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Instance destroyed successfully.
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.objects.instance [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lazy-loading 'resources' on Instance uuid 87744aef-7e32-475b-907e-e30702d083bf {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1985842296',display_name='tempest-ServerStableDeviceRescueTest-server-1985842296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1985842296',id=35,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU4niv4fKwifKIbusrskjKw+QLKV7egXGWJ857PxXbYP3fg26Vzmu8p/sI061Q4sngY65sMaHhlDzQGbahnpFyqwvkTF2KQYtYaGXFjuu4zchSAXVVqtz2l6VqNailjUw==',key_name='tempest-keypair-1811480596',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:49:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a37bdd4c8e1345209fa532c6fd9496dd',ramdisk_id='',reservation_id='r-zhq3ccpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-752573724',owner_user_name='tempest-ServerStableDeviceRescueTest-752573724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5019d84b3bb436f9125865467cbb702',uuid=87744aef-7e32-475b-907e-e30702d083bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Converting VIF {"id": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "address": "fa:16:3e:2f:73:38", "network": {"id": "10275d04-9a7c-40d7-9df0-3aa724a7b817", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1487124179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a37bdd4c8e1345209fa532c6fd9496dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cf9cd-ce", "ovs_interfaceid": "fb7cf9cd-ce27-4327-97ad-1c2692de57e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:73:38,bridge_name='br-int',has_traffic_filtering=True,id=fb7cf9cd-ce27-4327-97ad-1c2692de57e7,network=Network(10275d04-9a7c-40d7-9df0-3aa724a7b817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cf9cd-ce') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG os_vif [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:73:38,bridge_name='br-int',has_traffic_filtering=True,id=fb7cf9cd-ce27-4327-97ad-1c2692de57e7,network=Network(10275d04-9a7c-40d7-9df0-3aa724a7b817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cf9cd-ce') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb7cf9cd-ce, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f727753-b560-4e1f-aae0-70b3af7126a1) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:52:38 user nova-compute[75672]: INFO os_vif [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:73:38,bridge_name='br-int',has_traffic_filtering=True,id=fb7cf9cd-ce27-4327-97ad-1c2692de57e7,network=Network(10275d04-9a7c-40d7-9df0-3aa724a7b817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cf9cd-ce')
Nov 30 12:52:38 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Deleting instance files /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf_del
Nov 30 12:52:38 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Deletion of /opt/stack/data/nova/instances/87744aef-7e32-475b-907e-e30702d083bf_del complete
Nov 30 12:52:38 user nova-compute[75672]: INFO nova.compute.manager [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 30 12:52:38 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 87744aef-7e32-475b-907e-e30702d083bf] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Updating instance_info_cache with network_info: [{"id": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "address": "fa:16:3e:19:f8:f0", "network": {"id": "e46deca7-df83-4aa0-a78c-b56d6a38f955", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "08b033eb830b4d89adeaa6b52664498e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15f3413-98", "ovs_interfaceid": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Releasing lock "refresh_cache-9d7771dc-198f-4f4f-9083-60bea2dd80fe" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Instance network_info: |[{"id": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "address": "fa:16:3e:19:f8:f0", "network": {"id": "e46deca7-df83-4aa0-a78c-b56d6a38f955", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "08b033eb830b4d89adeaa6b52664498e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15f3413-98", "ovs_interfaceid": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d54a1ee4-059b-41be-baf0-c185ac18770f req-a03c1d15-5d82-435b-8ef6-eaa98327dd0b service nova] Acquired lock "refresh_cache-9d7771dc-198f-4f4f-9083-60bea2dd80fe" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.network.neutron [req-d54a1ee4-059b-41be-baf0-c185ac18770f req-a03c1d15-5d82-435b-8ef6-eaa98327dd0b service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Refreshing network info cache for port c15f3413-9806-48cf-8a63-0dc556eb7d8a {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Start _get_guest_xml network_info=[{"id": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "address": "fa:16:3e:19:f8:f0", "network": {"id": "e46deca7-df83-4aa0-a78c-b56d6a38f955", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "08b033eb830b4d89adeaa6b52664498e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15f3413-98", "ovs_interfaceid": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:52:38 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:52:38 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:52:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1480971532',display_name='tempest-VolumesNegativeTest-instance-1480971532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1480971532',id=45,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c614cd4f3e28445e96017eae9d962db8',ramdisk_id='',reservation_id='r-4raupa0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2040586798',owner_user_name='tempest-VolumesNegativeTest-2040586798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:52:37Z,user_data=None,user_id='d1b93fcc33344132916806925c5f2886',uuid=9d7771dc-198f-4f4f-9083-60bea2dd80fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "address": "fa:16:3e:19:f8:f0", "network": {"id": "e46deca7-df83-4aa0-a78c-b56d6a38f955", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "08b033eb830b4d89adeaa6b52664498e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15f3413-98", "ovs_interfaceid": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Converting VIF {"id": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "address": "fa:16:3e:19:f8:f0", "network": {"id": "e46deca7-df83-4aa0-a78c-b56d6a38f955", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "08b033eb830b4d89adeaa6b52664498e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15f3413-98", "ovs_interfaceid": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:f8:f0,bridge_name='br-int',has_traffic_filtering=True,id=c15f3413-9806-48cf-8a63-0dc556eb7d8a,network=Network(e46deca7-df83-4aa0-a78c-b56d6a38f955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc15f3413-98') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.objects.instance [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d7771dc-198f-4f4f-9083-60bea2dd80fe {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:52:38 user nova-compute[75672]:   <uuid>9d7771dc-198f-4f4f-9083-60bea2dd80fe</uuid>
Nov 30 12:52:38 user nova-compute[75672]:   <name>instance-0000002d</name>
Nov 30 12:52:38 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:52:38 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:52:38 user nova-compute[75672]:   <metadata>
Nov 30 12:52:38 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:52:38 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:52:38 user nova-compute[75672]:       <nova:name>tempest-VolumesNegativeTest-instance-1480971532</nova:name>
Nov 30 12:52:38 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:52:38</nova:creationTime>
Nov 30 12:52:38 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:52:38 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:52:38 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:52:38 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:52:38 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:52:38 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:52:38 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:52:38 user nova-compute[75672]:       <nova:owner>
Nov 30 12:52:38 user nova-compute[75672]:         <nova:user uuid="d1b93fcc33344132916806925c5f2886">tempest-VolumesNegativeTest-2040586798-project-member</nova:user>
Nov 30 12:52:38 user nova-compute[75672]:         <nova:project uuid="c614cd4f3e28445e96017eae9d962db8">tempest-VolumesNegativeTest-2040586798</nova:project>
Nov 30 12:52:38 user nova-compute[75672]:       </nova:owner>
Nov 30 12:52:38 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:52:38 user nova-compute[75672]:       <nova:ports>
Nov 30 12:52:38 user nova-compute[75672]:         <nova:port uuid="c15f3413-9806-48cf-8a63-0dc556eb7d8a">
Nov 30 12:52:38 user nova-compute[75672]:           <nova:ip type="fixed" address="192.168.233.76" ipVersion="4"/>
Nov 30 12:52:38 user nova-compute[75672]:         </nova:port>
Nov 30 12:52:38 user nova-compute[75672]:       </nova:ports>
Nov 30 12:52:38 user nova-compute[75672]:     </nova:instance>
Nov 30 12:52:38 user nova-compute[75672]:   </metadata>
Nov 30 12:52:38 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:52:38 user nova-compute[75672]:     <system>
Nov 30 12:52:38 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:52:38 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:52:38 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:52:38 user nova-compute[75672]:       <entry name="serial">9d7771dc-198f-4f4f-9083-60bea2dd80fe</entry>
Nov 30 12:52:38 user nova-compute[75672]:       <entry name="uuid">9d7771dc-198f-4f4f-9083-60bea2dd80fe</entry>
Nov 30 12:52:38 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:52:38 user nova-compute[75672]:     </system>
Nov 30 12:52:38 user nova-compute[75672]:   </sysinfo>
Nov 30 12:52:38 user nova-compute[75672]:   <os>
Nov 30 12:52:38 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:52:38 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:52:38 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:52:38 user nova-compute[75672]:   </os>
Nov 30 12:52:38 user nova-compute[75672]:   <features>
Nov 30 12:52:38 user nova-compute[75672]:     <acpi/>
Nov 30 12:52:38 user nova-compute[75672]:     <apic/>
Nov 30 12:52:38 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:52:38 user nova-compute[75672]:   </features>
Nov 30 12:52:38 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:52:38 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:52:38 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:52:38 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:52:38 user nova-compute[75672]:   </clock>
Nov 30 12:52:38 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:52:38 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:52:38 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:52:38 user nova-compute[75672]:   </cpu>
Nov 30 12:52:38 user nova-compute[75672]:   <devices>
Nov 30 12:52:38 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:52:38 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:52:38 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk"/>
Nov 30 12:52:38 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:52:38 user nova-compute[75672]:     </disk>
Nov 30 12:52:38 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:52:38 user nova-compute[75672]:       <mac address="fa:16:3e:19:f8:f0"/>
Nov 30 12:52:38 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:52:38 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:52:38 user nova-compute[75672]:       <target dev="tapc15f3413-98"/>
Nov 30 12:52:38 user nova-compute[75672]:     </interface>
Nov 30 12:52:38 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:52:38 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/console.log" append="off"/>
Nov 30 12:52:38 user nova-compute[75672]:     </serial>
Nov 30 12:52:38 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:52:38 user nova-compute[75672]:     <video>
Nov 30 12:52:38 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:52:38 user nova-compute[75672]:     </video>
Nov 30 12:52:38 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:52:38 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:52:38 user nova-compute[75672]:     </rng>
Nov 30 12:52:38 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:52:38 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:52:38 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:52:38 user nova-compute[75672]:     </memballoon>
Nov 30 12:52:38 user nova-compute[75672]:   </devices>
Nov 30 12:52:38 user nova-compute[75672]: </domain>
Nov 30 12:52:38 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:52:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1480971532',display_name='tempest-VolumesNegativeTest-instance-1480971532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1480971532',id=45,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c614cd4f3e28445e96017eae9d962db8',ramdisk_id='',reservation_id='r-4raupa0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2040586798',owner_user_name='tempest-VolumesNegativeTest-2040586798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:52:37Z,user_data=None,user_id='d1b93fcc33344132916806925c5f2886',uuid=9d7771dc-198f-4f4f-9083-60bea2dd80fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "address": "fa:16:3e:19:f8:f0", "network": {"id": "e46deca7-df83-4aa0-a78c-b56d6a38f955", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "08b033eb830b4d89adeaa6b52664498e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15f3413-98", "ovs_interfaceid": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Converting VIF {"id": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "address": "fa:16:3e:19:f8:f0", "network": {"id": "e46deca7-df83-4aa0-a78c-b56d6a38f955", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "08b033eb830b4d89adeaa6b52664498e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15f3413-98", "ovs_interfaceid": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:f8:f0,bridge_name='br-int',has_traffic_filtering=True,id=c15f3413-9806-48cf-8a63-0dc556eb7d8a,network=Network(e46deca7-df83-4aa0-a78c-b56d6a38f955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc15f3413-98') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG os_vif [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:f8:f0,bridge_name='br-int',has_traffic_filtering=True,id=c15f3413-9806-48cf-8a63-0dc556eb7d8a,network=Network(e46deca7-df83-4aa0-a78c-b56d6a38f955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc15f3413-98') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1e3fe25-fa8c-5c30-bd26-78ecfec52f4b', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc15f3413-98, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc15f3413-98, col_values=(('qos', UUID('6203fb63-d1b3-4160-85e5-a3efba638b52')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc15f3413-98, col_values=(('external_ids', {'iface-id': 'c15f3413-9806-48cf-8a63-0dc556eb7d8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:f8:f0', 'vm-uuid': '9d7771dc-198f-4f4f-9083-60bea2dd80fe'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:38 user nova-compute[75672]: INFO os_vif [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:f8:f0,bridge_name='br-int',has_traffic_filtering=True,id=c15f3413-9806-48cf-8a63-0dc556eb7d8a,network=Network(e46deca7-df83-4aa0-a78c-b56d6a38f955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc15f3413-98')
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:52:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] No VIF found with MAC fa:16:3e:19:f8:f0, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:52:39 user nova-compute[75672]: DEBUG nova.network.neutron [req-d54a1ee4-059b-41be-baf0-c185ac18770f req-a03c1d15-5d82-435b-8ef6-eaa98327dd0b service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Updated VIF entry in instance network info cache for port c15f3413-9806-48cf-8a63-0dc556eb7d8a. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:52:39 user nova-compute[75672]: DEBUG nova.network.neutron [req-d54a1ee4-059b-41be-baf0-c185ac18770f req-a03c1d15-5d82-435b-8ef6-eaa98327dd0b service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Updating instance_info_cache with network_info: [{"id": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "address": "fa:16:3e:19:f8:f0", "network": {"id": "e46deca7-df83-4aa0-a78c-b56d6a38f955", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "08b033eb830b4d89adeaa6b52664498e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15f3413-98", "ovs_interfaceid": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:52:39 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:52:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d54a1ee4-059b-41be-baf0-c185ac18770f req-a03c1d15-5d82-435b-8ef6-eaa98327dd0b service nova] Releasing lock "refresh_cache-9d7771dc-198f-4f4f-9083-60bea2dd80fe" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:52:39 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Took 0.64 seconds to deallocate network for instance.
Nov 30 12:52:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-586d6bf2-6554-47f6-b987-687e04952f52 req-38f4d548-e8c9-478c-8c45-7a00218573cf service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-vif-deleted-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:52:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:39 user nova-compute[75672]: DEBUG nova.compute.manager [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:52:39 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:52:39 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:52:39 user nova-compute[75672]: INFO nova.compute.manager [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] instance snapshotting
Nov 30 12:52:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:39 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Deleted allocations for instance 87744aef-7e32-475b-907e-e30702d083bf
Nov 30 12:52:39 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Beginning live snapshot process
Nov 30 12:52:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f4ee8ee0-168d-47e5-8b15-12892da20c14 tempest-ServerStableDeviceRescueTest-752573724 tempest-ServerStableDeviceRescueTest-752573724-project-member] Lock "87744aef-7e32-475b-907e-e30702d083bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.254s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json -f qcow2 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-64df1040-cc9b-4882-a90a-0e899e6e3e88 req-ecf288ed-48a7-47ba-bca0-db7612cdbf9c service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-64df1040-cc9b-4882-a90a-0e899e6e3e88 req-ecf288ed-48a7-47ba-bca0-db7612cdbf9c service nova] Acquiring lock "87744aef-7e32-475b-907e-e30702d083bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-64df1040-cc9b-4882-a90a-0e899e6e3e88 req-ecf288ed-48a7-47ba-bca0-db7612cdbf9c service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-64df1040-cc9b-4882-a90a-0e899e6e3e88 req-ecf288ed-48a7-47ba-bca0-db7612cdbf9c service nova] Lock "87744aef-7e32-475b-907e-e30702d083bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG nova.compute.manager [req-64df1040-cc9b-4882-a90a-0e899e6e3e88 req-ecf288ed-48a7-47ba-bca0-db7612cdbf9c service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] No waiting events found dispatching network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:52:40 user nova-compute[75672]: WARNING nova.compute.manager [req-64df1040-cc9b-4882-a90a-0e899e6e3e88 req-ecf288ed-48a7-47ba-bca0-db7612cdbf9c service nova] [instance: 87744aef-7e32-475b-907e-e30702d083bf] Received unexpected event network-vif-plugged-fb7cf9cd-ce27-4327-97ad-1c2692de57e7 for instance with vm_state deleted and task_state None.
Nov 30 12:52:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json -f qcow2 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.281s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7pvv36_9/2553b012a88e400885ab4cf360d439ef.delta 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7pvv36_9/2553b012a88e400885ab4cf360d439ef.delta 1073741824" returned: 0 in 0.061s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:40 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 12:52:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:52:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:41 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75672) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 12:52:41 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 12:52:42 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:52:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7pvv36_9/2553b012a88e400885ab4cf360d439ef.delta /opt/stack/data/nova/instances/snapshots/tmp7pvv36_9/2553b012a88e400885ab4cf360d439ef {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-0c73864b-3aba-49b8-aa12-52e9fdf2d02f req-e0a62e34-43b7-460a-9474-651b7d0c6d90 service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Received event network-vif-plugged-c15f3413-9806-48cf-8a63-0dc556eb7d8a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:52:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c73864b-3aba-49b8-aa12-52e9fdf2d02f req-e0a62e34-43b7-460a-9474-651b7d0c6d90 service nova] Acquiring lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c73864b-3aba-49b8-aa12-52e9fdf2d02f req-e0a62e34-43b7-460a-9474-651b7d0c6d90 service nova] Lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c73864b-3aba-49b8-aa12-52e9fdf2d02f req-e0a62e34-43b7-460a-9474-651b7d0c6d90 service nova] Lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-0c73864b-3aba-49b8-aa12-52e9fdf2d02f req-e0a62e34-43b7-460a-9474-651b7d0c6d90 service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] No waiting events found dispatching network-vif-plugged-c15f3413-9806-48cf-8a63-0dc556eb7d8a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:52:42 user nova-compute[75672]: WARNING nova.compute.manager [req-0c73864b-3aba-49b8-aa12-52e9fdf2d02f req-e0a62e34-43b7-460a-9474-651b7d0c6d90 service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Received unexpected event network-vif-plugged-c15f3413-9806-48cf-8a63-0dc556eb7d8a for instance with vm_state building and task_state spawning.
Nov 30 12:52:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-0c73864b-3aba-49b8-aa12-52e9fdf2d02f req-e0a62e34-43b7-460a-9474-651b7d0c6d90 service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Received event network-vif-plugged-c15f3413-9806-48cf-8a63-0dc556eb7d8a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:52:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c73864b-3aba-49b8-aa12-52e9fdf2d02f req-e0a62e34-43b7-460a-9474-651b7d0c6d90 service nova] Acquiring lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c73864b-3aba-49b8-aa12-52e9fdf2d02f req-e0a62e34-43b7-460a-9474-651b7d0c6d90 service nova] Lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0c73864b-3aba-49b8-aa12-52e9fdf2d02f req-e0a62e34-43b7-460a-9474-651b7d0c6d90 service nova] Lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-0c73864b-3aba-49b8-aa12-52e9fdf2d02f req-e0a62e34-43b7-460a-9474-651b7d0c6d90 service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] No waiting events found dispatching network-vif-plugged-c15f3413-9806-48cf-8a63-0dc556eb7d8a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:52:42 user nova-compute[75672]: WARNING nova.compute.manager [req-0c73864b-3aba-49b8-aa12-52e9fdf2d02f req-e0a62e34-43b7-460a-9474-651b7d0c6d90 service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Received unexpected event network-vif-plugged-c15f3413-9806-48cf-8a63-0dc556eb7d8a for instance with vm_state building and task_state spawning.
Nov 30 12:52:42 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7pvv36_9/2553b012a88e400885ab4cf360d439ef.delta /opt/stack/data/nova/instances/snapshots/tmp7pvv36_9/2553b012a88e400885ab4cf360d439ef" returned: 0 in 0.974s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:43 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Snapshot extracted, beginning image upload
Nov 30 12:52:43 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Skipping network cache update for instance because it is Building. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.objects.instance [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lazy-loading 'info_cache' on Instance uuid 50ef3313-795a-4797-9a3e-5e85f61d7631 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:52:43 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Instance spawned successfully.
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:52:43 user nova-compute[75672]: INFO nova.compute.manager [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Took 7.15 seconds to spawn the instance on the hypervisor.
Nov 30 12:52:43 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:52:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:43 user nova-compute[75672]: INFO nova.compute.manager [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Took 7.89 seconds to build instance.
Nov 30 12:52:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b1deab32-bcfa-4f0a-a6a0-20e566747d4c tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.979s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:44 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Updating instance_info_cache with network_info: [{"id": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "address": "fa:16:3e:ce:b3:ac", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b67acff-06", "ovs_interfaceid": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:52:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:52:44 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:52:45 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:52:45 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:52:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:45 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:52:45 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Snapshot image upload complete
Nov 30 12:52:45 user nova-compute[75672]: INFO nova.compute.manager [None req-29da4239-6a59-4f5d-9db3-cc896584cae0 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Took 5.99 seconds to snapshot the instance on the hypervisor.
Nov 30 12:52:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:52:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:52:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:52:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:49 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:52:49 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7734MB free_disk=24.818199157714844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance c00b64bd-8011-4609-8953-315f1e655930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 498d231e-d0be-4ea5-9024-669a978b8292 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 24033f28-8bf7-4d04-ba4d-88537ad30f10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 5cf89c9b-a2ba-4588-a2ea-67917b994afb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance cd6672f6-3d59-4311-b213-aee62517f868 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 9d7771dc-198f-4f4f-9083-60bea2dd80fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing inventories for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating ProviderTree inventory for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating inventory in ProviderTree for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing aggregate associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, aggregates: None {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing trait associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.841s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:49 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:52:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-1ace8b0d-4044-41bc-b555-181c72cf7803 req-f3671733-659f-40db-9b03-2bd52107eb37 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Received event network-changed-c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:52:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-1ace8b0d-4044-41bc-b555-181c72cf7803 req-f3671733-659f-40db-9b03-2bd52107eb37 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Refreshing instance network info cache due to event network-changed-c949af34-396a-4e42-917f-e555edc66487. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:52:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1ace8b0d-4044-41bc-b555-181c72cf7803 req-f3671733-659f-40db-9b03-2bd52107eb37 service nova] Acquiring lock "refresh_cache-24033f28-8bf7-4d04-ba4d-88537ad30f10" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:52:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1ace8b0d-4044-41bc-b555-181c72cf7803 req-f3671733-659f-40db-9b03-2bd52107eb37 service nova] Acquired lock "refresh_cache-24033f28-8bf7-4d04-ba4d-88537ad30f10" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:52:51 user nova-compute[75672]: DEBUG nova.network.neutron [req-1ace8b0d-4044-41bc-b555-181c72cf7803 req-f3671733-659f-40db-9b03-2bd52107eb37 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Refreshing network info cache for port c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:52:52 user nova-compute[75672]: DEBUG nova.network.neutron [req-1ace8b0d-4044-41bc-b555-181c72cf7803 req-f3671733-659f-40db-9b03-2bd52107eb37 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Updated VIF entry in instance network info cache for port c949af34-396a-4e42-917f-e555edc66487. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:52:52 user nova-compute[75672]: DEBUG nova.network.neutron [req-1ace8b0d-4044-41bc-b555-181c72cf7803 req-f3671733-659f-40db-9b03-2bd52107eb37 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Updating instance_info_cache with network_info: [{"id": "c949af34-396a-4e42-917f-e555edc66487", "address": "fa:16:3e:65:e5:8b", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc949af34-39", "ovs_interfaceid": "c949af34-396a-4e42-917f-e555edc66487", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:52:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1ace8b0d-4044-41bc-b555-181c72cf7803 req-f3671733-659f-40db-9b03-2bd52107eb37 service nova] Releasing lock "refresh_cache-24033f28-8bf7-4d04-ba4d-88537ad30f10" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:52:52 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:52:52 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:52:52 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:52:52 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:52:52 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 12:52:52 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] There are 0 instances to clean {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG nova.objects.instance [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lazy-loading 'flavor' on Instance uuid 24033f28-8bf7-4d04-ba4d-88537ad30f10 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:52:53 user nova-compute[75672]: INFO nova.compute.manager [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Attaching volume afd479e2-3e2f-4c60-acbd-232fbe68aae4 to /dev/vdb
Nov 30 12:52:53 user nova-compute[75672]: DEBUG os_brick.utils [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d261edb-b5fe-4c0e-8a13-9d2d8eb57957]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1962662-d7e1-40f8-ad2c-a2000e872bd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f2b157-5f16-4c31-9144-1afb08f106e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9662e9d2-30cb-4983-9bdd-8f5b185cdbaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:52:53 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:52:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b4e3d9-b392-408e-97eb-5fd1fbb1e386]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG os_brick.utils [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:52:53 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Updating existing volume attachment record: ce6fe482-c27d-490e-bb38-e28231ffa531 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:52:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:52:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:52:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:52:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:52:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:52:57 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:52:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:01 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:53:01 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75672) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 12:53:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:53:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WeAsIBJN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:53:02 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:53:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:53:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:53:02 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:53:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:53:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:53:02 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:53:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c7e818-3c25-4b2c-88a3-2d161a098398]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:53:02 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:53:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8216f0e8-acaf-4a7b-bd36-e6bd669af055]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4] added
Nov 30 12:53:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[484ba73d-99b7-4528-aeba-728f70eef2d2]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dab8daf-4dd8-4587-811d-886689ad1bfc]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WeAsIBJN {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WeAsIBJN" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[21581085-d6ae-4054-aa1b-c64a7b66af8b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WeAsIBJN'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b2613c-b9ac-4148-af01-ebd5e1267bbc]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[53251e7d-2b5c-4dfe-8d80-24b4b150e541]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:53:03 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:53:03 user nova-compute[75672]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)
Nov 30 12:53:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:53:03 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:53:03 user nova-compute[75672]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)
Nov 30 12:53:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacedb17-b318-4682-ad5e-78e8f364d9e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4, portal: 172.16.0.220,3260]
Nov 30 12:53:03 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4, portal: 172.16.0.220,3260] successful.
Nov 30 12:53:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a9e5d8-a6e3-466c-8075-3e8c32644bd7]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f08642e-0280-47d5-94fe-ec677c8ac2e9]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:53:03 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:53:03 user nova-compute[75672]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)
Nov 30 12:53:03 user nova-compute[75672]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 (non-flash)
Nov 30 12:53:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:53:03 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:53:03 user nova-compute[75672]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)
Nov 30 12:53:03 user nova-compute[75672]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 (non-flash)
Nov 30 12:53:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf1b32a-a477-4a88-ad98-26c93bec847d]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:53:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WeAsIBJN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:53:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:04 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:53:04 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23362633834343561', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:53:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362633834343561', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:53:04 user nova-compute[75672]: DEBUG nova.objects.instance [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lazy-loading 'flavor' on Instance uuid 24033f28-8bf7-4d04-ba4d-88537ad30f10 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:53:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:53:04 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:53:04 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 12:53:04 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:53:04 user nova-compute[75672]:   <serial>afd479e2-3e2f-4c60-acbd-232fbe68aae4</serial>
Nov 30 12:53:04 user nova-compute[75672]: </disk>
Nov 30 12:53:04 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:53:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:53:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:53:04 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] No VIF found with MAC fa:16:3e:65:e5:8b, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:53:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-27c58706-4c32-4de3-809e-fb2080568adb tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.250s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:06 user nova-compute[75672]: INFO nova.compute.manager [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Detaching volume afd479e2-3e2f-4c60-acbd-232fbe68aae4
Nov 30 12:53:06 user nova-compute[75672]: INFO nova.virt.block_device [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Attempting to driver detach volume afd479e2-3e2f-4c60-acbd-232fbe68aae4 from mountpoint /dev/vdb
Nov 30 12:53:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Attempting to detach device vdb from instance 24033f28-8bf7-4d04-ba4d-88537ad30f10 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:53:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:53:06 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:53:06 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 12:53:06 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:53:06 user nova-compute[75672]:   <serial>afd479e2-3e2f-4c60-acbd-232fbe68aae4</serial>
Nov 30 12:53:06 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:53:06 user nova-compute[75672]: </disk>
Nov 30 12:53:06 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:53:06 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Successfully detached device vdb from instance 24033f28-8bf7-4d04-ba4d-88537ad30f10 from the persistent domain config.
Nov 30 12:53:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24033f28-8bf7-4d04-ba4d-88537ad30f10 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:53:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:53:06 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:53:06 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 12:53:06 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:53:06 user nova-compute[75672]:   <serial>afd479e2-3e2f-4c60-acbd-232fbe68aae4</serial>
Nov 30 12:53:06 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:53:06 user nova-compute[75672]: </disk>
Nov 30 12:53:06 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:53:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24033f28-8bf7-4d04-ba4d-88537ad30f10 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:53:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-d84f89b3-2d5f-47d7-9817-8cae77a107aa req-0c43c13d-a7a8-4bd2-95f0-81522972bc0c service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Received event network-changed-cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:53:08 user nova-compute[75672]: DEBUG nova.compute.manager [req-d84f89b3-2d5f-47d7-9817-8cae77a107aa req-0c43c13d-a7a8-4bd2-95f0-81522972bc0c service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Refreshing instance network info cache due to event network-changed-cf838815-138a-4d8d-9280-f9312c7c10fc. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:53:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d84f89b3-2d5f-47d7-9817-8cae77a107aa req-0c43c13d-a7a8-4bd2-95f0-81522972bc0c service nova] Acquiring lock "refresh_cache-5cf89c9b-a2ba-4588-a2ea-67917b994afb" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:53:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d84f89b3-2d5f-47d7-9817-8cae77a107aa req-0c43c13d-a7a8-4bd2-95f0-81522972bc0c service nova] Acquired lock "refresh_cache-5cf89c9b-a2ba-4588-a2ea-67917b994afb" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:53:08 user nova-compute[75672]: DEBUG nova.network.neutron [req-d84f89b3-2d5f-47d7-9817-8cae77a107aa req-0c43c13d-a7a8-4bd2-95f0-81522972bc0c service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Refreshing network info cache for port cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-d84f89b3-2d5f-47d7-9817-8cae77a107aa req-0c43c13d-a7a8-4bd2-95f0-81522972bc0c service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Updated VIF entry in instance network info cache for port cf838815-138a-4d8d-9280-f9312c7c10fc. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-d84f89b3-2d5f-47d7-9817-8cae77a107aa req-0c43c13d-a7a8-4bd2-95f0-81522972bc0c service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Updating instance_info_cache with network_info: [{"id": "cf838815-138a-4d8d-9280-f9312c7c10fc", "address": "fa:16:3e:df:ec:8b", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf838815-13", "ovs_interfaceid": "cf838815-138a-4d8d-9280-f9312c7c10fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d84f89b3-2d5f-47d7-9817-8cae77a107aa req-0c43c13d-a7a8-4bd2-95f0-81522972bc0c service nova] Releasing lock "refresh_cache-5cf89c9b-a2ba-4588-a2ea-67917b994afb" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-e912e10f-81b8-4ea7-84b2-274cac7de807 req-2345cb8f-592a-46a3-a208-ef08905250ca service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Received event network-changed-cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-e912e10f-81b8-4ea7-84b2-274cac7de807 req-2345cb8f-592a-46a3-a208-ef08905250ca service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Refreshing instance network info cache due to event network-changed-cf838815-138a-4d8d-9280-f9312c7c10fc. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e912e10f-81b8-4ea7-84b2-274cac7de807 req-2345cb8f-592a-46a3-a208-ef08905250ca service nova] Acquiring lock "refresh_cache-5cf89c9b-a2ba-4588-a2ea-67917b994afb" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e912e10f-81b8-4ea7-84b2-274cac7de807 req-2345cb8f-592a-46a3-a208-ef08905250ca service nova] Acquired lock "refresh_cache-5cf89c9b-a2ba-4588-a2ea-67917b994afb" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-e912e10f-81b8-4ea7-84b2-274cac7de807 req-2345cb8f-592a-46a3-a208-ef08905250ca service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Refreshing network info cache for port cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:09 user nova-compute[75672]: INFO nova.compute.manager [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Terminating instance
Nov 30 12:53:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-6403c0e8-13f9-49a3-af09-2851bbadda4d req-9aaa33f0-4f46-4fcf-8c91-96c9174c0062 service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Received event network-vif-unplugged-cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6403c0e8-13f9-49a3-af09-2851bbadda4d req-9aaa33f0-4f46-4fcf-8c91-96c9174c0062 service nova] Acquiring lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6403c0e8-13f9-49a3-af09-2851bbadda4d req-9aaa33f0-4f46-4fcf-8c91-96c9174c0062 service nova] Lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6403c0e8-13f9-49a3-af09-2851bbadda4d req-9aaa33f0-4f46-4fcf-8c91-96c9174c0062 service nova] Lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-6403c0e8-13f9-49a3-af09-2851bbadda4d req-9aaa33f0-4f46-4fcf-8c91-96c9174c0062 service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] No waiting events found dispatching network-vif-unplugged-cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-6403c0e8-13f9-49a3-af09-2851bbadda4d req-9aaa33f0-4f46-4fcf-8c91-96c9174c0062 service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Received event network-vif-unplugged-cf838815-138a-4d8d-9280-f9312c7c10fc for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:10 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Instance destroyed successfully.
Nov 30 12:53:10 user nova-compute[75672]: DEBUG nova.objects.instance [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lazy-loading 'resources' on Instance uuid 5cf89c9b-a2ba-4588-a2ea-67917b994afb {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-500135060',display_name='tempest-TestVolumeBootPattern-server-500135060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-500135060',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/tiWnKVjyQ+YQ0wPEgFpD4sUWbk2GMRtR0fUhMrrhWzqEfZseqSV3bBKpPI9FNVcBh3EJSPDcri0dXJ24ST3AlMd1Z9vj5ezFGg5LMAjAiHzircmeHJyIgzk+4EYWw6A==',key_name='tempest-TestVolumeBootPattern-1453287901',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:51:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-9vdyk083',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:51:38Z,user_data=None,user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=5cf89c9b-a2ba-4588-a2ea-67917b994afb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf838815-138a-4d8d-9280-f9312c7c10fc", "address": "fa:16:3e:df:ec:8b", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf838815-13", "ovs_interfaceid": "cf838815-138a-4d8d-9280-f9312c7c10fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "cf838815-138a-4d8d-9280-f9312c7c10fc", "address": "fa:16:3e:df:ec:8b", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf838815-13", "ovs_interfaceid": "cf838815-138a-4d8d-9280-f9312c7c10fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=cf838815-138a-4d8d-9280-f9312c7c10fc,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf838815-13') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_vif [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=cf838815-138a-4d8d-9280-f9312c7c10fc,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf838815-13') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf838815-13, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9594537e-d340-43e8-a43b-85506503f239) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:53:10 user nova-compute[75672]: INFO os_vif [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=cf838815-138a-4d8d-9280-f9312c7c10fc,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf838815-13')
Nov 30 12:53:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zSeJdhxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:53:10 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4adb31-e3ea-4b72-b5f0-5b4133fbb5c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:53:10 user nova-compute[75672]: No targets found.
Nov 30 12:53:10 user nova-compute[75672]: iSNS:
Nov 30 12:53:10 user nova-compute[75672]: No targets found.
Nov 30 12:53:10 user nova-compute[75672]: STATIC:
Nov 30 12:53:10 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b
Nov 30 12:53:10 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:53:10 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:53:10 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:53:10 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:53:10 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:53:10 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf
Nov 30 12:53:10 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:53:10 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:53:10 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4
Nov 30 12:53:10 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:53:10 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:53:10 user nova-compute[75672]: FIRMWARE:
Nov 30 12:53:10 user nova-compute[75672]: No targets found.
Nov 30 12:53:10 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:53:10 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:53:10 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb08234-e277-4273-98c8-23aaeecd517f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG nova.network.neutron [req-e912e10f-81b8-4ea7-84b2-274cac7de807 req-2345cb8f-592a-46a3-a208-ef08905250ca service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Updated VIF entry in instance network info cache for port cf838815-138a-4d8d-9280-f9312c7c10fc. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG nova.network.neutron [req-e912e10f-81b8-4ea7-84b2-274cac7de807 req-2345cb8f-592a-46a3-a208-ef08905250ca service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Updating instance_info_cache with network_info: [{"id": "cf838815-138a-4d8d-9280-f9312c7c10fc", "address": "fa:16:3e:df:ec:8b", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf838815-13", "ovs_interfaceid": "cf838815-138a-4d8d-9280-f9312c7c10fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fa0358-b711-4f53-b569-653b6bd8652c]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:53:10 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:53:10 user nova-compute[75672]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)
Nov 30 12:53:10 user nova-compute[75672]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 (non-flash)
Nov 30 12:53:10 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:53:10 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:53:10 user nova-compute[75672]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b (non-flash)
Nov 30 12:53:10 user nova-compute[75672]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 (non-flash)
Nov 30 12:53:10 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd413ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b'): ({'sde'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Removing single pathed devices sde {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e912e10f-81b8-4ea7-84b2-274cac7de807 req-2345cb8f-592a-46a3-a208-ef08905250ca service nova] Releasing lock "refresh_cache-5cf89c9b-a2ba-4588-a2ea-67917b994afb" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[952861d8-2b0d-4cbb-bc15-209e09650a56]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8632a91-8d6c-4b8b-af44-8a017af19f05]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flushing IO for device /dev/sde {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd083e1f-8f2a-4570-96f1-9ea1b3c6cedd]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[931dfbb0-f0b5-4059-bf91-f44eca233e0d]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] SCSI volumes sde have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[71105c69-6d28-423a-86b3-dccc490db3fc]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[324caa83-2b94-48d1-870e-dc2995ad5ef2]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b, portal: 172.16.0.220,3260]
Nov 30 12:53:10 user nova-compute[75672]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b, portal: 172.16.0.220,3260] successful.
Nov 30 12:53:10 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa691601-e25e-4809-b28e-13a6e286166b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b43380f-4c8d-4a0c-aa84-141037c15358]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== disconnect_volume: return (341ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:53:10 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Deleting instance files /opt/stack/data/nova/instances/5cf89c9b-a2ba-4588-a2ea-67917b994afb_del
Nov 30 12:53:10 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Deletion of /opt/stack/data/nova/instances/5cf89c9b-a2ba-4588-a2ea-67917b994afb_del complete
Nov 30 12:53:10 user nova-compute[75672]: INFO nova.compute.manager [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 30 12:53:10 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:53:10 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:53:11 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:53:11 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Took 0.39 seconds to deallocate network for instance.
Nov 30 12:53:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-20067194-37a7-45ed-a538-1b9f671e3891 req-d2fcea96-b060-416f-be59-e6d52499568c service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Received event network-vif-deleted-cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:53:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-328e1d89-01ec-4091-8a88-a8d3fe91123a req-0f2b6b83-a4e0-4f04-a3bc-f9bcabc6d52b service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Received event network-vif-plugged-cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:53:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-328e1d89-01ec-4091-8a88-a8d3fe91123a req-0f2b6b83-a4e0-4f04-a3bc-f9bcabc6d52b service nova] Acquiring lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-328e1d89-01ec-4091-8a88-a8d3fe91123a req-0f2b6b83-a4e0-4f04-a3bc-f9bcabc6d52b service nova] Lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-328e1d89-01ec-4091-8a88-a8d3fe91123a req-0f2b6b83-a4e0-4f04-a3bc-f9bcabc6d52b service nova] Lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-328e1d89-01ec-4091-8a88-a8d3fe91123a req-0f2b6b83-a4e0-4f04-a3bc-f9bcabc6d52b service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] No waiting events found dispatching network-vif-plugged-cf838815-138a-4d8d-9280-f9312c7c10fc {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:53:11 user nova-compute[75672]: WARNING nova.compute.manager [req-328e1d89-01ec-4091-8a88-a8d3fe91123a req-0f2b6b83-a4e0-4f04-a3bc-f9bcabc6d52b service nova] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Received unexpected event network-vif-plugged-cf838815-138a-4d8d-9280-f9312c7c10fc for instance with vm_state active and task_state deleting.
Nov 30 12:53:12 user nova-compute[75672]: INFO nova.compute.manager [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 5cf89c9b-a2ba-4588-a2ea-67917b994afb] Took 0.86 seconds to detach 1 volumes for instance.
Nov 30 12:53:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:12 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:53:12 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:53:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:12 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Deleted allocations for instance 5cf89c9b-a2ba-4588-a2ea-67917b994afb
Nov 30 12:53:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-de1f33b0-6a40-42a2-80e0-62adb8a3adaf tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "5cf89c9b-a2ba-4588-a2ea-67917b994afb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.944s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:53:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:27 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 24033f28-8bf7-4d04-ba4d-88537ad30f10 is timed out.
Nov 30 12:53:27 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Successfully detached device vdb from instance 24033f28-8bf7-4d04-ba4d-88537ad30f10 from the live domain config.
Nov 30 12:53:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WeAsIBJN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:53:27 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[710c2bcf-3f91-4eb4-a780-edb8f4e923ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:53:27 user nova-compute[75672]: No targets found.
Nov 30 12:53:27 user nova-compute[75672]: iSNS:
Nov 30 12:53:27 user nova-compute[75672]: No targets found.
Nov 30 12:53:27 user nova-compute[75672]: STATIC:
Nov 30 12:53:27 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:53:27 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:53:27 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:53:27 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf
Nov 30 12:53:27 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:53:27 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:53:27 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4
Nov 30 12:53:27 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:53:27 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:53:27 user nova-compute[75672]: FIRMWARE:
Nov 30 12:53:27 user nova-compute[75672]: No targets found.
Nov 30 12:53:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:53:27 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:53:27 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff416e7c-446e-4152-82bd-b529b297a1a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[21261827-57b4-4a53-82ef-2edcab9607b8]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:53:27 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:53:27 user nova-compute[75672]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 (non-flash)
Nov 30 12:53:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:53:27 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:53:27 user nova-compute[75672]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 (non-flash)
Nov 30 12:53:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd413e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[73426f86-8328-417a-bc2c-6ef721812c9f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b153e2aa-87f5-4fda-b2b8-2f621885817a]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6a1b3c-5f73-44c9-8eda-fb085ca444be]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed6e9fc-1d73-4bd5-aef5-0d35113962c8]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[551a8132-ee15-4968-b7ab-b24ff1473cd5]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fe40c9-7eb5-4a7f-ad94-fe15e801ef27]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4, portal: 172.16.0.220,3260]
Nov 30 12:53:27 user nova-compute[75672]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4, portal: 172.16.0.220,3260] successful.
Nov 30 12:53:27 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd479e2-3e2f-4c60-acbd-232fbe68aae4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ff01dd-2b47-4cc9-a987-883616064766]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] <== disconnect_volume: return (305ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:53:27 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:53:28 user nova-compute[75672]: DEBUG nova.objects.instance [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lazy-loading 'flavor' on Instance uuid 24033f28-8bf7-4d04-ba4d-88537ad30f10 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:53:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-7ffc2672-a2ce-4311-b1eb-23c19b9a7dc0 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.736s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:43 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG nova.compute.manager [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:53:45 user nova-compute[75672]: INFO nova.compute.claims [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Claim successful on node user
Nov 30 12:53:45 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:45 user nova-compute[75672]: DEBUG nova.compute.manager [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Updating instance_info_cache with network_info: [{"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:53:46 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:53:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG nova.policy [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e87ad9fef5444b4b0124b0bd71f8324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e674749412c04ea3a757ac31928844c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:53:46 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Creating image(s)
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "/opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "/opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.200s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk 1073741824" returned: 0 in 0.062s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Successfully created port: 0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.194s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:46 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Cannot resize image /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Ensure instance console log exists: /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG nova.network.neutron [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Successfully updated port: 0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "80050f56-3708-448e-b501-7e930438e94b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquired lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG nova.network.neutron [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4fea21e-323a-4b09-bd64-ae7ba3d50edb req-85abb5a3-86b4-4e6e-a904-4a5ec1a923a9 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received event network-changed-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-d4fea21e-323a-4b09-bd64-ae7ba3d50edb req-85abb5a3-86b4-4e6e-a904-4a5ec1a923a9 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Refreshing instance network info cache due to event network-changed-0f14b102-12f4-4138-9227-d231693b61e8. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4fea21e-323a-4b09-bd64-ae7ba3d50edb req-85abb5a3-86b4-4e6e-a904-4a5ec1a923a9 service nova] Acquiring lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG nova.network.neutron [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:53:47 user nova-compute[75672]: INFO nova.compute.claims [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Claim successful on node user
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:47 user nova-compute[75672]: DEBUG nova.network.neutron [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updating instance_info_cache with network_info: [{"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Releasing lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.compute.manager [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Instance network_info: |[{"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4fea21e-323a-4b09-bd64-ae7ba3d50edb req-85abb5a3-86b4-4e6e-a904-4a5ec1a923a9 service nova] Acquired lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.network.neutron [req-d4fea21e-323a-4b09-bd64-ae7ba3d50edb req-85abb5a3-86b4-4e6e-a904-4a5ec1a923a9 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Refreshing network info cache for port 0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Start _get_guest_xml network_info=[{"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:53:48 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:53:48 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1480779755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1480779755',id=46,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/4Xthbt7YMcriM6AbB5mTwThqufRFxpj1vCBwiqGrbMgOoMPstysotckw2aKh1s4BlRzesc1LcFIVvsri+pJD+cPC5L10MOGW858Yxbt0zmAWlKJ5vEkcZ+NloSW13rg==',key_name='tempest-keypair-1872424482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e674749412c04ea3a757ac31928844c6',ramdisk_id='',reservation_id='r-gjk8zon0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792375540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792375540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e87ad9fef5444b4b0124b0bd71f8324',uuid=f5e20a72-18eb-4e06-a28e-d1bc9f88f64a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converting VIF {"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0f14b102-12f4-4138-9227-d231693b61e8,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f14b102-12') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.objects.instance [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'pci_devices' on Instance uuid f5e20a72-18eb-4e06-a28e-d1bc9f88f64a {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:53:48 user nova-compute[75672]:   <uuid>f5e20a72-18eb-4e06-a28e-d1bc9f88f64a</uuid>
Nov 30 12:53:48 user nova-compute[75672]:   <name>instance-0000002e</name>
Nov 30 12:53:48 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:53:48 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:53:48 user nova-compute[75672]:   <metadata>
Nov 30 12:53:48 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:53:48 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:53:48 user nova-compute[75672]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1480779755</nova:name>
Nov 30 12:53:48 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:53:48</nova:creationTime>
Nov 30 12:53:48 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:53:48 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:53:48 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:53:48 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:53:48 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:53:48 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:53:48 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:53:48 user nova-compute[75672]:       <nova:owner>
Nov 30 12:53:48 user nova-compute[75672]:         <nova:user uuid="2e87ad9fef5444b4b0124b0bd71f8324">tempest-AttachVolumeShelveTestJSON-1792375540-project-member</nova:user>
Nov 30 12:53:48 user nova-compute[75672]:         <nova:project uuid="e674749412c04ea3a757ac31928844c6">tempest-AttachVolumeShelveTestJSON-1792375540</nova:project>
Nov 30 12:53:48 user nova-compute[75672]:       </nova:owner>
Nov 30 12:53:48 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:53:48 user nova-compute[75672]:       <nova:ports>
Nov 30 12:53:48 user nova-compute[75672]:         <nova:port uuid="0f14b102-12f4-4138-9227-d231693b61e8">
Nov 30 12:53:48 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 12:53:48 user nova-compute[75672]:         </nova:port>
Nov 30 12:53:48 user nova-compute[75672]:       </nova:ports>
Nov 30 12:53:48 user nova-compute[75672]:     </nova:instance>
Nov 30 12:53:48 user nova-compute[75672]:   </metadata>
Nov 30 12:53:48 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:53:48 user nova-compute[75672]:     <system>
Nov 30 12:53:48 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:53:48 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:53:48 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:53:48 user nova-compute[75672]:       <entry name="serial">f5e20a72-18eb-4e06-a28e-d1bc9f88f64a</entry>
Nov 30 12:53:48 user nova-compute[75672]:       <entry name="uuid">f5e20a72-18eb-4e06-a28e-d1bc9f88f64a</entry>
Nov 30 12:53:48 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:53:48 user nova-compute[75672]:     </system>
Nov 30 12:53:48 user nova-compute[75672]:   </sysinfo>
Nov 30 12:53:48 user nova-compute[75672]:   <os>
Nov 30 12:53:48 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:53:48 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:53:48 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:53:48 user nova-compute[75672]:   </os>
Nov 30 12:53:48 user nova-compute[75672]:   <features>
Nov 30 12:53:48 user nova-compute[75672]:     <acpi/>
Nov 30 12:53:48 user nova-compute[75672]:     <apic/>
Nov 30 12:53:48 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:53:48 user nova-compute[75672]:   </features>
Nov 30 12:53:48 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:53:48 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:53:48 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:53:48 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:53:48 user nova-compute[75672]:   </clock>
Nov 30 12:53:48 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:53:48 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:53:48 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:53:48 user nova-compute[75672]:   </cpu>
Nov 30 12:53:48 user nova-compute[75672]:   <devices>
Nov 30 12:53:48 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:53:48 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:53:48 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk"/>
Nov 30 12:53:48 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:53:48 user nova-compute[75672]:     </disk>
Nov 30 12:53:48 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:53:48 user nova-compute[75672]:       <mac address="fa:16:3e:16:4e:b7"/>
Nov 30 12:53:48 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:53:48 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:53:48 user nova-compute[75672]:       <target dev="tap0f14b102-12"/>
Nov 30 12:53:48 user nova-compute[75672]:     </interface>
Nov 30 12:53:48 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:53:48 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/console.log" append="off"/>
Nov 30 12:53:48 user nova-compute[75672]:     </serial>
Nov 30 12:53:48 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:53:48 user nova-compute[75672]:     <video>
Nov 30 12:53:48 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:53:48 user nova-compute[75672]:     </video>
Nov 30 12:53:48 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:53:48 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:53:48 user nova-compute[75672]:     </rng>
Nov 30 12:53:48 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:53:48 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:53:48 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:53:48 user nova-compute[75672]:     </memballoon>
Nov 30 12:53:48 user nova-compute[75672]:   </devices>
Nov 30 12:53:48 user nova-compute[75672]: </domain>
Nov 30 12:53:48 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1480779755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1480779755',id=46,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/4Xthbt7YMcriM6AbB5mTwThqufRFxpj1vCBwiqGrbMgOoMPstysotckw2aKh1s4BlRzesc1LcFIVvsri+pJD+cPC5L10MOGW858Yxbt0zmAWlKJ5vEkcZ+NloSW13rg==',key_name='tempest-keypair-1872424482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e674749412c04ea3a757ac31928844c6',ramdisk_id='',reservation_id='r-gjk8zon0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792375540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792375540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e87ad9fef5444b4b0124b0bd71f8324',uuid=f5e20a72-18eb-4e06-a28e-d1bc9f88f64a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converting VIF {"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0f14b102-12f4-4138-9227-d231693b61e8,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f14b102-12') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG os_vif [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0f14b102-12f4-4138-9227-d231693b61e8,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f14b102-12') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6e3bd95-69ac-5028-9c80-1034c3a8a762', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f14b102-12, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f14b102-12, col_values=(('qos', UUID('b058f87c-e746-48de-ba84-fa665c2d59f2')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f14b102-12, col_values=(('external_ids', {'iface-id': '0f14b102-12f4-4138-9227-d231693b61e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:4e:b7', 'vm-uuid': 'f5e20a72-18eb-4e06-a28e-d1bc9f88f64a'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:48 user nova-compute[75672]: INFO os_vif [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0f14b102-12f4-4138-9227-d231693b61e8,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f14b102-12')
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] No VIF found with MAC fa:16:3e:16:4e:b7, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.network.neutron [req-d4fea21e-323a-4b09-bd64-ae7ba3d50edb req-85abb5a3-86b4-4e6e-a904-4a5ec1a923a9 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updated VIF entry in instance network info cache for port 0f14b102-12f4-4138-9227-d231693b61e8. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.network.neutron [req-d4fea21e-323a-4b09-bd64-ae7ba3d50edb req-85abb5a3-86b4-4e6e-a904-4a5ec1a923a9 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updating instance_info_cache with network_info: [{"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:53:48 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:53:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d4fea21e-323a-4b09-bd64-ae7ba3d50edb req-85abb5a3-86b4-4e6e-a904-4a5ec1a923a9 service nova] Releasing lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG nova.policy [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa5b3c989c934220a07aba162e68ea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47874c48ecea456eac7968640910afba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:53:48 user nova-compute[75672]: INFO nova.virt.block_device [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Booting with volume-backed-image f1bddb75-c432-42ad-9253-e3e4a10e804c at /dev/vda
Nov 30 12:53:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Successfully created port: 0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.manager [req-f54026e8-b967-4506-ace9-7eb379d2bcbe req-28bc5573-788c-4d17-a739-f2b83cf8bd50 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received event network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f54026e8-b967-4506-ace9-7eb379d2bcbe req-28bc5573-788c-4d17-a739-f2b83cf8bd50 service nova] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f54026e8-b967-4506-ace9-7eb379d2bcbe req-28bc5573-788c-4d17-a739-f2b83cf8bd50 service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f54026e8-b967-4506-ace9-7eb379d2bcbe req-28bc5573-788c-4d17-a739-f2b83cf8bd50 service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.manager [req-f54026e8-b967-4506-ace9-7eb379d2bcbe req-28bc5573-788c-4d17-a739-f2b83cf8bd50 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] No waiting events found dispatching network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:53:52 user nova-compute[75672]: WARNING nova.compute.manager [req-f54026e8-b967-4506-ace9-7eb379d2bcbe req-28bc5573-788c-4d17-a739-f2b83cf8bd50 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received unexpected event network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 for instance with vm_state building and task_state spawning.
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.manager [req-8b40ce9d-14d9-4b04-840c-ddc707254e0e req-ea51915b-d397-4c65-9ef5-066b1b91f437 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received event network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8b40ce9d-14d9-4b04-840c-ddc707254e0e req-ea51915b-d397-4c65-9ef5-066b1b91f437 service nova] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8b40ce9d-14d9-4b04-840c-ddc707254e0e req-ea51915b-d397-4c65-9ef5-066b1b91f437 service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8b40ce9d-14d9-4b04-840c-ddc707254e0e req-ea51915b-d397-4c65-9ef5-066b1b91f437 service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.manager [req-8b40ce9d-14d9-4b04-840c-ddc707254e0e req-ea51915b-d397-4c65-9ef5-066b1b91f437 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] No waiting events found dispatching network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:53:52 user nova-compute[75672]: WARNING nova.compute.manager [req-8b40ce9d-14d9-4b04-840c-ddc707254e0e req-ea51915b-d397-4c65-9ef5-066b1b91f437 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received unexpected event network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 for instance with vm_state building and task_state spawning.
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.manager [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:53:52 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:53:52 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7891MB free_disk=24.82854461669922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:52 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Instance spawned successfully.
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:53:52 user nova-compute[75672]: INFO nova.compute.manager [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.manager [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance c00b64bd-8011-4609-8953-315f1e655930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 498d231e-d0be-4ea5-9024-669a978b8292 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 24033f28-8bf7-4d04-ba4d-88537ad30f10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance cd6672f6-3d59-4311-b213-aee62517f868 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 9d7771dc-198f-4f4f-9083-60bea2dd80fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f5e20a72-18eb-4e06-a28e-d1bc9f88f64a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 80050f56-3708-448e-b501-7e930438e94b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:53:52 user nova-compute[75672]: INFO nova.compute.manager [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Took 6.93 seconds to build instance.
Nov 30 12:53:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-96f0aee1-e9c0-4567-8d6f-9621b20566a3 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.044s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.625s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Successfully updated port: 0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "refresh_cache-80050f56-3708-448e-b501-7e930438e94b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquired lock "refresh_cache-80050f56-3708-448e-b501-7e930438e94b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.manager [req-8913c982-f149-453f-ba8d-fc7fccda7d94 req-43cd528e-ea29-4786-9697-d72757214844 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-changed-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.compute.manager [req-8913c982-f149-453f-ba8d-fc7fccda7d94 req-43cd528e-ea29-4786-9697-d72757214844 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Refreshing instance network info cache due to event network-changed-0d245425-351d-4f32-bc2e-0c4f4cf9c532. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8913c982-f149-453f-ba8d-fc7fccda7d94 req-43cd528e-ea29-4786-9697-d72757214844 service nova] Acquiring lock "refresh_cache-80050f56-3708-448e-b501-7e930438e94b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:53:52 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:53:53 user nova-compute[75672]: DEBUG nova.network.neutron [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Updating instance_info_cache with network_info: [{"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:53:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Releasing lock "refresh_cache-80050f56-3708-448e-b501-7e930438e94b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:53:53 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Instance network_info: |[{"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:53:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8913c982-f149-453f-ba8d-fc7fccda7d94 req-43cd528e-ea29-4786-9697-d72757214844 service nova] Acquired lock "refresh_cache-80050f56-3708-448e-b501-7e930438e94b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:53:53 user nova-compute[75672]: DEBUG nova.network.neutron [req-8913c982-f149-453f-ba8d-fc7fccda7d94 req-43cd528e-ea29-4786-9697-d72757214844 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Refreshing network info cache for port 0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:53:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:53 user nova-compute[75672]: DEBUG nova.network.neutron [req-8913c982-f149-453f-ba8d-fc7fccda7d94 req-43cd528e-ea29-4786-9697-d72757214844 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Updated VIF entry in instance network info cache for port 0d245425-351d-4f32-bc2e-0c4f4cf9c532. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:53:53 user nova-compute[75672]: DEBUG nova.network.neutron [req-8913c982-f149-453f-ba8d-fc7fccda7d94 req-43cd528e-ea29-4786-9697-d72757214844 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Updating instance_info_cache with network_info: [{"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:53:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8913c982-f149-453f-ba8d-fc7fccda7d94 req-43cd528e-ea29-4786-9697-d72757214844 service nova] Releasing lock "refresh_cache-80050f56-3708-448e-b501-7e930438e94b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:53:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-24d34a12-959e-43ff-a93a-0d8792b6c3cd req-591fd0a2-31f7-44e5-a930-f967a02f5305 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Received event network-changed-c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:53:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-24d34a12-959e-43ff-a93a-0d8792b6c3cd req-591fd0a2-31f7-44e5-a930-f967a02f5305 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Refreshing instance network info cache due to event network-changed-c1570a44-7d9b-4e09-9005-cd6fd016a602. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:53:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-24d34a12-959e-43ff-a93a-0d8792b6c3cd req-591fd0a2-31f7-44e5-a930-f967a02f5305 service nova] Acquiring lock "refresh_cache-cd6672f6-3d59-4311-b213-aee62517f868" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:53:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-24d34a12-959e-43ff-a93a-0d8792b6c3cd req-591fd0a2-31f7-44e5-a930-f967a02f5305 service nova] Acquired lock "refresh_cache-cd6672f6-3d59-4311-b213-aee62517f868" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:53:54 user nova-compute[75672]: DEBUG nova.network.neutron [req-24d34a12-959e-43ff-a93a-0d8792b6c3cd req-591fd0a2-31f7-44e5-a930-f967a02f5305 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Refreshing network info cache for port c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:53:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "cd6672f6-3d59-4311-b213-aee62517f868" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cd6672f6-3d59-4311-b213-aee62517f868" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:54 user nova-compute[75672]: DEBUG nova.objects.instance [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lazy-loading 'flavor' on Instance uuid cd6672f6-3d59-4311-b213-aee62517f868 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:53:54 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Ignoring supplied device name: /dev/vdb
Nov 30 12:53:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cd6672f6-3d59-4311-b213-aee62517f868" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG nova.network.neutron [req-24d34a12-959e-43ff-a93a-0d8792b6c3cd req-591fd0a2-31f7-44e5-a930-f967a02f5305 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Updated VIF entry in instance network info cache for port c1570a44-7d9b-4e09-9005-cd6fd016a602. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG nova.network.neutron [req-24d34a12-959e-43ff-a93a-0d8792b6c3cd req-591fd0a2-31f7-44e5-a930-f967a02f5305 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Updating instance_info_cache with network_info: [{"id": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "address": "fa:16:3e:99:4d:34", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1570a44-7d", "ovs_interfaceid": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-24d34a12-959e-43ff-a93a-0d8792b6c3cd req-591fd0a2-31f7-44e5-a930-f967a02f5305 service nova] Releasing lock "refresh_cache-cd6672f6-3d59-4311-b213-aee62517f868" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "cd6672f6-3d59-4311-b213-aee62517f868" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cd6672f6-3d59-4311-b213-aee62517f868" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:55 user nova-compute[75672]: INFO nova.compute.manager [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Attaching volume 3b287cce-e44c-4d2d-aa5f-293db072f2a6 to /dev/vdb
Nov 30 12:53:55 user nova-compute[75672]: DEBUG os_brick.utils [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57c51cb-0d38-42a9-ac9c-13b1c0cc33f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08bbc31-2aa1-4965-948b-41c217c0fdfe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[400cb69c-b9c2-4339-a27a-cd4231eccbd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe4315-4123-45b3-b692-2ce8c12934f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:53:55 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[386ec555-3f06-41f7-910c-1f2c66e7cb53]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG os_brick.utils [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Updating existing volume attachment record: a4366eeb-b986-4fa4-b782-473ebd99ea4b {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:53:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:53:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-3f85f077-c22d-4b30-8e6d-5da3bfb3f2ff req-5828bdd2-23de-4336-b642-ff6a624cc5a1 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Received event network-changed-c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-3f85f077-c22d-4b30-8e6d-5da3bfb3f2ff req-5828bdd2-23de-4336-b642-ff6a624cc5a1 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Refreshing instance network info cache due to event network-changed-c949af34-396a-4e42-917f-e555edc66487. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3f85f077-c22d-4b30-8e6d-5da3bfb3f2ff req-5828bdd2-23de-4336-b642-ff6a624cc5a1 service nova] Acquiring lock "refresh_cache-24033f28-8bf7-4d04-ba4d-88537ad30f10" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3f85f077-c22d-4b30-8e6d-5da3bfb3f2ff req-5828bdd2-23de-4336-b642-ff6a624cc5a1 service nova] Acquired lock "refresh_cache-24033f28-8bf7-4d04-ba4d-88537ad30f10" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG nova.network.neutron [req-3f85f077-c22d-4b30-8e6d-5da3bfb3f2ff req-5828bdd2-23de-4336-b642-ff6a624cc5a1 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Refreshing network info cache for port c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:57 user nova-compute[75672]: INFO nova.compute.manager [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Terminating instance
Nov 30 12:53:57 user nova-compute[75672]: DEBUG nova.compute.manager [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG nova.network.neutron [req-3f85f077-c22d-4b30-8e6d-5da3bfb3f2ff req-5828bdd2-23de-4336-b642-ff6a624cc5a1 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Updated VIF entry in instance network info cache for port c949af34-396a-4e42-917f-e555edc66487. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG nova.network.neutron [req-3f85f077-c22d-4b30-8e6d-5da3bfb3f2ff req-5828bdd2-23de-4336-b642-ff6a624cc5a1 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Updating instance_info_cache with network_info: [{"id": "c949af34-396a-4e42-917f-e555edc66487", "address": "fa:16:3e:65:e5:8b", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc949af34-39", "ovs_interfaceid": "c949af34-396a-4e42-917f-e555edc66487", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-0efb3ead-d422-4b41-9a14-9ac86a28d79f req-79b0c0d0-3410-48ed-a03d-345285030cc8 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Received event network-vif-unplugged-c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0efb3ead-d422-4b41-9a14-9ac86a28d79f req-79b0c0d0-3410-48ed-a03d-345285030cc8 service nova] Acquiring lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0efb3ead-d422-4b41-9a14-9ac86a28d79f req-79b0c0d0-3410-48ed-a03d-345285030cc8 service nova] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0efb3ead-d422-4b41-9a14-9ac86a28d79f req-79b0c0d0-3410-48ed-a03d-345285030cc8 service nova] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-0efb3ead-d422-4b41-9a14-9ac86a28d79f req-79b0c0d0-3410-48ed-a03d-345285030cc8 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] No waiting events found dispatching network-vif-unplugged-c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-0efb3ead-d422-4b41-9a14-9ac86a28d79f req-79b0c0d0-3410-48ed-a03d-345285030cc8 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Received event network-vif-unplugged-c949af34-396a-4e42-917f-e555edc66487 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3f85f077-c22d-4b30-8e6d-5da3bfb3f2ff req-5828bdd2-23de-4336-b642-ff6a624cc5a1 service nova] Releasing lock "refresh_cache-24033f28-8bf7-4d04-ba4d-88537ad30f10" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Instance destroyed successfully.
Nov 30 12:53:58 user nova-compute[75672]: DEBUG nova.objects.instance [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lazy-loading 'resources' on Instance uuid 24033f28-8bf7-4d04-ba4d-88537ad30f10 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1595541361',display_name='tempest-TestStampPattern-server-1595541361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1595541361',id=42,image_ref='ed053729-6d3f-4405-966f-b7cde14ec65e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuijQmPQJraElz60vaRaG/e8nrlOXht9CJYkW2bgFzbRFpEhWL7TMKFRy/q/cr8dhtExqxBW2eC1142b+wZVginkATR2akVdepgzX/hlOLrLqJpXg6xSJ07bI2dQ6OD6A==',key_name='tempest-TestStampPattern-1531471902',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:51:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f78ee16221704ff48f3ce5ff927aad62',ramdisk_id='',reservation_id='r-u5647seb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df',image_min_disk='1',image_min_ram='0',image_owner_id='f78ee16221704ff48f3ce5ff927aad62',image_owner_project_name='tempest-TestStampPattern-2034271615',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2034271615-project-member',image_user_id='8aec8237a0eb47fc891389705f0cc270',owner_project_name='tempest-TestStampPattern-2034271615',owner_user_name='tempest-TestStampPattern-2034271615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:51:09Z,user_data=None,user_id='8aec8237a0eb47fc891389705f0cc270',uuid=24033f28-8bf7-4d04-ba4d-88537ad30f10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c949af34-396a-4e42-917f-e555edc66487", "address": "fa:16:3e:65:e5:8b", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc949af34-39", "ovs_interfaceid": "c949af34-396a-4e42-917f-e555edc66487", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Converting VIF {"id": "c949af34-396a-4e42-917f-e555edc66487", "address": "fa:16:3e:65:e5:8b", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc949af34-39", "ovs_interfaceid": "c949af34-396a-4e42-917f-e555edc66487", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:e5:8b,bridge_name='br-int',has_traffic_filtering=True,id=c949af34-396a-4e42-917f-e555edc66487,network=Network(1bf9e732-dd63-4d07-adfa-89a3ffde5dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc949af34-39') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG os_vif [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:e5:8b,bridge_name='br-int',has_traffic_filtering=True,id=c949af34-396a-4e42-917f-e555edc66487,network=Network(1bf9e732-dd63-4d07-adfa-89a3ffde5dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc949af34-39') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc949af34-39, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51c88573-dbec-4f10-8ef9-77ebff539809) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:53:58 user nova-compute[75672]: INFO os_vif [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:e5:8b,bridge_name='br-int',has_traffic_filtering=True,id=c949af34-396a-4e42-917f-e555edc66487,network=Network(1bf9e732-dd63-4d07-adfa-89a3ffde5dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc949af34-39')
Nov 30 12:53:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Deleting instance files /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10_del
Nov 30 12:53:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Deletion of /opt/stack/data/nova/instances/24033f28-8bf7-4d04-ba4d-88537ad30f10_del complete
Nov 30 12:53:58 user nova-compute[75672]: INFO nova.compute.manager [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 30 12:53:58 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:53:58 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Took 0.45 seconds to deallocate network for instance.
Nov 30 12:53:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-e71633c8-9da2-43e8-95c0-86a6eb09c980 req-50634ccc-55ff-47e3-8462-96f795c465be service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Received event network-vif-deleted-c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:53:58 user nova-compute[75672]: INFO nova.compute.manager [req-e71633c8-9da2-43e8-95c0-86a6eb09c980 req-50634ccc-55ff-47e3-8462-96f795c465be service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Neutron deleted interface c949af34-396a-4e42-917f-e555edc66487; detaching it from the instance and deleting it from the info cache
Nov 30 12:53:58 user nova-compute[75672]: DEBUG nova.network.neutron [req-e71633c8-9da2-43e8-95c0-86a6eb09c980 req-50634ccc-55ff-47e3-8462-96f795c465be service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-e71633c8-9da2-43e8-95c0-86a6eb09c980 req-50634ccc-55ff-47e3-8462-96f795c465be service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Detach interface failed, port_id=c949af34-396a-4e42-917f-e555edc66487, reason: Instance 24033f28-8bf7-4d04-ba4d-88537ad30f10 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:59 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Deleted allocations for instance 24033f28-8bf7-4d04-ba4d-88537ad30f10
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-06d08dcb-02e7-459a-b23c-620535619bd3 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.858s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG os_brick.utils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4661209e-732a-4e82-bcc3-2f6fc80a3a8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f90c0f-a4b1-4324-8ab3-996ee8f1b521]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-dd532472-9129-4862-bb30-e04bc370903a req-9387e693-19f1-4ba8-9353-671ac39e58e1 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Received event network-vif-plugged-c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dd532472-9129-4862-bb30-e04bc370903a req-9387e693-19f1-4ba8-9353-671ac39e58e1 service nova] Acquiring lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dd532472-9129-4862-bb30-e04bc370903a req-9387e693-19f1-4ba8-9353-671ac39e58e1 service nova] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-dd532472-9129-4862-bb30-e04bc370903a req-9387e693-19f1-4ba8-9353-671ac39e58e1 service nova] Lock "24033f28-8bf7-4d04-ba4d-88537ad30f10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG nova.compute.manager [req-dd532472-9129-4862-bb30-e04bc370903a req-9387e693-19f1-4ba8-9353-671ac39e58e1 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] No waiting events found dispatching network-vif-plugged-c949af34-396a-4e42-917f-e555edc66487 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:53:59 user nova-compute[75672]: WARNING nova.compute.manager [req-dd532472-9129-4862-bb30-e04bc370903a req-9387e693-19f1-4ba8-9353-671ac39e58e1 service nova] [instance: 24033f28-8bf7-4d04-ba4d-88537ad30f10] Received unexpected event network-vif-plugged-c949af34-396a-4e42-917f-e555edc66487 for instance with vm_state deleted and task_state None.
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[13953073-7335-4d50-a6d7-a1d85d381fe6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5834308-4b39-4cf1-aecf-8f28964f2b4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:53:59 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:53:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[613f856f-28f6-42de-a4b9-a53c53aff919]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG os_brick.utils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:53:59 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Updating existing volume attachment record: e45397ea-de81-4205-8097-e8c541172e67 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:54:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWXaZKfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:54:05 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:54:05 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:54:05 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[de572f49-60e3-4e3e-a413-07af4864a542]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:54:05 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1ae53f-526b-4172-b434-5a9a96a509dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6] added
Nov 30 12:54:05 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c46ef5-8013-4fdd-9f01-b10c53c1e582]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66503a1-2ca2-47a3-af48-c4e44cf37f22]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SWXaZKfg {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SWXaZKfg" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b32f103-0a44-4e95-ac56-c29705904162]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SWXaZKfg'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[256599dd-315f-4e1e-97fa-5d6b212e123d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f9bc1d-f009-4d77-b8fc-24bea1bad58a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:54:05 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:54:05 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:54:05 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:54:05 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aa356e-3489-4bf9-8b6a-f62a35c5ca43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6, portal: 172.16.0.220,3260]
Nov 30 12:54:05 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6, portal: 172.16.0.220,3260] successful.
Nov 30 12:54:05 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4f4a13-e522-4bb8-a986-941a597aa8b3]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[281d6f3b-0413-468d-b125-24d01868ef58]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:54:05 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:54:05 user nova-compute[75672]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)
Nov 30 12:54:05 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:54:05 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:54:05 user nova-compute[75672]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)
Nov 30 12:54:05 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46e1465-dd20-4df1-8701-bc955920e048]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:54:05 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWXaZKfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:54:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:54:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23261333633313233', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:54:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261333633313233', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:54:06 user nova-compute[75672]: DEBUG nova.objects.instance [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lazy-loading 'flavor' on Instance uuid cd6672f6-3d59-4311-b213-aee62517f868 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:54:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:54:06 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:54:06 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 12:54:06 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:54:06 user nova-compute[75672]:   <serial>3b287cce-e44c-4d2d-aa5f-293db072f2a6</serial>
Nov 30 12:54:06 user nova-compute[75672]: </disk>
Nov 30 12:54:06 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:54:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:54:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:54:07 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] No VIF found with MAC fa:16:3e:99:4d:34, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:54:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-5bf6297c-cbfc-4490-be84-cb7aa0ae3e42 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cd6672f6-3d59-4311-b213-aee62517f868" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-45fff4d2-96fc-4be6-bc1e-08f8d87d29bc req-1c19218d-d70c-4ed0-b723-762643b1240a service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Received event network-changed-015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-45fff4d2-96fc-4be6-bc1e-08f8d87d29bc req-1c19218d-d70c-4ed0-b723-762643b1240a service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Refreshing instance network info cache due to event network-changed-015af49e-5605-48da-a8bc-472fe731e91a. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-45fff4d2-96fc-4be6-bc1e-08f8d87d29bc req-1c19218d-d70c-4ed0-b723-762643b1240a service nova] Acquiring lock "refresh_cache-498d231e-d0be-4ea5-9024-669a978b8292" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-45fff4d2-96fc-4be6-bc1e-08f8d87d29bc req-1c19218d-d70c-4ed0-b723-762643b1240a service nova] Acquired lock "refresh_cache-498d231e-d0be-4ea5-9024-669a978b8292" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-45fff4d2-96fc-4be6-bc1e-08f8d87d29bc req-1c19218d-d70c-4ed0-b723-762643b1240a service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Refreshing network info cache for port 015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "498d231e-d0be-4ea5-9024-669a978b8292" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "498d231e-d0be-4ea5-9024-669a978b8292" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "498d231e-d0be-4ea5-9024-669a978b8292-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "498d231e-d0be-4ea5-9024-669a978b8292-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "498d231e-d0be-4ea5-9024-669a978b8292-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:09 user nova-compute[75672]: INFO nova.compute.manager [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Terminating instance
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:54:09 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Creating image(s)
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Ensure instance console log exists: /opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Start _get_guest_xml network_info=[{"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'e45397ea-de81-4205-8097-e8c541172e67', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unIFSckN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '80050f56-3708-448e-b501-7e930438e94b', 'attached_at': '', 'detached_at': '', 'volume_id': '9f5a1108-315a-43cf-9248-ff49b3e57d74', 'serial': '9f5a1108-315a-43cf-9248-ff49b3e57d74'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:54:09 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:54:09 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unIFSckN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:54:09 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:54:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:54:09 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:54:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:54:09 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebf262d-2d82-40a9-9a01-5a91ad7fb241]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:54:09 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2cd4ef-6ef6-4461-b752-4de06db9a8f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74] added
Nov 30 12:54:09 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-8d610da3-51de-4e83-88f9-1c21db6b6d0c req-68b0b9fb-576e-4c02-9504-8ee7c1d05718 service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Received event network-vif-unplugged-015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8d610da3-51de-4e83-88f9-1c21db6b6d0c req-68b0b9fb-576e-4c02-9504-8ee7c1d05718 service nova] Acquiring lock "498d231e-d0be-4ea5-9024-669a978b8292-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8d610da3-51de-4e83-88f9-1c21db6b6d0c req-68b0b9fb-576e-4c02-9504-8ee7c1d05718 service nova] Lock "498d231e-d0be-4ea5-9024-669a978b8292-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8d610da3-51de-4e83-88f9-1c21db6b6d0c req-68b0b9fb-576e-4c02-9504-8ee7c1d05718 service nova] Lock "498d231e-d0be-4ea5-9024-669a978b8292-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-8d610da3-51de-4e83-88f9-1c21db6b6d0c req-68b0b9fb-576e-4c02-9504-8ee7c1d05718 service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] No waiting events found dispatching network-vif-unplugged-015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-8d610da3-51de-4e83-88f9-1c21db6b6d0c req-68b0b9fb-576e-4c02-9504-8ee7c1d05718 service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Received event network-vif-unplugged-015af49e-5605-48da-a8bc-472fe731e91a for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-45fff4d2-96fc-4be6-bc1e-08f8d87d29bc req-1c19218d-d70c-4ed0-b723-762643b1240a service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Updated VIF entry in instance network info cache for port 015af49e-5605-48da-a8bc-472fe731e91a. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-45fff4d2-96fc-4be6-bc1e-08f8d87d29bc req-1c19218d-d70c-4ed0-b723-762643b1240a service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Updating instance_info_cache with network_info: [{"id": "015af49e-5605-48da-a8bc-472fe731e91a", "address": "fa:16:3e:ae:be:e3", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015af49e-56", "ovs_interfaceid": "015af49e-5605-48da-a8bc-472fe731e91a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1c8fa6-91a1-4c7e-8ed5-4c4c6d6b7cfa]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-45fff4d2-96fc-4be6-bc1e-08f8d87d29bc req-1c19218d-d70c-4ed0-b723-762643b1240a service nova] Releasing lock "refresh_cache-498d231e-d0be-4ea5-9024-669a978b8292" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[947ee967-56d7-4518-8ba4-f7355527bf07]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v unIFSckN {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v unIFSckN" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[54448963-4a4b-4d5d-ac43-71c0379fe5c0]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'unIFSckN'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa92448c-4322-44a3-861e-eb5274915245]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[51017744-ab76-446c-9b4e-41aac9fd1b49]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:54:09 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:54:09 user nova-compute[75672]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)
Nov 30 12:54:09 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:54:09 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:54:09 user nova-compute[75672]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)
Nov 30 12:54:09 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:54:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9b5e8c-b0bf-4feb-943e-5d22b98d0657]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74, portal: 172.16.0.220,3260]
Nov 30 12:54:10 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74, portal: 172.16.0.220,3260] successful.
Nov 30 12:54:10 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7867ba-d8a8-45b5-be69-9c4dc9ab724e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ede9b6-e401-4871-9a11-68ca07bfc933]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:54:10 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:54:10 user nova-compute[75672]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)
Nov 30 12:54:10 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:54:10 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:54:10 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:54:10 user nova-compute[75672]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)
Nov 30 12:54:10 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:54:10 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b198ca-7082-47ff-a24e-23d010e18b10]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unIFSckN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:10 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Instance destroyed successfully.
Nov 30 12:54:10 user nova-compute[75672]: DEBUG nova.objects.instance [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lazy-loading 'resources' on Instance uuid 498d231e-d0be-4ea5-9024-669a978b8292 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2033127066',display_name='tempest-TestVolumeBootPattern-server-2033127066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2033127066',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/tiWnKVjyQ+YQ0wPEgFpD4sUWbk2GMRtR0fUhMrrhWzqEfZseqSV3bBKpPI9FNVcBh3EJSPDcri0dXJ24ST3AlMd1Z9vj5ezFGg5LMAjAiHzircmeHJyIgzk+4EYWw6A==',key_name='tempest-TestVolumeBootPattern-1453287901',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:49:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='513644b3a140400dbdf6b07e8e727dd4',ramdisk_id='',reservation_id='r-az5lqqp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1743139468',owner_user_name='tempest-TestVolumeBootPattern-1743139468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:49:28Z,user_data=None,user_id='924cf8ff73154f8fadb371175a0d8fc4',uuid=498d231e-d0be-4ea5-9024-669a978b8292,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "015af49e-5605-48da-a8bc-472fe731e91a", "address": "fa:16:3e:ae:be:e3", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015af49e-56", "ovs_interfaceid": "015af49e-5605-48da-a8bc-472fe731e91a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converting VIF {"id": "015af49e-5605-48da-a8bc-472fe731e91a", "address": "fa:16:3e:ae:be:e3", "network": {"id": "dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1871891056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513644b3a140400dbdf6b07e8e727dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015af49e-56", "ovs_interfaceid": "015af49e-5605-48da-a8bc-472fe731e91a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:be:e3,bridge_name='br-int',has_traffic_filtering=True,id=015af49e-5605-48da-a8bc-472fe731e91a,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015af49e-56') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG os_vif [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:be:e3,bridge_name='br-int',has_traffic_filtering=True,id=015af49e-5605-48da-a8bc-472fe731e91a,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015af49e-56') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap015af49e-56, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fdd888d-9d53-4664-89c9-44404a321490) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:54:10 user nova-compute[75672]: INFO os_vif [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:be:e3,bridge_name='br-int',has_traffic_filtering=True,id=015af49e-5605-48da-a8bc-472fe731e91a,network=Network(dd1f1b39-3abc-4156-9b8d-a582dc1b6e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015af49e-56')
Nov 30 12:54:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:54:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'viUPLGdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:54:10 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:54:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23766393130666439', 'path': '/dev/sde'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766393130666439', 'path': '/dev/sde'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.891s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[545c56a4-02f9-4c87-994a-34107a976252]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:54:11 user nova-compute[75672]: No targets found.
Nov 30 12:54:11 user nova-compute[75672]: iSNS:
Nov 30 12:54:11 user nova-compute[75672]: No targets found.
Nov 30 12:54:11 user nova-compute[75672]: STATIC:
Nov 30 12:54:11 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74
Nov 30 12:54:11 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:54:11 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:54:11 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:54:11 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:54:11 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:54:11 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf
Nov 30 12:54:11 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:54:11 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:54:11 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6
Nov 30 12:54:11 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:54:11 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:54:11 user nova-compute[75672]: FIRMWARE:
Nov 30 12:54:11 user nova-compute[75672]: No targets found.
Nov 30 12:54:11 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:54:11 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:54:11 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1229297497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1229297497',id=47,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47874c48ecea456eac7968640910afba',ramdisk_id='',reservation_id='r-fkioef23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-547265583',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:53:49Z,user_data=None,user_id='aa5b3c989c934220a07aba162e68ea87',uuid=80050f56-3708-448e-b501-7e930438e94b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converting VIF {"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:65:77,bridge_name='br-int',has_traffic_filtering=True,id=0d245425-351d-4f32-bc2e-0c4f4cf9c532,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d245425-35') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.objects.instance [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'pci_devices' on Instance uuid 80050f56-3708-448e-b501-7e930438e94b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:54:11 user nova-compute[75672]:   <uuid>80050f56-3708-448e-b501-7e930438e94b</uuid>
Nov 30 12:54:11 user nova-compute[75672]:   <name>instance-0000002f</name>
Nov 30 12:54:11 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:54:11 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:54:11 user nova-compute[75672]:   <metadata>
Nov 30 12:54:11 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:54:11 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:54:11 user nova-compute[75672]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1229297497</nova:name>
Nov 30 12:54:11 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:54:09</nova:creationTime>
Nov 30 12:54:11 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:54:11 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:54:11 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:54:11 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:54:11 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:54:11 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:54:11 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:54:11 user nova-compute[75672]:       <nova:owner>
Nov 30 12:54:11 user nova-compute[75672]:         <nova:user uuid="aa5b3c989c934220a07aba162e68ea87">tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member</nova:user>
Nov 30 12:54:11 user nova-compute[75672]:         <nova:project uuid="47874c48ecea456eac7968640910afba">tempest-ServerBootFromVolumeStableRescueTest-547265583</nova:project>
Nov 30 12:54:11 user nova-compute[75672]:       </nova:owner>
Nov 30 12:54:11 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:54:11 user nova-compute[75672]:       <nova:ports>
Nov 30 12:54:11 user nova-compute[75672]:         <nova:port uuid="0d245425-351d-4f32-bc2e-0c4f4cf9c532">
Nov 30 12:54:11 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 12:54:11 user nova-compute[75672]:         </nova:port>
Nov 30 12:54:11 user nova-compute[75672]:       </nova:ports>
Nov 30 12:54:11 user nova-compute[75672]:     </nova:instance>
Nov 30 12:54:11 user nova-compute[75672]:   </metadata>
Nov 30 12:54:11 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:54:11 user nova-compute[75672]:     <system>
Nov 30 12:54:11 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:54:11 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:54:11 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:54:11 user nova-compute[75672]:       <entry name="serial">80050f56-3708-448e-b501-7e930438e94b</entry>
Nov 30 12:54:11 user nova-compute[75672]:       <entry name="uuid">80050f56-3708-448e-b501-7e930438e94b</entry>
Nov 30 12:54:11 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:54:11 user nova-compute[75672]:     </system>
Nov 30 12:54:11 user nova-compute[75672]:   </sysinfo>
Nov 30 12:54:11 user nova-compute[75672]:   <os>
Nov 30 12:54:11 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:54:11 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:54:11 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:54:11 user nova-compute[75672]:   </os>
Nov 30 12:54:11 user nova-compute[75672]:   <features>
Nov 30 12:54:11 user nova-compute[75672]:     <acpi/>
Nov 30 12:54:11 user nova-compute[75672]:     <apic/>
Nov 30 12:54:11 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:54:11 user nova-compute[75672]:   </features>
Nov 30 12:54:11 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:54:11 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:54:11 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:54:11 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:54:11 user nova-compute[75672]:   </clock>
Nov 30 12:54:11 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:54:11 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:54:11 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:54:11 user nova-compute[75672]:   </cpu>
Nov 30 12:54:11 user nova-compute[75672]:   <devices>
Nov 30 12:54:11 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:54:11 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:54:11 user nova-compute[75672]:       <source dev="/dev/sde"/>
Nov 30 12:54:11 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:54:11 user nova-compute[75672]:       <serial>9f5a1108-315a-43cf-9248-ff49b3e57d74</serial>
Nov 30 12:54:11 user nova-compute[75672]:     </disk>
Nov 30 12:54:11 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:54:11 user nova-compute[75672]:       <mac address="fa:16:3e:7e:65:77"/>
Nov 30 12:54:11 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:54:11 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:54:11 user nova-compute[75672]:       <target dev="tap0d245425-35"/>
Nov 30 12:54:11 user nova-compute[75672]:     </interface>
Nov 30 12:54:11 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:54:11 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/console.log" append="off"/>
Nov 30 12:54:11 user nova-compute[75672]:     </serial>
Nov 30 12:54:11 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:54:11 user nova-compute[75672]:     <video>
Nov 30 12:54:11 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:54:11 user nova-compute[75672]:     </video>
Nov 30 12:54:11 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:54:11 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:54:11 user nova-compute[75672]:     </rng>
Nov 30 12:54:11 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:54:11 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:54:11 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:54:11 user nova-compute[75672]:     </memballoon>
Nov 30 12:54:11 user nova-compute[75672]:   </devices>
Nov 30 12:54:11 user nova-compute[75672]: </domain>
Nov 30 12:54:11 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1229297497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1229297497',id=47,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47874c48ecea456eac7968640910afba',ramdisk_id='',reservation_id='r-fkioef23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-547265583',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:53:49Z,user_data=None,user_id='aa5b3c989c934220a07aba162e68ea87',uuid=80050f56-3708-448e-b501-7e930438e94b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converting VIF {"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:65:77,bridge_name='br-int',has_traffic_filtering=True,id=0d245425-351d-4f32-bc2e-0c4f4cf9c532,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d245425-35') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_vif [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:65:77,bridge_name='br-int',has_traffic_filtering=True,id=0d245425-351d-4f32-bc2e-0c4f4cf9c532,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d245425-35') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f87899c-9106-4d4a-8003-2d7f6cb43afc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa6cc280-956c-5020-ae61-80fac9a2c775', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d245425-35, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d245425-35, col_values=(('qos', UUID('7f865674-0d90-4949-9191-7469d70e6cc6')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d245425-35, col_values=(('external_ids', {'iface-id': '0d245425-351d-4f32-bc2e-0c4f4cf9c532', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:65:77', 'vm-uuid': '80050f56-3708-448e-b501-7e930438e94b'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e294411-135e-4636-9c2a-304dd804596a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:54:11 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:54:11 user nova-compute[75672]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)
Nov 30 12:54:11 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:54:11 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:54:11 user nova-compute[75672]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf (non-flash)
Nov 30 12:54:11 user nova-compute[75672]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)
Nov 30 12:54:11 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:54:11 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcb47c9e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf'): ({'sdc'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Removing single pathed devices sdc {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:11 user nova-compute[75672]: INFO os_vif [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:65:77,bridge_name='br-int',has_traffic_filtering=True,id=0d245425-351d-4f32-bc2e-0c4f4cf9c532,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d245425-35')
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ca0272-3a34-4d1c-b064-56f81182fbba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2947b5-703a-45f5-a9fe-725f96783a6b]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Flushing IO for device /dev/sdc {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] No VIF found with MAC fa:16:3e:7e:65:77, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a38843f-3815-42d5-876d-a2b3b01188ce]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb80c12-0640-4547-889f-6d8add015398]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2e71bd-6bc2-4d49-9344-78af3f8debdc]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b586626-7c1e-4efe-a9f7-571b162d7c5a]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260]
Nov 30 12:54:11 user nova-compute[75672]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf, portal: 172.16.0.220,3260] successful.
Nov 30 12:54:11 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebfdf80-0d02-4c7e-84ba-a61c53f8f4bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59d4bf8-1188-4b17-b723-2d066a9b365d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] <== disconnect_volume: return (1211ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:54:11 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Deleting instance files /opt/stack/data/nova/instances/498d231e-d0be-4ea5-9024-669a978b8292_del
Nov 30 12:54:11 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Deletion of /opt/stack/data/nova/instances/498d231e-d0be-4ea5-9024-669a978b8292_del complete
Nov 30 12:54:11 user nova-compute[75672]: INFO nova.compute.manager [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Took 2.08 seconds to destroy the instance on the hypervisor.
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-b14b16e6-8d4b-4867-a091-f86f5a0988fa req-b913685f-cc53-45c6-b5f3-8bcabcbce24a service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Received event network-vif-plugged-015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b14b16e6-8d4b-4867-a091-f86f5a0988fa req-b913685f-cc53-45c6-b5f3-8bcabcbce24a service nova] Acquiring lock "498d231e-d0be-4ea5-9024-669a978b8292-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b14b16e6-8d4b-4867-a091-f86f5a0988fa req-b913685f-cc53-45c6-b5f3-8bcabcbce24a service nova] Lock "498d231e-d0be-4ea5-9024-669a978b8292-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b14b16e6-8d4b-4867-a091-f86f5a0988fa req-b913685f-cc53-45c6-b5f3-8bcabcbce24a service nova] Lock "498d231e-d0be-4ea5-9024-669a978b8292-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-b14b16e6-8d4b-4867-a091-f86f5a0988fa req-b913685f-cc53-45c6-b5f3-8bcabcbce24a service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] No waiting events found dispatching network-vif-plugged-015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:54:11 user nova-compute[75672]: WARNING nova.compute.manager [req-b14b16e6-8d4b-4867-a091-f86f5a0988fa req-b913685f-cc53-45c6-b5f3-8bcabcbce24a service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Received unexpected event network-vif-plugged-015af49e-5605-48da-a8bc-472fe731e91a for instance with vm_state active and task_state deleting.
Nov 30 12:54:12 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:54:12 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Took 0.48 seconds to deallocate network for instance.
Nov 30 12:54:12 user nova-compute[75672]: DEBUG nova.compute.manager [req-197ef343-2343-4b06-9136-5a83bf7b5e2a req-5b40159a-393b-4cf6-b4bc-044b7b1966bd service nova] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Received event network-vif-deleted-015af49e-5605-48da-a8bc-472fe731e91a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:54:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:12 user nova-compute[75672]: DEBUG nova.compute.manager [req-39f011cc-3cf3-4780-90fc-94126907fd09 req-e1863964-eee2-4e11-88c0-9106c0c42bfa service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:54:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-39f011cc-3cf3-4780-90fc-94126907fd09 req-e1863964-eee2-4e11-88c0-9106c0c42bfa service nova] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-39f011cc-3cf3-4780-90fc-94126907fd09 req-e1863964-eee2-4e11-88c0-9106c0c42bfa service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-39f011cc-3cf3-4780-90fc-94126907fd09 req-e1863964-eee2-4e11-88c0-9106c0c42bfa service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:12 user nova-compute[75672]: DEBUG nova.compute.manager [req-39f011cc-3cf3-4780-90fc-94126907fd09 req-e1863964-eee2-4e11-88c0-9106c0c42bfa service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] No waiting events found dispatching network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:54:12 user nova-compute[75672]: WARNING nova.compute.manager [req-39f011cc-3cf3-4780-90fc-94126907fd09 req-e1863964-eee2-4e11-88c0-9106c0c42bfa service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received unexpected event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 for instance with vm_state building and task_state spawning.
Nov 30 12:54:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:12 user nova-compute[75672]: INFO nova.compute.manager [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] [instance: 498d231e-d0be-4ea5-9024-669a978b8292] Took 0.88 seconds to detach 1 volumes for instance.
Nov 30 12:54:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:13 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:54:13 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:54:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:13 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Deleted allocations for instance 498d231e-d0be-4ea5-9024-669a978b8292
Nov 30 12:54:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-093edc6b-bfd6-48c4-8efa-7bbcb729096f tempest-TestVolumeBootPattern-1743139468 tempest-TestVolumeBootPattern-1743139468-project-member] Lock "498d231e-d0be-4ea5-9024-669a978b8292" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.071s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:54:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:54:14 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 80050f56-3708-448e-b501-7e930438e94b] Instance spawned successfully.
Nov 30 12:54:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:54:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:54:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:54:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:54:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:54:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:54:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:54:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-b0873229-8db6-4d94-a44f-7fb3f620832a req-4cdcfc05-412d-4970-b6b9-715a4ede48fc service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:54:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b0873229-8db6-4d94-a44f-7fb3f620832a req-4cdcfc05-412d-4970-b6b9-715a4ede48fc service nova] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b0873229-8db6-4d94-a44f-7fb3f620832a req-4cdcfc05-412d-4970-b6b9-715a4ede48fc service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b0873229-8db6-4d94-a44f-7fb3f620832a req-4cdcfc05-412d-4970-b6b9-715a4ede48fc service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-b0873229-8db6-4d94-a44f-7fb3f620832a req-4cdcfc05-412d-4970-b6b9-715a4ede48fc service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] No waiting events found dispatching network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:54:14 user nova-compute[75672]: WARNING nova.compute.manager [req-b0873229-8db6-4d94-a44f-7fb3f620832a req-4cdcfc05-412d-4970-b6b9-715a4ede48fc service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received unexpected event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 for instance with vm_state building and task_state spawning.
Nov 30 12:54:14 user nova-compute[75672]: INFO nova.compute.manager [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 30 12:54:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:54:15 user nova-compute[75672]: INFO nova.compute.manager [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Took 27.35 seconds to build instance.
Nov 30 12:54:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b7880998-06d8-41a0-b18b-217169337462 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "80050f56-3708-448e-b501-7e930438e94b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.466s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Acquiring lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Acquiring lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:25 user nova-compute[75672]: INFO nova.compute.manager [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Terminating instance
Nov 30 12:54:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-b109533e-cbb1-4ef0-8076-5c9f3077f3af req-0d5176b9-57a2-47f7-9de5-def07bbfae0c service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Received event network-vif-unplugged-c15f3413-9806-48cf-8a63-0dc556eb7d8a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b109533e-cbb1-4ef0-8076-5c9f3077f3af req-0d5176b9-57a2-47f7-9de5-def07bbfae0c service nova] Acquiring lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b109533e-cbb1-4ef0-8076-5c9f3077f3af req-0d5176b9-57a2-47f7-9de5-def07bbfae0c service nova] Lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b109533e-cbb1-4ef0-8076-5c9f3077f3af req-0d5176b9-57a2-47f7-9de5-def07bbfae0c service nova] Lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-b109533e-cbb1-4ef0-8076-5c9f3077f3af req-0d5176b9-57a2-47f7-9de5-def07bbfae0c service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] No waiting events found dispatching network-vif-unplugged-c15f3413-9806-48cf-8a63-0dc556eb7d8a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG nova.compute.manager [req-b109533e-cbb1-4ef0-8076-5c9f3077f3af req-0d5176b9-57a2-47f7-9de5-def07bbfae0c service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Received event network-vif-unplugged-c15f3413-9806-48cf-8a63-0dc556eb7d8a for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:54:26 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Instance destroyed successfully.
Nov 30 12:54:26 user nova-compute[75672]: DEBUG nova.objects.instance [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lazy-loading 'resources' on Instance uuid 9d7771dc-198f-4f4f-9083-60bea2dd80fe {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:52:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1480971532',display_name='tempest-VolumesNegativeTest-instance-1480971532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1480971532',id=45,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:52:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c614cd4f3e28445e96017eae9d962db8',ramdisk_id='',reservation_id='r-4raupa0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2040586798',owner_user_name='tempest-VolumesNegativeTest-2040586798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:52:44Z,user_data=None,user_id='d1b93fcc33344132916806925c5f2886',uuid=9d7771dc-198f-4f4f-9083-60bea2dd80fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "address": "fa:16:3e:19:f8:f0", "network": {"id": "e46deca7-df83-4aa0-a78c-b56d6a38f955", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "08b033eb830b4d89adeaa6b52664498e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15f3413-98", "ovs_interfaceid": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Converting VIF {"id": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "address": "fa:16:3e:19:f8:f0", "network": {"id": "e46deca7-df83-4aa0-a78c-b56d6a38f955", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "08b033eb830b4d89adeaa6b52664498e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15f3413-98", "ovs_interfaceid": "c15f3413-9806-48cf-8a63-0dc556eb7d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:f8:f0,bridge_name='br-int',has_traffic_filtering=True,id=c15f3413-9806-48cf-8a63-0dc556eb7d8a,network=Network(e46deca7-df83-4aa0-a78c-b56d6a38f955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc15f3413-98') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG os_vif [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:f8:f0,bridge_name='br-int',has_traffic_filtering=True,id=c15f3413-9806-48cf-8a63-0dc556eb7d8a,network=Network(e46deca7-df83-4aa0-a78c-b56d6a38f955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc15f3413-98') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc15f3413-98, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6203fb63-d1b3-4160-85e5-a3efba638b52) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:26 user nova-compute[75672]: INFO os_vif [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:f8:f0,bridge_name='br-int',has_traffic_filtering=True,id=c15f3413-9806-48cf-8a63-0dc556eb7d8a,network=Network(e46deca7-df83-4aa0-a78c-b56d6a38f955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc15f3413-98')
Nov 30 12:54:26 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Deleting instance files /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe_del
Nov 30 12:54:26 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Deletion of /opt/stack/data/nova/instances/9d7771dc-198f-4f4f-9083-60bea2dd80fe_del complete
Nov 30 12:54:26 user nova-compute[75672]: INFO nova.compute.manager [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 30 12:54:26 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:54:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:27 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:54:27 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Took 0.45 seconds to deallocate network for instance.
Nov 30 12:54:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-30346de2-cf89-4ffd-ad3d-1a8178cc06cd req-d02164c5-2a7f-45a0-a8f3-7e988084e209 service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Received event network-vif-deleted-c15f3413-9806-48cf-8a63-0dc556eb7d8a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:54:27 user nova-compute[75672]: INFO nova.compute.manager [req-30346de2-cf89-4ffd-ad3d-1a8178cc06cd req-d02164c5-2a7f-45a0-a8f3-7e988084e209 service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Neutron deleted interface c15f3413-9806-48cf-8a63-0dc556eb7d8a; detaching it from the instance and deleting it from the info cache
Nov 30 12:54:27 user nova-compute[75672]: DEBUG nova.network.neutron [req-30346de2-cf89-4ffd-ad3d-1a8178cc06cd req-d02164c5-2a7f-45a0-a8f3-7e988084e209 service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:54:27 user nova-compute[75672]: DEBUG nova.compute.manager [req-30346de2-cf89-4ffd-ad3d-1a8178cc06cd req-d02164c5-2a7f-45a0-a8f3-7e988084e209 service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Detach interface failed, port_id=c15f3413-9806-48cf-8a63-0dc556eb7d8a, reason: Instance 9d7771dc-198f-4f4f-9083-60bea2dd80fe could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:54:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:27 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:54:27 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:54:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:27 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Deleted allocations for instance 9d7771dc-198f-4f4f-9083-60bea2dd80fe
Nov 30 12:54:27 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-156c3ffd-1aba-440f-9af3-38a4d5c51afa tempest-VolumesNegativeTest-2040586798 tempest-VolumesNegativeTest-2040586798-project-member] Lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.858s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:28 user nova-compute[75672]: DEBUG nova.compute.manager [req-18a4c146-9e72-4e53-8fca-1f5fab1f949a req-47b57a55-73fe-498a-becb-f61540c07196 service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Received event network-vif-plugged-c15f3413-9806-48cf-8a63-0dc556eb7d8a {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:54:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-18a4c146-9e72-4e53-8fca-1f5fab1f949a req-47b57a55-73fe-498a-becb-f61540c07196 service nova] Acquiring lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-18a4c146-9e72-4e53-8fca-1f5fab1f949a req-47b57a55-73fe-498a-becb-f61540c07196 service nova] Lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:28 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-18a4c146-9e72-4e53-8fca-1f5fab1f949a req-47b57a55-73fe-498a-becb-f61540c07196 service nova] Lock "9d7771dc-198f-4f4f-9083-60bea2dd80fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:28 user nova-compute[75672]: DEBUG nova.compute.manager [req-18a4c146-9e72-4e53-8fca-1f5fab1f949a req-47b57a55-73fe-498a-becb-f61540c07196 service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] No waiting events found dispatching network-vif-plugged-c15f3413-9806-48cf-8a63-0dc556eb7d8a {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:54:28 user nova-compute[75672]: WARNING nova.compute.manager [req-18a4c146-9e72-4e53-8fca-1f5fab1f949a req-47b57a55-73fe-498a-becb-f61540c07196 service nova] [instance: 9d7771dc-198f-4f4f-9083-60bea2dd80fe] Received unexpected event network-vif-plugged-c15f3413-9806-48cf-8a63-0dc556eb7d8a for instance with vm_state deleted and task_state None.
Nov 30 12:54:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "cd6672f6-3d59-4311-b213-aee62517f868" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cd6672f6-3d59-4311-b213-aee62517f868" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:34 user nova-compute[75672]: INFO nova.compute.manager [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Detaching volume 3b287cce-e44c-4d2d-aa5f-293db072f2a6
Nov 30 12:54:34 user nova-compute[75672]: INFO nova.virt.block_device [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Attempting to driver detach volume 3b287cce-e44c-4d2d-aa5f-293db072f2a6 from mountpoint /dev/vdb
Nov 30 12:54:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Attempting to detach device vdb from instance cd6672f6-3d59-4311-b213-aee62517f868 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:54:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:54:34 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:54:34 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 12:54:34 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:54:34 user nova-compute[75672]:   <serial>3b287cce-e44c-4d2d-aa5f-293db072f2a6</serial>
Nov 30 12:54:34 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:54:34 user nova-compute[75672]: </disk>
Nov 30 12:54:34 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:54:34 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Successfully detached device vdb from instance cd6672f6-3d59-4311-b213-aee62517f868 from the persistent domain config.
Nov 30 12:54:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd6672f6-3d59-4311-b213-aee62517f868 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:54:34 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:54:34 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:54:34 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 12:54:34 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:54:34 user nova-compute[75672]:   <serial>3b287cce-e44c-4d2d-aa5f-293db072f2a6</serial>
Nov 30 12:54:34 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:54:34 user nova-compute[75672]: </disk>
Nov 30 12:54:34 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:54:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "cd6672f6-3d59-4311-b213-aee62517f868" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd6672f6-3d59-4311-b213-aee62517f868 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:54:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:44 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:54:45 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:54:45 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:54:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-c00b64bd-8011-4609-8953-315f1e655930" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:54:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-c00b64bd-8011-4609-8953-315f1e655930" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:54:45 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: c00b64bd-8011-4609-8953-315f1e655930] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:54:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: c00b64bd-8011-4609-8953-315f1e655930] Updating instance_info_cache with network_info: [{"id": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "address": "fa:16:3e:d5:5a:b2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1b4262-1c", "ovs_interfaceid": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:54:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-c00b64bd-8011-4609-8953-315f1e655930" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:54:46 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: c00b64bd-8011-4609-8953-315f1e655930] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:54:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:54:48 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:54:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:48 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:54:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:54:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:54:51 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:54:51 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=7924MB free_disk=24.82564926147461GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance c00b64bd-8011-4609-8953-315f1e655930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance cd6672f6-3d59-4311-b213-aee62517f868 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f5e20a72-18eb-4e06-a28e-d1bc9f88f64a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 80050f56-3708-448e-b501-7e930438e94b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:54:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:54 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:54:54 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:54:54 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:54:55 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd6672f6-3d59-4311-b213-aee62517f868 is timed out.
Nov 30 12:54:55 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Successfully detached device vdb from instance cd6672f6-3d59-4311-b213-aee62517f868 from the live domain config.
Nov 30 12:54:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWXaZKfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:54:55 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd008301-7fed-4f25-9015-a79c9a82db9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:54:55 user nova-compute[75672]: No targets found.
Nov 30 12:54:55 user nova-compute[75672]: iSNS:
Nov 30 12:54:55 user nova-compute[75672]: No targets found.
Nov 30 12:54:55 user nova-compute[75672]: STATIC:
Nov 30 12:54:55 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74
Nov 30 12:54:55 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:54:55 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:54:55 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:54:55 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:54:55 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:54:55 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6
Nov 30 12:54:55 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:54:55 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:54:55 user nova-compute[75672]: FIRMWARE:
Nov 30 12:54:55 user nova-compute[75672]: No targets found.
Nov 30 12:54:55 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:54:55 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:54:55 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e9c193-7921-4e1b-b920-e676521a1e92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32dc2b4-dd88-42be-88ad-3f5135050870]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:54:55 user nova-compute[75672]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)
Nov 30 12:54:55 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:54:55 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:54:55 user nova-compute[75672]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 (non-flash)
Nov 30 12:54:55 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:54:55 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcb46d31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7899c848-f6b1-4d24-8baa-1533b9797c15]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46293d4-3f74-4c92-a3c4-029affc23a9b]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96852bb-646d-49d7-9a7a-b5495e99bb0a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[682be931-4faa-44af-a611-008b9051e52b]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1714f17a-5d31-48ee-aa58-cbc28b4f379f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[53053a6a-ec20-4b21-acad-cdc5a87d6205]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6, portal: 172.16.0.220,3260]
Nov 30 12:54:55 user nova-compute[75672]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6, portal: 172.16.0.220,3260] successful.
Nov 30 12:54:55 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bb2876-6383-4e59-820c-24fa8fc8034a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] <== disconnect_volume: return (311ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:54:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:54:56 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:54:56 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:54:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:54:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:54:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:54:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:54:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lazy-loading 'flavor' on Instance uuid cd6672f6-3d59-4311-b213-aee62517f868 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c208867a-11e5-4949-8baa-33c7de6a0174 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cd6672f6-3d59-4311-b213-aee62517f868" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.646s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cd6672f6-3d59-4311-b213-aee62517f868" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 23.535s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "cd6672f6-3d59-4311-b213-aee62517f868-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cd6672f6-3d59-4311-b213-aee62517f868-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cd6672f6-3d59-4311-b213-aee62517f868-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:58 user nova-compute[75672]: INFO nova.compute.manager [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Terminating instance
Nov 30 12:54:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-99b9f18f-5367-4751-82fc-08b061fb3716 req-7d4c8dfb-8354-49a8-9f95-bb5239d794c5 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Received event network-vif-unplugged-c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-99b9f18f-5367-4751-82fc-08b061fb3716 req-7d4c8dfb-8354-49a8-9f95-bb5239d794c5 service nova] Acquiring lock "cd6672f6-3d59-4311-b213-aee62517f868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-99b9f18f-5367-4751-82fc-08b061fb3716 req-7d4c8dfb-8354-49a8-9f95-bb5239d794c5 service nova] Lock "cd6672f6-3d59-4311-b213-aee62517f868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-99b9f18f-5367-4751-82fc-08b061fb3716 req-7d4c8dfb-8354-49a8-9f95-bb5239d794c5 service nova] Lock "cd6672f6-3d59-4311-b213-aee62517f868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-99b9f18f-5367-4751-82fc-08b061fb3716 req-7d4c8dfb-8354-49a8-9f95-bb5239d794c5 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] No waiting events found dispatching network-vif-unplugged-c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-99b9f18f-5367-4751-82fc-08b061fb3716 req-7d4c8dfb-8354-49a8-9f95-bb5239d794c5 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Received event network-vif-unplugged-c1570a44-7d9b-4e09-9005-cd6fd016a602 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-5429260d-8dda-41ab-aed1-22d86f6df9e3 req-e0f0896a-0578-45c2-a437-67af89a0c4d5 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Received event network-changed-2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-5429260d-8dda-41ab-aed1-22d86f6df9e3 req-e0f0896a-0578-45c2-a437-67af89a0c4d5 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Refreshing instance network info cache due to event network-changed-2bec6ecb-cf05-4ca4-bfe8-352f139903de. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5429260d-8dda-41ab-aed1-22d86f6df9e3 req-e0f0896a-0578-45c2-a437-67af89a0c4d5 service nova] Acquiring lock "refresh_cache-a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5429260d-8dda-41ab-aed1-22d86f6df9e3 req-e0f0896a-0578-45c2-a437-67af89a0c4d5 service nova] Acquired lock "refresh_cache-a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG nova.network.neutron [req-5429260d-8dda-41ab-aed1-22d86f6df9e3 req-e0f0896a-0578-45c2-a437-67af89a0c4d5 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Refreshing network info cache for port 2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:54:58 user nova-compute[75672]: INFO nova.compute.manager [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Terminating instance
Nov 30 12:54:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Instance destroyed successfully.
Nov 30 12:54:58 user nova-compute[75672]: DEBUG nova.objects.instance [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lazy-loading 'resources' on Instance uuid cd6672f6-3d59-4311-b213-aee62517f868 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:52:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-734764111',display_name='tempest-VolumesSnapshotTestJSON-instance-734764111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-734764111',id=44,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/4xtK336lut8V0nEdldL5nfRJsHz7EPtKCjLVdkmiKfWUPZwWZalAlWdrsSoabdI4VtF8XxFjnqfY+CRVoERanYpy0udpJnjIwokOrP37crXCjIDhvi3nYBQMnAvmDTQ==',key_name='tempest-keypair-1785605369',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:52:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eae82e7799446a4af16b2b239c2003f',ramdisk_id='',reservation_id='r-rspoyar9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-453020492',owner_user_name='tempest-VolumesSnapshotTestJSON-453020492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:52:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4204698d39994cf8aab1a59ddc16e387',uuid=cd6672f6-3d59-4311-b213-aee62517f868,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "address": "fa:16:3e:99:4d:34", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1570a44-7d", "ovs_interfaceid": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Converting VIF {"id": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "address": "fa:16:3e:99:4d:34", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1570a44-7d", "ovs_interfaceid": "c1570a44-7d9b-4e09-9005-cd6fd016a602", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:4d:34,bridge_name='br-int',has_traffic_filtering=True,id=c1570a44-7d9b-4e09-9005-cd6fd016a602,network=Network(fcb1c4a1-0917-4076-9739-0989986069ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1570a44-7d') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG os_vif [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:4d:34,bridge_name='br-int',has_traffic_filtering=True,id=c1570a44-7d9b-4e09-9005-cd6fd016a602,network=Network(fcb1c4a1-0917-4076-9739-0989986069ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1570a44-7d') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1570a44-7d, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43ee6572-18f9-44e4-9176-a895e0950304) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:58 user nova-compute[75672]: INFO os_vif [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:4d:34,bridge_name='br-int',has_traffic_filtering=True,id=c1570a44-7d9b-4e09-9005-cd6fd016a602,network=Network(fcb1c4a1-0917-4076-9739-0989986069ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1570a44-7d')
Nov 30 12:54:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWXaZKfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:54:58 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:54:58 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[67261480-4509-421d-a0f3-1ca8b173c82a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:54:58 user nova-compute[75672]: No targets found.
Nov 30 12:54:58 user nova-compute[75672]: iSNS:
Nov 30 12:54:58 user nova-compute[75672]: No targets found.
Nov 30 12:54:58 user nova-compute[75672]: STATIC:
Nov 30 12:54:58 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74
Nov 30 12:54:58 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:54:58 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:54:58 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:54:58 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:54:58 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:54:58 user nova-compute[75672]: FIRMWARE:
Nov 30 12:54:58 user nova-compute[75672]: No targets found.
Nov 30 12:54:58 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:54:58 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:54:58 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b287cce-e44c-4d2d-aa5f-293db072f2a6', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e43ef99-1331-4766-9018-b4d55a447fc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e79ae89-7c9c-4a31-b6d1-8d79e043eaee]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:54:59 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:54:59 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:54:59 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:54:59 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd4669480>, {}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Disconnecting from: [] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] <== disconnect_volume: return (74ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:54:59 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Deleting instance files /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868_del
Nov 30 12:54:59 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Deletion of /opt/stack/data/nova/instances/cd6672f6-3d59-4311-b213-aee62517f868_del complete
Nov 30 12:54:59 user nova-compute[75672]: INFO nova.compute.manager [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 30 12:54:59 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: cd6672f6-3d59-4311-b213-aee62517f868] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG nova.network.neutron [req-5429260d-8dda-41ab-aed1-22d86f6df9e3 req-e0f0896a-0578-45c2-a437-67af89a0c4d5 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Updated VIF entry in instance network info cache for port 2bec6ecb-cf05-4ca4-bfe8-352f139903de. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG nova.network.neutron [req-5429260d-8dda-41ab-aed1-22d86f6df9e3 req-e0f0896a-0578-45c2-a437-67af89a0c4d5 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Updating instance_info_cache with network_info: [{"id": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "address": "fa:16:3e:a2:c8:b8", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec6ecb-cf", "ovs_interfaceid": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5429260d-8dda-41ab-aed1-22d86f6df9e3 req-e0f0896a-0578-45c2-a437-67af89a0c4d5 service nova] Releasing lock "refresh_cache-a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:59 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Instance destroyed successfully.
Nov 30 12:54:59 user nova-compute[75672]: DEBUG nova.objects.instance [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lazy-loading 'resources' on Instance uuid a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-151961309',display_name='tempest-TestStampPattern-server-151961309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-151961309',id=38,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuijQmPQJraElz60vaRaG/e8nrlOXht9CJYkW2bgFzbRFpEhWL7TMKFRy/q/cr8dhtExqxBW2eC1142b+wZVginkATR2akVdepgzX/hlOLrLqJpXg6xSJ07bI2dQ6OD6A==',key_name='tempest-TestStampPattern-1531471902',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:47:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f78ee16221704ff48f3ce5ff927aad62',ramdisk_id='',reservation_id='r-poodbyye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2034271615',owner_user_name='tempest-TestStampPattern-2034271615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:50:58Z,user_data=None,user_id='8aec8237a0eb47fc891389705f0cc270',uuid=a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "address": "fa:16:3e:a2:c8:b8", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec6ecb-cf", "ovs_interfaceid": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Converting VIF {"id": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "address": "fa:16:3e:a2:c8:b8", "network": {"id": "1bf9e732-dd63-4d07-adfa-89a3ffde5dc5", "bridge": "br-int", "label": "tempest-TestStampPattern-1389521236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ee16221704ff48f3ce5ff927aad62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec6ecb-cf", "ovs_interfaceid": "2bec6ecb-cf05-4ca4-bfe8-352f139903de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c8:b8,bridge_name='br-int',has_traffic_filtering=True,id=2bec6ecb-cf05-4ca4-bfe8-352f139903de,network=Network(1bf9e732-dd63-4d07-adfa-89a3ffde5dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bec6ecb-cf') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG os_vif [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c8:b8,bridge_name='br-int',has_traffic_filtering=True,id=2bec6ecb-cf05-4ca4-bfe8-352f139903de,network=Network(1bf9e732-dd63-4d07-adfa-89a3ffde5dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bec6ecb-cf') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bec6ecb-cf, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9de9e9bd-001c-4b31-8ac4-db987826f31b) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:54:59 user nova-compute[75672]: INFO os_vif [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c8:b8,bridge_name='br-int',has_traffic_filtering=True,id=2bec6ecb-cf05-4ca4-bfe8-352f139903de,network=Network(1bf9e732-dd63-4d07-adfa-89a3ffde5dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bec6ecb-cf')
Nov 30 12:54:59 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Deleting instance files /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df_del
Nov 30 12:54:59 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Deletion of /opt/stack/data/nova/instances/a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df_del complete
Nov 30 12:54:59 user nova-compute[75672]: INFO nova.compute.manager [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 30 12:54:59 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:54:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:00 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Took 0.41 seconds to deallocate network for instance.
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Received event network-vif-plugged-c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] Acquiring lock "cd6672f6-3d59-4311-b213-aee62517f868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] Lock "cd6672f6-3d59-4311-b213-aee62517f868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] Lock "cd6672f6-3d59-4311-b213-aee62517f868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] No waiting events found dispatching network-vif-plugged-c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:55:00 user nova-compute[75672]: WARNING nova.compute.manager [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Received unexpected event network-vif-plugged-c1570a44-7d9b-4e09-9005-cd6fd016a602 for instance with vm_state active and task_state deleting.
Nov 30 12:55:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Received event network-vif-unplugged-2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] Acquiring lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] No waiting events found dispatching network-vif-unplugged-2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:55:00 user nova-compute[75672]: WARNING nova.compute.manager [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Received unexpected event network-vif-unplugged-2bec6ecb-cf05-4ca4-bfe8-352f139903de for instance with vm_state deleted and task_state None.
Nov 30 12:55:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Received event network-vif-plugged-2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] Acquiring lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] No waiting events found dispatching network-vif-plugged-2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:55:00 user nova-compute[75672]: WARNING nova.compute.manager [req-9b955fc2-bef0-4bf4-99ac-c22a4025f76f req-6236b27d-52e1-4aa9-bc58-ae2ab653ba35 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Received unexpected event network-vif-plugged-2bec6ecb-cf05-4ca4-bfe8-352f139903de for instance with vm_state deleted and task_state None.
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:00 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Deleted allocations for instance a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:55:00 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Took 1.50 seconds to deallocate network for instance.
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-551e3bd4-d78b-4464-8573-055ee0cf9132 tempest-TestStampPattern-2034271615 tempest-TestStampPattern-2034271615-project-member] Lock "a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.923s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:00 user nova-compute[75672]: WARNING nova.volume.cinder [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Attachment a4366eeb-b986-4fa4-b782-473ebd99ea4b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a4366eeb-b986-4fa4-b782-473ebd99ea4b. (HTTP 404) (Request-ID: req-017b5f94-283d-4b9e-93dc-9dade9dc9c89)
Nov 30 12:55:00 user nova-compute[75672]: INFO nova.compute.manager [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Took 0.02 seconds to detach 1 volumes for instance.
Nov 30 12:55:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-9f9def2a-5403-4cb4-8a85-bf21be066268 req-49377af4-2163-4681-86fa-c79ac4cbe159 service nova] [instance: a9c16a2c-4cc1-4ba2-b4c3-70dd7f5580df] Received event network-vif-deleted-2bec6ecb-cf05-4ca4-bfe8-352f139903de {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:55:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:00 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Deleted allocations for instance cd6672f6-3d59-4311-b213-aee62517f868
Nov 30 12:55:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-73cc03d4-79e6-468a-9cfd-4d57420fc74b tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cd6672f6-3d59-4311-b213-aee62517f868" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.971s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-59542959-1952-4622-b07e-8422962151e3 req-f1d55d6a-0cec-45af-9368-b19178d5e24d service nova] [instance: cd6672f6-3d59-4311-b213-aee62517f868] Received event network-vif-deleted-c1570a44-7d9b-4e09-9005-cd6fd016a602 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-d9a46687-4db9-4fe4-8987-96a69f367d31 req-37114650-894a-424b-8e3a-56eaeefeae7b service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received event network-changed-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-d9a46687-4db9-4fe4-8987-96a69f367d31 req-37114650-894a-424b-8e3a-56eaeefeae7b service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Refreshing instance network info cache due to event network-changed-0f14b102-12f4-4138-9227-d231693b61e8. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:55:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d9a46687-4db9-4fe4-8987-96a69f367d31 req-37114650-894a-424b-8e3a-56eaeefeae7b service nova] Acquiring lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:55:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d9a46687-4db9-4fe4-8987-96a69f367d31 req-37114650-894a-424b-8e3a-56eaeefeae7b service nova] Acquired lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:55:36 user nova-compute[75672]: DEBUG nova.network.neutron [req-d9a46687-4db9-4fe4-8987-96a69f367d31 req-37114650-894a-424b-8e3a-56eaeefeae7b service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Refreshing network info cache for port 0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:55:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:36 user nova-compute[75672]: DEBUG nova.network.neutron [req-d9a46687-4db9-4fe4-8987-96a69f367d31 req-37114650-894a-424b-8e3a-56eaeefeae7b service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updated VIF entry in instance network info cache for port 0f14b102-12f4-4138-9227-d231693b61e8. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:55:36 user nova-compute[75672]: DEBUG nova.network.neutron [req-d9a46687-4db9-4fe4-8987-96a69f367d31 req-37114650-894a-424b-8e3a-56eaeefeae7b service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updating instance_info_cache with network_info: [{"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:55:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d9a46687-4db9-4fe4-8987-96a69f367d31 req-37114650-894a-424b-8e3a-56eaeefeae7b service nova] Releasing lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:55:38 user nova-compute[75672]: INFO nova.compute.manager [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Rescuing
Nov 30 12:55:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "refresh_cache-80050f56-3708-448e-b501-7e930438e94b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:55:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquired lock "refresh_cache-80050f56-3708-448e-b501-7e930438e94b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:55:38 user nova-compute[75672]: DEBUG nova.network.neutron [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:55:39 user nova-compute[75672]: DEBUG nova.network.neutron [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Updating instance_info_cache with network_info: [{"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:55:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Releasing lock "refresh_cache-80050f56-3708-448e-b501-7e930438e94b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:55:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-3d7ce34a-0812-4db2-b9e8-e2f7b0f4be65 req-cb9b4e0c-d157-4a69-98b3-7613a8f1d9d4 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-vif-unplugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3d7ce34a-0812-4db2-b9e8-e2f7b0f4be65 req-cb9b4e0c-d157-4a69-98b3-7613a8f1d9d4 service nova] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3d7ce34a-0812-4db2-b9e8-e2f7b0f4be65 req-cb9b4e0c-d157-4a69-98b3-7613a8f1d9d4 service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3d7ce34a-0812-4db2-b9e8-e2f7b0f4be65 req-cb9b4e0c-d157-4a69-98b3-7613a8f1d9d4 service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-3d7ce34a-0812-4db2-b9e8-e2f7b0f4be65 req-cb9b4e0c-d157-4a69-98b3-7613a8f1d9d4 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] No waiting events found dispatching network-vif-unplugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:55:39 user nova-compute[75672]: WARNING nova.compute.manager [req-3d7ce34a-0812-4db2-b9e8-e2f7b0f4be65 req-cb9b4e0c-d157-4a69-98b3-7613a8f1d9d4 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received unexpected event network-vif-unplugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 for instance with vm_state active and task_state rescuing.
Nov 30 12:55:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:40 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 80050f56-3708-448e-b501-7e930438e94b] Instance destroyed successfully.
Nov 30 12:55:40 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Attempting a stable device rescue
Nov 30 12:55:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75672) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Nov 30 12:55:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Instance directory exists: not creating {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Nov 30 12:55:40 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Creating image(s)
Nov 30 12:55:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "/opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "/opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "/opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:40 user nova-compute[75672]: DEBUG nova.objects.instance [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'trusted_certs' on Instance uuid 80050f56-3708-448e-b501-7e930438e94b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:55:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "32c3f14dc97a3ae8f2dddba42d82066dea3a3431" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "32c3f14dc97a3ae8f2dddba42d82066dea3a3431" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431.part --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:41 user nova-compute[75672]: DEBUG nova.compute.manager [req-ddfa91af-aaa1-421a-a352-e9648edb6fa2 req-93bfb03f-9991-44d8-af87-bb8ae6ff737b service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ddfa91af-aaa1-421a-a352-e9648edb6fa2 req-93bfb03f-9991-44d8-af87-bb8ae6ff737b service nova] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ddfa91af-aaa1-421a-a352-e9648edb6fa2 req-93bfb03f-9991-44d8-af87-bb8ae6ff737b service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-ddfa91af-aaa1-421a-a352-e9648edb6fa2 req-93bfb03f-9991-44d8-af87-bb8ae6ff737b service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:41 user nova-compute[75672]: DEBUG nova.compute.manager [req-ddfa91af-aaa1-421a-a352-e9648edb6fa2 req-93bfb03f-9991-44d8-af87-bb8ae6ff737b service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] No waiting events found dispatching network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:55:41 user nova-compute[75672]: WARNING nova.compute.manager [req-ddfa91af-aaa1-421a-a352-e9648edb6fa2 req-93bfb03f-9991-44d8-af87-bb8ae6ff737b service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received unexpected event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 for instance with vm_state active and task_state rescuing.
Nov 30 12:55:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431.part --force-share --output=json" returned: 0 in 0.219s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:41 user nova-compute[75672]: DEBUG nova.virt.images [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] ac1beb08-2b6c-4aec-b2c9-8f72723c75d3 was qcow2, converting to raw {{(pid=75672) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 12:55:41 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:55:41 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431.part /opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431.converted {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:42 user nova-compute[75672]: INFO nova.compute.manager [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Shelving
Nov 30 12:55:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431.part /opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431.converted" returned: 0 in 0.747s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431.converted --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "32c3f14dc97a3ae8f2dddba42d82066dea3a3431" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.737s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-1a8efcc9-7c86-47f5-a949-b753bc887ae9 req-22bea73a-e87c-40bd-b97c-ad3560df748a service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received event network-vif-unplugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1a8efcc9-7c86-47f5-a949-b753bc887ae9 req-22bea73a-e87c-40bd-b97c-ad3560df748a service nova] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1a8efcc9-7c86-47f5-a949-b753bc887ae9 req-22bea73a-e87c-40bd-b97c-ad3560df748a service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1a8efcc9-7c86-47f5-a949-b753bc887ae9 req-22bea73a-e87c-40bd-b97c-ad3560df748a service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG nova.compute.manager [req-1a8efcc9-7c86-47f5-a949-b753bc887ae9 req-22bea73a-e87c-40bd-b97c-ad3560df748a service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] No waiting events found dispatching network-vif-unplugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:55:42 user nova-compute[75672]: WARNING nova.compute.manager [req-1a8efcc9-7c86-47f5-a949-b753bc887ae9 req-22bea73a-e87c-40bd-b97c-ad3560df748a service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received unexpected event network-vif-unplugged-0f14b102-12f4-4138-9227-d231693b61e8 for instance with vm_state active and task_state shelving.
Nov 30 12:55:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "32c3f14dc97a3ae8f2dddba42d82066dea3a3431" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "32c3f14dc97a3ae8f2dddba42d82066dea3a3431" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:42 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431 --force-share --output=json" returned: 0 in 0.193s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431,backing_fmt=raw /opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/disk.rescue {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:43 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Instance destroyed successfully.
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431,backing_fmt=raw /opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/disk.rescue" returned: 0 in 0.082s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "32c3f14dc97a3ae8f2dddba42d82066dea3a3431" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.objects.instance [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'migration_context' on Instance uuid 80050f56-3708-448e-b501-7e930438e94b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.objects.base [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Object Instance<80050f56-3708-448e-b501-7e930438e94b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Start _get_guest_xml network_info=[{"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "vif_mac": "fa:16:3e:7e:65:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ac1beb08-2b6c-4aec-b2c9-8f72723c75d3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'e45397ea-de81-4205-8097-e8c541172e67', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unIFSckN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '80050f56-3708-448e-b501-7e930438e94b', 'attached_at': '', 'detached_at': '', 'volume_id': '9f5a1108-315a-43cf-9248-ff49b3e57d74', 'serial': '9f5a1108-315a-43cf-9248-ff49b3e57d74'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.objects.instance [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'resources' on Instance uuid 80050f56-3708-448e-b501-7e930438e94b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.objects.base [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Object Instance<80050f56-3708-448e-b501-7e930438e94b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.objects.instance [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'numa_topology' on Instance uuid 80050f56-3708-448e-b501-7e930438e94b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.objects.base [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Object Instance<80050f56-3708-448e-b501-7e930438e94b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:55:43 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:55:43 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:55:43 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Beginning cold snapshot process
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.objects.instance [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80050f56-3708-448e-b501-7e930438e94b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.objects.base [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Object Instance<80050f56-3708-448e-b501-7e930438e94b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unIFSckN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:55:43 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:55:43 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:55:43 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5500107c-a85d-49ac-a72b-ceb90d81cd59]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = unIFSckN\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 12:55:43 user nova-compute[75672]: node.name = iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74
Nov 30 12:55:43 user nova-compute[75672]: node.tpgt = -1
Nov 30 12:55:43 user nova-compute[75672]: node.startup = automatic
Nov 30 12:55:43 user nova-compute[75672]: node.leading_login = No
Nov 30 12:55:43 user nova-compute[75672]: iface.iscsi_ifacename = default
Nov 30 12:55:43 user nova-compute[75672]: iface.net_ifacename = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.ipaddress = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.prefix_len = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.hwaddress = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.transport_name = tcp
Nov 30 12:55:43 user nova-compute[75672]: iface.initiatorname = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.state = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.vlan_id = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.vlan_priority = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.vlan_state = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.iface_num = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.mtu = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.port = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.bootproto = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.subnet_mask = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.gateway = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.dhcp_alt_client_id = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.dhcp_dns = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.dhcp_learn_iqn = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.dhcp_vendor_id_state = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.dhcp_vendor_id = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.dhcp_slp_da = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.fragmentation = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.gratuitous_arp = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.incoming_forwarding = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.tos_state = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.tos = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.ttl = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.delayed_ack = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.tcp_nagle = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.tcp_wsf_state = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.tcp_wsf = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.tcp_timer_scale = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.tcp_timestamp = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.redirect = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.def_task_mgmt_timeout = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.header_digest = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.data_digest = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.immediate_data = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.initial_r2t = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.data_seq_inorder = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.data_pdu_inorder = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.erl = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.max_receive_data_len = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.first_burst_len = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.max_outstanding_r2t = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.max_burst_len = 0
Nov 30 12:55:43 user nova-compute[75672]: iface.chap_auth = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.bidi_chap = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.strict_login_compliance = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.discovery_auth = <empty>
Nov 30 12:55:43 user nova-compute[75672]: iface.discovery_logout = <empty>
Nov 30 12:55:43 user nova-compute[75672]: node.discovery_address = <empty>
Nov 30 12:55:43 user nova-compute[75672]: node.discovery_port = 0
Nov 30 12:55:43 user nova-compute[75672]: node.discovery_type = static
Nov 30 12:55:43 user nova-compute[75672]: node.session.initial_cmdsn = 0
Nov 30 12:55:43 user nova-compute[75672]: node.session.initial_login_retry_max = 8
Nov 30 12:55:43 user nova-compute[75672]: node.session.xmit_thread_priority = -20
Nov 30 12:55:43 user nova-compute[75672]: node.session.cmds_max = 128
Nov 30 12:55:43 user nova-compute[75672]: node.session.queue_depth = 32
Nov 30 12:55:43 user nova-compute[75672]: node.session.nr_sessions = 1
Nov 30 12:55:43 user nova-compute[75672]: node.session.auth.authmethod = CHAP
Nov 30 12:55:43 user nova-compute[75672]: node.session.auth.username = unIFSckN
Nov 30 12:55:43 user nova-compute[75672]: node.session.auth.password = ***
Nov 30 12:55:43 user nova-compute[75672]: node.session.auth.username_in = <empty>
Nov 30 12:55:43 user nova-compute[75672]: node.session.auth.password_in = <empty>
Nov 30 12:55:43 user nova-compute[75672]: node.session.auth.chap_algs = MD5
Nov 30 12:55:43 user nova-compute[75672]: node.session.timeo.replacement_timeout = 120
Nov 30 12:55:43 user nova-compute[75672]: node.session.err_timeo.abort_timeout = 15
Nov 30 12:55:43 user nova-compute[75672]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 12:55:43 user nova-compute[75672]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 12:55:43 user nova-compute[75672]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 12:55:43 user nova-compute[75672]: node.session.iscsi.FastAbort = Yes
Nov 30 12:55:43 user nova-compute[75672]: node.session.iscsi.InitialR2T = No
Nov 30 12:55:43 user nova-compute[75672]: node.session.iscsi.ImmediateData = Yes
Nov 30 12:55:43 user nova-compute[75672]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 12:55:43 user nova-compute[75672]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 12:55:43 user nova-compute[75672]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 12:55:43 user nova-compute[75672]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 12:55:43 user nova-compute[75672]: node.session.iscsi.MaxConnections = 1
Nov 30 12:55:43 user nova-compute[75672]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 12:55:43 user nova-compute[75672]: node.session.iscsi.ERL = 0
Nov 30 12:55:43 user nova-compute[75672]: node.session.scan = manual
Nov 30 12:55:43 user nova-compute[75672]: node.session.reopen_max = 0
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].address = 172.16.0.220
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].port = 3260
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].startup = manual
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].tcp.window_size = 524288
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].tcp.type_of_service = 0
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].timeo.logout_timeout = 15
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].timeo.login_timeout = 15
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].timeo.auth_timeout = 45
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].iscsi.DataDigest = None
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].iscsi.IFMarker = No
Nov 30 12:55:43 user nova-compute[75672]: node.conn[0].iscsi.OFMarker = No
Nov 30 12:55:43 user nova-compute[75672]: # END RECORD
Nov 30 12:55:43 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abe1b38-f64f-44e8-b8eb-28c9540f9966]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ded816-6d53-4c58-94ce-6202767ea652]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v unIFSckN {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v unIFSckN" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e85710-c428-412e-a40c-e88b2b0f3f6a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'unIFSckN'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6e8c9d-4fe6-4661-bb77-6b22f0e07251]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk /opt/stack/data/nova/instances/snapshots/tmp0n1flets/a098669ebad94403aeb26082ee7ffeb4 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c5b4d0-22e2-4c1d-a1bc-3cafe7297493]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:55:43 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:55:43 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:55:43 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:55:43 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.209s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] HCTL ('36', '0', '0', 0) found on session 49 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf282b8-b909-4093-aada-4fcd452af00e]: (4, ('0 0 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Searching for a device in session 49 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unIFSckN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.240s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] <== connect_volume: return (242ms) {'type': 'block', 'scsi_wwn': '23766393130666439', 'path': '/dev/sde'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766393130666439', 'path': '/dev/sde'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1229297497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1229297497',id=47,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47874c48ecea456eac7968640910afba',ramdisk_id='',reservation_id='r-fkioef23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-547265583',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:54:15Z,user_data=None,user_id='aa5b3c989c934220a07aba162e68ea87',uuid=80050f56-3708-448e-b501-7e930438e94b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "vif_mac": "fa:16:3e:7e:65:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converting VIF {"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "vif_mac": "fa:16:3e:7e:65:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:65:77,bridge_name='br-int',has_traffic_filtering=True,id=0d245425-351d-4f32-bc2e-0c4f4cf9c532,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d245425-35') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.objects.instance [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'pci_devices' on Instance uuid 80050f56-3708-448e-b501-7e930438e94b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.objects.base [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Object Instance<80050f56-3708-448e-b501-7e930438e94b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:55:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:55:43 user nova-compute[75672]:   <uuid>80050f56-3708-448e-b501-7e930438e94b</uuid>
Nov 30 12:55:43 user nova-compute[75672]:   <name>instance-0000002f</name>
Nov 30 12:55:43 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:55:43 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:55:43 user nova-compute[75672]:   <metadata>
Nov 30 12:55:43 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:55:43 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:55:43 user nova-compute[75672]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1229297497</nova:name>
Nov 30 12:55:43 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:55:43</nova:creationTime>
Nov 30 12:55:43 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:55:43 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:55:43 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:55:43 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:55:43 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:55:43 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:55:43 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:55:43 user nova-compute[75672]:       <nova:owner>
Nov 30 12:55:43 user nova-compute[75672]:         <nova:user uuid="aa5b3c989c934220a07aba162e68ea87">tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member</nova:user>
Nov 30 12:55:43 user nova-compute[75672]:         <nova:project uuid="47874c48ecea456eac7968640910afba">tempest-ServerBootFromVolumeStableRescueTest-547265583</nova:project>
Nov 30 12:55:43 user nova-compute[75672]:       </nova:owner>
Nov 30 12:55:43 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:55:43 user nova-compute[75672]:       <nova:ports>
Nov 30 12:55:43 user nova-compute[75672]:         <nova:port uuid="0d245425-351d-4f32-bc2e-0c4f4cf9c532">
Nov 30 12:55:43 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 12:55:43 user nova-compute[75672]:         </nova:port>
Nov 30 12:55:43 user nova-compute[75672]:       </nova:ports>
Nov 30 12:55:43 user nova-compute[75672]:     </nova:instance>
Nov 30 12:55:43 user nova-compute[75672]:   </metadata>
Nov 30 12:55:43 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:55:43 user nova-compute[75672]:     <system>
Nov 30 12:55:43 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:55:43 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:55:43 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:55:43 user nova-compute[75672]:       <entry name="serial">80050f56-3708-448e-b501-7e930438e94b</entry>
Nov 30 12:55:43 user nova-compute[75672]:       <entry name="uuid">80050f56-3708-448e-b501-7e930438e94b</entry>
Nov 30 12:55:43 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:55:43 user nova-compute[75672]:     </system>
Nov 30 12:55:43 user nova-compute[75672]:   </sysinfo>
Nov 30 12:55:43 user nova-compute[75672]:   <os>
Nov 30 12:55:43 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:55:43 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:55:43 user nova-compute[75672]:   </os>
Nov 30 12:55:43 user nova-compute[75672]:   <features>
Nov 30 12:55:43 user nova-compute[75672]:     <acpi/>
Nov 30 12:55:43 user nova-compute[75672]:     <apic/>
Nov 30 12:55:43 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:55:43 user nova-compute[75672]:   </features>
Nov 30 12:55:43 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:55:43 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:55:43 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:55:43 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:55:43 user nova-compute[75672]:   </clock>
Nov 30 12:55:43 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:55:43 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:55:43 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:55:43 user nova-compute[75672]:   </cpu>
Nov 30 12:55:43 user nova-compute[75672]:   <devices>
Nov 30 12:55:43 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:55:43 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:55:43 user nova-compute[75672]:       <source dev="/dev/sde"/>
Nov 30 12:55:43 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:55:43 user nova-compute[75672]:       <serial>9f5a1108-315a-43cf-9248-ff49b3e57d74</serial>
Nov 30 12:55:43 user nova-compute[75672]:     </disk>
Nov 30 12:55:43 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:55:43 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:55:43 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/disk.rescue"/>
Nov 30 12:55:43 user nova-compute[75672]:       <target dev="vdb" bus="virtio"/>
Nov 30 12:55:43 user nova-compute[75672]:       <boot order="1"/>
Nov 30 12:55:43 user nova-compute[75672]:     </disk>
Nov 30 12:55:43 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:55:43 user nova-compute[75672]:       <mac address="fa:16:3e:7e:65:77"/>
Nov 30 12:55:43 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:55:43 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:55:43 user nova-compute[75672]:       <target dev="tap0d245425-35"/>
Nov 30 12:55:43 user nova-compute[75672]:     </interface>
Nov 30 12:55:43 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:55:43 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/console.log" append="off"/>
Nov 30 12:55:43 user nova-compute[75672]:     </serial>
Nov 30 12:55:43 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:55:43 user nova-compute[75672]:     <video>
Nov 30 12:55:43 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:55:43 user nova-compute[75672]:     </video>
Nov 30 12:55:43 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:55:43 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:55:43 user nova-compute[75672]:     </rng>
Nov 30 12:55:43 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:55:43 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:55:43 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:55:43 user nova-compute[75672]:     </memballoon>
Nov 30 12:55:43 user nova-compute[75672]:   </devices>
Nov 30 12:55:43 user nova-compute[75672]: </domain>
Nov 30 12:55:43 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:55:43 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 80050f56-3708-448e-b501-7e930438e94b] Instance destroyed successfully.
Nov 30 12:55:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:55:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:55:44 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] No VIF found with MAC fa:16:3e:7e:65:77, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:55:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk /opt/stack/data/nova/instances/snapshots/tmp0n1flets/a098669ebad94403aeb26082ee7ffeb4" returned: 0 in 0.672s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:44 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Snapshot extracted, beginning image upload
Nov 30 12:55:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-25fcaf04-5061-4859-9c27-acace46d5073 req-b30384a6-1bf1-4702-af9b-dcd6f4c40ece service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received event network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-25fcaf04-5061-4859-9c27-acace46d5073 req-b30384a6-1bf1-4702-af9b-dcd6f4c40ece service nova] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-25fcaf04-5061-4859-9c27-acace46d5073 req-b30384a6-1bf1-4702-af9b-dcd6f4c40ece service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-25fcaf04-5061-4859-9c27-acace46d5073 req-b30384a6-1bf1-4702-af9b-dcd6f4c40ece service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:44 user nova-compute[75672]: DEBUG nova.compute.manager [req-25fcaf04-5061-4859-9c27-acace46d5073 req-b30384a6-1bf1-4702-af9b-dcd6f4c40ece service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] No waiting events found dispatching network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:55:44 user nova-compute[75672]: WARNING nova.compute.manager [req-25fcaf04-5061-4859-9c27-acace46d5073 req-b30384a6-1bf1-4702-af9b-dcd6f4c40ece service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received unexpected event network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 for instance with vm_state active and task_state shelving_image_uploading.
Nov 30 12:55:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:55:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:55:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:47 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Snapshot image upload complete
Nov 30 12:55:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:55:47 user nova-compute[75672]: INFO nova.compute.manager [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Shelve offloading
Nov 30 12:55:47 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Instance destroyed successfully.
Nov 30 12:55:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:55:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:55:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquired lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:55:47 user nova-compute[75672]: DEBUG nova.network.neutron [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:55:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:55:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:55:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:55:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:55:47 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:55:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0822598f-b2e9-42e8-9304-b52803a4adb9 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Updating instance_info_cache with network_info: [{"id": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "address": "fa:16:3e:70:81:44", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc241fa-0a", "ovs_interfaceid": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG nova.compute.manager [req-4601a0fa-5a6a-49df-9238-86bafcc1e186 req-9e3e4bca-86b0-441e-8226-318102e4cb6b service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4601a0fa-5a6a-49df-9238-86bafcc1e186 req-9e3e4bca-86b0-441e-8226-318102e4cb6b service nova] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4601a0fa-5a6a-49df-9238-86bafcc1e186 req-9e3e4bca-86b0-441e-8226-318102e4cb6b service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4601a0fa-5a6a-49df-9238-86bafcc1e186 req-9e3e4bca-86b0-441e-8226-318102e4cb6b service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG nova.compute.manager [req-4601a0fa-5a6a-49df-9238-86bafcc1e186 req-9e3e4bca-86b0-441e-8226-318102e4cb6b service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] No waiting events found dispatching network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:55:48 user nova-compute[75672]: WARNING nova.compute.manager [req-4601a0fa-5a6a-49df-9238-86bafcc1e186 req-9e3e4bca-86b0-441e-8226-318102e4cb6b service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received unexpected event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 for instance with vm_state rescued and task_state None.
Nov 30 12:55:48 user nova-compute[75672]: DEBUG nova.network.neutron [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updating instance_info_cache with network_info: [{"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Releasing lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "9de1abf0-249e-44c5-bad0-23dd475132e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG nova.compute.manager [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:48 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:55:48 user nova-compute[75672]: INFO nova.compute.claims [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Claim successful on node user
Nov 30 12:55:49 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Instance destroyed successfully.
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'resources' on Instance uuid f5e20a72-18eb-4e06-a28e-d1bc9f88f64a {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1480779755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1480779755',id=46,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/4Xthbt7YMcriM6AbB5mTwThqufRFxpj1vCBwiqGrbMgOoMPstysotckw2aKh1s4BlRzesc1LcFIVvsri+pJD+cPC5L10MOGW858Yxbt0zmAWlKJ5vEkcZ+NloSW13rg==',key_name='tempest-keypair-1872424482',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e674749412c04ea3a757ac31928844c6',ramdisk_id='',reservation_id='r-gjk8zon0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792375540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792375540-project-member',shelved_at='2023-11-30T12:55:47.187103',shelved_host='user',shelved_image_id='ccacfb9e-a2e2-4653-9d4e-2b264c27c67e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e87ad9fef5444b4b0124b0bd71f8324',uuid=f5e20a72-18eb-4e06-a28e-d1bc9f88f64a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converting VIF {"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0f14b102-12f4-4138-9227-d231693b61e8,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f14b102-12') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG os_vif [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0f14b102-12f4-4138-9227-d231693b61e8,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f14b102-12') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-892bff51-d091-47a3-b635-6e6454b73cc2 req-80cc02f3-ba0e-4b97-8b33-79a23e5f9619 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received event network-changed-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-892bff51-d091-47a3-b635-6e6454b73cc2 req-80cc02f3-ba0e-4b97-8b33-79a23e5f9619 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Refreshing instance network info cache due to event network-changed-0f14b102-12f4-4138-9227-d231693b61e8. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-892bff51-d091-47a3-b635-6e6454b73cc2 req-80cc02f3-ba0e-4b97-8b33-79a23e5f9619 service nova] Acquiring lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-892bff51-d091-47a3-b635-6e6454b73cc2 req-80cc02f3-ba0e-4b97-8b33-79a23e5f9619 service nova] Acquired lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.network.neutron [req-892bff51-d091-47a3-b635-6e6454b73cc2 req-80cc02f3-ba0e-4b97-8b33-79a23e5f9619 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Refreshing network info cache for port 0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f14b102-12, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b058f87c-e746-48de-ba84-fa665c2d59f2) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:55:49 user nova-compute[75672]: INFO os_vif [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0f14b102-12f4-4138-9227-d231693b61e8,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f14b102-12')
Nov 30 12:55:49 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Deleting instance files /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a_del
Nov 30 12:55:49 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Deletion of /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a_del complete
Nov 30 12:55:49 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Deleted allocations for instance f5e20a72-18eb-4e06-a28e-d1bc9f88f64a
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.compute.manager [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.050s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'numa_topology' on Instance uuid f5e20a72-18eb-4e06-a28e-d1bc9f88f64a {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.objects.base [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Object Instance<f5e20a72-18eb-4e06-a28e-d1bc9f88f64a> lazy-loaded attributes: resources,numa_topology {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.compute.manager [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.network.neutron [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:55:49 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.compute.manager [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.policy [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4204698d39994cf8aab1a59ddc16e387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eae82e7799446a4af16b2b239c2003f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.network.neutron [req-892bff51-d091-47a3-b635-6e6454b73cc2 req-80cc02f3-ba0e-4b97-8b33-79a23e5f9619 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updated VIF entry in instance network info cache for port 0f14b102-12f4-4138-9227-d231693b61e8. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.network.neutron [req-892bff51-d091-47a3-b635-6e6454b73cc2 req-80cc02f3-ba0e-4b97-8b33-79a23e5f9619 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updating instance_info_cache with network_info: [{"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0f14b102-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-892bff51-d091-47a3-b635-6e6454b73cc2 req-80cc02f3-ba0e-4b97-8b33-79a23e5f9619 service nova] Releasing lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.compute.manager [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:55:49 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Creating image(s)
Nov 30 12:55:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "/opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "/opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "/opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:55:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.208s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e75a5ad8-8ab0-4b0a-9ec7-052a2c2a91c5 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.765s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.205s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk 1073741824" returned: 0 in 0.053s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG nova.network.neutron [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Successfully created port: d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG nova.compute.manager [req-1912d0aa-226e-40b9-9069-61c6ae52077f req-4c0c575a-603a-4344-99a4-8dd753111bfb service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1912d0aa-226e-40b9-9069-61c6ae52077f req-4c0c575a-603a-4344-99a4-8dd753111bfb service nova] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1912d0aa-226e-40b9-9069-61c6ae52077f req-4c0c575a-603a-4344-99a4-8dd753111bfb service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-1912d0aa-226e-40b9-9069-61c6ae52077f req-4c0c575a-603a-4344-99a4-8dd753111bfb service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG nova.compute.manager [req-1912d0aa-226e-40b9-9069-61c6ae52077f req-4c0c575a-603a-4344-99a4-8dd753111bfb service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] No waiting events found dispatching network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:55:50 user nova-compute[75672]: WARNING nova.compute.manager [req-1912d0aa-226e-40b9-9069-61c6ae52077f req-4c0c575a-603a-4344-99a4-8dd753111bfb service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received unexpected event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 for instance with vm_state rescued and task_state None.
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.201s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Cannot resize image /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Ensure instance console log exists: /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.008s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.network.neutron [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Successfully updated port: d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-d9247159-35a2-4a77-9a73-94e63ef5f1f5 req-13b4029d-b15d-4f98-a06f-553e136947ca service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Received event network-changed-d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-d9247159-35a2-4a77-9a73-94e63ef5f1f5 req-13b4029d-b15d-4f98-a06f-553e136947ca service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Refreshing instance network info cache due to event network-changed-d5f8d326-bf95-442a-b095-500dbc3bfc7c. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d9247159-35a2-4a77-9a73-94e63ef5f1f5 req-13b4029d-b15d-4f98-a06f-553e136947ca service nova] Acquiring lock "refresh_cache-9de1abf0-249e-44c5-bad0-23dd475132e0" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d9247159-35a2-4a77-9a73-94e63ef5f1f5 req-13b4029d-b15d-4f98-a06f-553e136947ca service nova] Acquired lock "refresh_cache-9de1abf0-249e-44c5-bad0-23dd475132e0" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.network.neutron [req-d9247159-35a2-4a77-9a73-94e63ef5f1f5 req-13b4029d-b15d-4f98-a06f-553e136947ca service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Refreshing network info cache for port d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "refresh_cache-9de1abf0-249e-44c5-bad0-23dd475132e0" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.network.neutron [req-d9247159-35a2-4a77-9a73-94e63ef5f1f5 req-13b4029d-b15d-4f98-a06f-553e136947ca service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.network.neutron [req-d9247159-35a2-4a77-9a73-94e63ef5f1f5 req-13b4029d-b15d-4f98-a06f-553e136947ca service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d9247159-35a2-4a77-9a73-94e63ef5f1f5 req-13b4029d-b15d-4f98-a06f-553e136947ca service nova] Releasing lock "refresh_cache-9de1abf0-249e-44c5-bad0-23dd475132e0" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquired lock "refresh_cache-9de1abf0-249e-44c5-bad0-23dd475132e0" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.network.neutron [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.network.neutron [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.network.neutron [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Updating instance_info_cache with network_info: [{"id": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "address": "fa:16:3e:23:b7:cc", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8d326-bf", "ovs_interfaceid": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Releasing lock "refresh_cache-9de1abf0-249e-44c5-bad0-23dd475132e0" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Instance network_info: |[{"id": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "address": "fa:16:3e:23:b7:cc", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8d326-bf", "ovs_interfaceid": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Start _get_guest_xml network_info=[{"id": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "address": "fa:16:3e:23:b7:cc", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8d326-bf", "ovs_interfaceid": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:55:51 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:55:51 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:55:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-794027610',display_name='tempest-VolumesSnapshotTestJSON-instance-794027610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-794027610',id=48,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzSwF639o/wEvIb02p/cwfbnE7SxAZKrgLaTSK/pqIKZsLmGreSZrCTzEhGTplof43B6EgiE6NkB/euKYIbBo4uyAMAmUwJqHANIfh484usm6oAekw7zWiZ68fO2XvR6g==',key_name='tempest-keypair-727724207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eae82e7799446a4af16b2b239c2003f',ramdisk_id='',reservation_id='r-m5edpysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-453020492',owner_user_name='tempest-VolumesSnapshotTestJSON-453020492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4204698d39994cf8aab1a59ddc16e387',uuid=9de1abf0-249e-44c5-bad0-23dd475132e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "address": "fa:16:3e:23:b7:cc", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8d326-bf", "ovs_interfaceid": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Converting VIF {"id": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "address": "fa:16:3e:23:b7:cc", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8d326-bf", "ovs_interfaceid": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:b7:cc,bridge_name='br-int',has_traffic_filtering=True,id=d5f8d326-bf95-442a-b095-500dbc3bfc7c,network=Network(fcb1c4a1-0917-4076-9739-0989986069ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f8d326-bf') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG nova.objects.instance [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lazy-loading 'pci_devices' on Instance uuid 9de1abf0-249e-44c5-bad0-23dd475132e0 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:55:52 user nova-compute[75672]:   <uuid>9de1abf0-249e-44c5-bad0-23dd475132e0</uuid>
Nov 30 12:55:52 user nova-compute[75672]:   <name>instance-00000030</name>
Nov 30 12:55:52 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:55:52 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:55:52 user nova-compute[75672]:   <metadata>
Nov 30 12:55:52 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:55:52 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:55:52 user nova-compute[75672]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-794027610</nova:name>
Nov 30 12:55:52 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:55:51</nova:creationTime>
Nov 30 12:55:52 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:55:52 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:55:52 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:55:52 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:55:52 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:55:52 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:55:52 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:55:52 user nova-compute[75672]:       <nova:owner>
Nov 30 12:55:52 user nova-compute[75672]:         <nova:user uuid="4204698d39994cf8aab1a59ddc16e387">tempest-VolumesSnapshotTestJSON-453020492-project-member</nova:user>
Nov 30 12:55:52 user nova-compute[75672]:         <nova:project uuid="9eae82e7799446a4af16b2b239c2003f">tempest-VolumesSnapshotTestJSON-453020492</nova:project>
Nov 30 12:55:52 user nova-compute[75672]:       </nova:owner>
Nov 30 12:55:52 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 12:55:52 user nova-compute[75672]:       <nova:ports>
Nov 30 12:55:52 user nova-compute[75672]:         <nova:port uuid="d5f8d326-bf95-442a-b095-500dbc3bfc7c">
Nov 30 12:55:52 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 12:55:52 user nova-compute[75672]:         </nova:port>
Nov 30 12:55:52 user nova-compute[75672]:       </nova:ports>
Nov 30 12:55:52 user nova-compute[75672]:     </nova:instance>
Nov 30 12:55:52 user nova-compute[75672]:   </metadata>
Nov 30 12:55:52 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:55:52 user nova-compute[75672]:     <system>
Nov 30 12:55:52 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:55:52 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:55:52 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:55:52 user nova-compute[75672]:       <entry name="serial">9de1abf0-249e-44c5-bad0-23dd475132e0</entry>
Nov 30 12:55:52 user nova-compute[75672]:       <entry name="uuid">9de1abf0-249e-44c5-bad0-23dd475132e0</entry>
Nov 30 12:55:52 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:55:52 user nova-compute[75672]:     </system>
Nov 30 12:55:52 user nova-compute[75672]:   </sysinfo>
Nov 30 12:55:52 user nova-compute[75672]:   <os>
Nov 30 12:55:52 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:55:52 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:55:52 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:55:52 user nova-compute[75672]:   </os>
Nov 30 12:55:52 user nova-compute[75672]:   <features>
Nov 30 12:55:52 user nova-compute[75672]:     <acpi/>
Nov 30 12:55:52 user nova-compute[75672]:     <apic/>
Nov 30 12:55:52 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:55:52 user nova-compute[75672]:   </features>
Nov 30 12:55:52 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:55:52 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:55:52 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:55:52 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:55:52 user nova-compute[75672]:   </clock>
Nov 30 12:55:52 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:55:52 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:55:52 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:55:52 user nova-compute[75672]:   </cpu>
Nov 30 12:55:52 user nova-compute[75672]:   <devices>
Nov 30 12:55:52 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:55:52 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:55:52 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk"/>
Nov 30 12:55:52 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:55:52 user nova-compute[75672]:     </disk>
Nov 30 12:55:52 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:55:52 user nova-compute[75672]:       <mac address="fa:16:3e:23:b7:cc"/>
Nov 30 12:55:52 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:55:52 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:55:52 user nova-compute[75672]:       <target dev="tapd5f8d326-bf"/>
Nov 30 12:55:52 user nova-compute[75672]:     </interface>
Nov 30 12:55:52 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:55:52 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/console.log" append="off"/>
Nov 30 12:55:52 user nova-compute[75672]:     </serial>
Nov 30 12:55:52 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:55:52 user nova-compute[75672]:     <video>
Nov 30 12:55:52 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:55:52 user nova-compute[75672]:     </video>
Nov 30 12:55:52 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:55:52 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:55:52 user nova-compute[75672]:     </rng>
Nov 30 12:55:52 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:55:52 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:55:52 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:55:52 user nova-compute[75672]:     </memballoon>
Nov 30 12:55:52 user nova-compute[75672]:   </devices>
Nov 30 12:55:52 user nova-compute[75672]: </domain>
Nov 30 12:55:52 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-794027610',display_name='tempest-VolumesSnapshotTestJSON-instance-794027610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-794027610',id=48,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzSwF639o/wEvIb02p/cwfbnE7SxAZKrgLaTSK/pqIKZsLmGreSZrCTzEhGTplof43B6EgiE6NkB/euKYIbBo4uyAMAmUwJqHANIfh484usm6oAekw7zWiZ68fO2XvR6g==',key_name='tempest-keypair-727724207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eae82e7799446a4af16b2b239c2003f',ramdisk_id='',reservation_id='r-m5edpysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-453020492',owner_user_name='tempest-VolumesSnapshotTestJSON-453020492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4204698d39994cf8aab1a59ddc16e387',uuid=9de1abf0-249e-44c5-bad0-23dd475132e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "address": "fa:16:3e:23:b7:cc", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8d326-bf", "ovs_interfaceid": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Converting VIF {"id": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "address": "fa:16:3e:23:b7:cc", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8d326-bf", "ovs_interfaceid": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:b7:cc,bridge_name='br-int',has_traffic_filtering=True,id=d5f8d326-bf95-442a-b095-500dbc3bfc7c,network=Network(fcb1c4a1-0917-4076-9739-0989986069ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f8d326-bf') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG os_vif [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:b7:cc,bridge_name='br-int',has_traffic_filtering=True,id=d5f8d326-bf95-442a-b095-500dbc3bfc7c,network=Network(fcb1c4a1-0917-4076-9739-0989986069ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f8d326-bf') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60b8c668-742c-567a-b02a-26f5acccc89d', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5f8d326-bf, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5f8d326-bf, col_values=(('qos', UUID('ee2eeed3-6d60-4048-bd55-1171a72c204a')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5f8d326-bf, col_values=(('external_ids', {'iface-id': 'd5f8d326-bf95-442a-b095-500dbc3bfc7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:b7:cc', 'vm-uuid': '9de1abf0-249e-44c5-bad0-23dd475132e0'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:52 user nova-compute[75672]: INFO os_vif [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:b7:cc,bridge_name='br-int',has_traffic_filtering=True,id=d5f8d326-bf95-442a-b095-500dbc3bfc7c,network=Network(fcb1c4a1-0917-4076-9739-0989986069ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f8d326-bf')
Nov 30 12:55:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] No VIF found with MAC fa:16:3e:23:b7:cc, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.manager [req-3ec2e5bb-68e9-4469-b555-e6731f9f16ae req-cb6ea6af-a90a-4097-b230-feb3ae396c42 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Received event network-vif-plugged-d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3ec2e5bb-68e9-4469-b555-e6731f9f16ae req-cb6ea6af-a90a-4097-b230-feb3ae396c42 service nova] Acquiring lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3ec2e5bb-68e9-4469-b555-e6731f9f16ae req-cb6ea6af-a90a-4097-b230-feb3ae396c42 service nova] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3ec2e5bb-68e9-4469-b555-e6731f9f16ae req-cb6ea6af-a90a-4097-b230-feb3ae396c42 service nova] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.manager [req-3ec2e5bb-68e9-4469-b555-e6731f9f16ae req-cb6ea6af-a90a-4097-b230-feb3ae396c42 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] No waiting events found dispatching network-vif-plugged-d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:55:56 user nova-compute[75672]: WARNING nova.compute.manager [req-3ec2e5bb-68e9-4469-b555-e6731f9f16ae req-cb6ea6af-a90a-4097-b230-feb3ae396c42 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Received unexpected event network-vif-plugged-d5f8d326-bf95-442a-b095-500dbc3bfc7c for instance with vm_state building and task_state spawning.
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.manager [req-9e943be1-b374-409b-9f24-40ebf1bc1c6d req-cd24df8c-0b2c-4e95-bc2a-06ccdf286b71 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Received event network-vif-plugged-d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9e943be1-b374-409b-9f24-40ebf1bc1c6d req-cd24df8c-0b2c-4e95-bc2a-06ccdf286b71 service nova] Acquiring lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9e943be1-b374-409b-9f24-40ebf1bc1c6d req-cd24df8c-0b2c-4e95-bc2a-06ccdf286b71 service nova] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-9e943be1-b374-409b-9f24-40ebf1bc1c6d req-cd24df8c-0b2c-4e95-bc2a-06ccdf286b71 service nova] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.manager [req-9e943be1-b374-409b-9f24-40ebf1bc1c6d req-cd24df8c-0b2c-4e95-bc2a-06ccdf286b71 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] No waiting events found dispatching network-vif-plugged-d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:55:56 user nova-compute[75672]: WARNING nova.compute.manager [req-9e943be1-b374-409b-9f24-40ebf1bc1c6d req-cd24df8c-0b2c-4e95-bc2a-06ccdf286b71 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Received unexpected event network-vif-plugged-d5f8d326-bf95-442a-b095-500dbc3bfc7c for instance with vm_state building and task_state spawning.
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.manager [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:55:56 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:55:56 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=8455MB free_disk=24.841888427734375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:56 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Instance spawned successfully.
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:55:56 user nova-compute[75672]: INFO nova.compute.manager [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.manager [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance c00b64bd-8011-4609-8953-315f1e655930 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 80050f56-3708-448e-b501-7e930438e94b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 9de1abf0-249e-44c5-bad0-23dd475132e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:55:56 user nova-compute[75672]: INFO nova.compute.manager [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Took 7.88 seconds to build instance.
Nov 30 12:55:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-50e8b184-4c05-4481-aa79-5d06808c5d19 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.990s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:55:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:55:57 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:55:57 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:55:57 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:55:57 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:55:57 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:55:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "b5b3baae-893d-4909-9504-e0be595cbf67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "b5b3baae-893d-4909-9504-e0be595cbf67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 12:55:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:55:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:55:58 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:55:58 user nova-compute[75672]: INFO nova.compute.claims [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Claim successful on node user
Nov 30 12:55:59 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 12:55:59 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 12:55:59 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 12:55:59 user nova-compute[75672]: INFO nova.virt.block_device [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Booting with volume 1a9701f3-890f-47d7-bfcf-3318810bbd74 at /dev/vda
Nov 30 12:55:59 user nova-compute[75672]: DEBUG os_brick.utils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d2f23b-0cf9-4222-bbaa-e06370d2b5e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b3ef0e-b558-4b11-b647-02fd7b16565d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[516c1e1d-cc54-44ed-8bb4-12fa5b0c7fdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[099fe4c0-ea71-44e6-8d5b-2dc17f391086]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:55:59 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:55:59 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[90977f17-f24c-4585-845a-cce6ad2cf49d]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG os_brick.utils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updating existing volume attachment record: 51180ace-2e5a-462d-8ec3-a2f53e19c5da {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:55:59 user nova-compute[75672]: DEBUG nova.policy [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e62e4eb6ad444fc3bc0e069c9cc2f921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc381a3d4844cc84b470c640b397c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 12:56:00 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:56:00 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Successfully created port: b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 12:56:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:01 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Successfully updated port: b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 12:56:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:56:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquired lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:56:01 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:56:01 user nova-compute[75672]: DEBUG nova.compute.manager [req-eccbebe8-d5a7-4c5f-9541-99c295f5f6b7 req-04735156-614f-4f2c-ac12-b18f0f186645 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-changed-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:56:01 user nova-compute[75672]: DEBUG nova.compute.manager [req-eccbebe8-d5a7-4c5f-9541-99c295f5f6b7 req-04735156-614f-4f2c-ac12-b18f0f186645 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Refreshing instance network info cache due to event network-changed-b432c044-6444-4219-a936-3a8e16d4d3d3. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:56:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-eccbebe8-d5a7-4c5f-9541-99c295f5f6b7 req-04735156-614f-4f2c-ac12-b18f0f186645 service nova] Acquiring lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:56:01 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 12:56:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:02 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updating instance_info_cache with network_info: [{"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:56:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Releasing lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:56:02 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Instance network_info: |[{"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 12:56:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-eccbebe8-d5a7-4c5f-9541-99c295f5f6b7 req-04735156-614f-4f2c-ac12-b18f0f186645 service nova] Acquired lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:56:02 user nova-compute[75672]: DEBUG nova.network.neutron [req-eccbebe8-d5a7-4c5f-9541-99c295f5f6b7 req-04735156-614f-4f2c-ac12-b18f0f186645 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Refreshing network info cache for port b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:56:02 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:56:02 user nova-compute[75672]: DEBUG nova.network.neutron [req-eccbebe8-d5a7-4c5f-9541-99c295f5f6b7 req-04735156-614f-4f2c-ac12-b18f0f186645 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updated VIF entry in instance network info cache for port b432c044-6444-4219-a936-3a8e16d4d3d3. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:56:02 user nova-compute[75672]: DEBUG nova.network.neutron [req-eccbebe8-d5a7-4c5f-9541-99c295f5f6b7 req-04735156-614f-4f2c-ac12-b18f0f186645 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updating instance_info_cache with network_info: [{"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:56:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-eccbebe8-d5a7-4c5f-9541-99c295f5f6b7 req-04735156-614f-4f2c-ac12-b18f0f186645 service nova] Releasing lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:56:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "c00b64bd-8011-4609-8953-315f1e655930" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:56:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "c00b64bd-8011-4609-8953-315f1e655930" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:56:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "c00b64bd-8011-4609-8953-315f1e655930-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:56:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "c00b64bd-8011-4609-8953-315f1e655930-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:56:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "c00b64bd-8011-4609-8953-315f1e655930-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:56:04 user nova-compute[75672]: INFO nova.compute.manager [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Terminating instance
Nov 30 12:56:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:56:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-b5729527-e3c3-4925-86c7-60e356fd847a req-1318547c-74e0-49f2-b16a-28b62196f5a3 service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Received event network-vif-unplugged-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b5729527-e3c3-4925-86c7-60e356fd847a req-1318547c-74e0-49f2-b16a-28b62196f5a3 service nova] Acquiring lock "c00b64bd-8011-4609-8953-315f1e655930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b5729527-e3c3-4925-86c7-60e356fd847a req-1318547c-74e0-49f2-b16a-28b62196f5a3 service nova] Lock "c00b64bd-8011-4609-8953-315f1e655930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b5729527-e3c3-4925-86c7-60e356fd847a req-1318547c-74e0-49f2-b16a-28b62196f5a3 service nova] Lock "c00b64bd-8011-4609-8953-315f1e655930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-b5729527-e3c3-4925-86c7-60e356fd847a req-1318547c-74e0-49f2-b16a-28b62196f5a3 service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] No waiting events found dispatching network-vif-unplugged-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-b5729527-e3c3-4925-86c7-60e356fd847a req-1318547c-74e0-49f2-b16a-28b62196f5a3 service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Received event network-vif-unplugged-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:56:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: c00b64bd-8011-4609-8953-315f1e655930] Instance destroyed successfully.
Nov 30 12:56:05 user nova-compute[75672]: DEBUG nova.objects.instance [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lazy-loading 'resources' on Instance uuid c00b64bd-8011-4609-8953-315f1e655930 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:47:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-506734386',display_name='tempest-ServersNegativeTestJSON-server-506734386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-506734386',id=37,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:47:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5a515a90e05403281db278fd0da0516',ramdisk_id='',reservation_id='r-1ms9zekp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-69784533',owner_user_name='tempest-ServersNegativeTestJSON-69784533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:47:25Z,user_data=None,user_id='aa04e80eda5248478efbdcc04f68d79f',uuid=c00b64bd-8011-4609-8953-315f1e655930,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "address": "fa:16:3e:d5:5a:b2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1b4262-1c", "ovs_interfaceid": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Converting VIF {"id": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "address": "fa:16:3e:d5:5a:b2", "network": {"id": "01af390a-7f78-4062-bb05-a7cc50446933", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1514493543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5a515a90e05403281db278fd0da0516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1b4262-1c", "ovs_interfaceid": "7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:5a:b2,bridge_name='br-int',has_traffic_filtering=True,id=7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2,network=Network(01af390a-7f78-4062-bb05-a7cc50446933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b1b4262-1c') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG os_vif [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:5a:b2,bridge_name='br-int',has_traffic_filtering=True,id=7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2,network=Network(01af390a-7f78-4062-bb05-a7cc50446933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b1b4262-1c') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b1b4262-1c, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9dfe384-961b-4fef-8508-0f2595a84f56) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:56:05 user nova-compute[75672]: INFO os_vif [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:5a:b2,bridge_name='br-int',has_traffic_filtering=True,id=7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2,network=Network(01af390a-7f78-4062-bb05-a7cc50446933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b1b4262-1c')
Nov 30 12:56:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Deleting instance files /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930_del
Nov 30 12:56:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Deletion of /opt/stack/data/nova/instances/c00b64bd-8011-4609-8953-315f1e655930_del complete
Nov 30 12:56:05 user nova-compute[75672]: INFO nova.compute.manager [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] [instance: c00b64bd-8011-4609-8953-315f1e655930] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 30 12:56:05 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: c00b64bd-8011-4609-8953-315f1e655930] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:56:05 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: c00b64bd-8011-4609-8953-315f1e655930] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:56:06 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: c00b64bd-8011-4609-8953-315f1e655930] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:56:06 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: c00b64bd-8011-4609-8953-315f1e655930] Took 0.70 seconds to deallocate network for instance.
Nov 30 12:56:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-c6100db7-d859-4d97-80c9-f8caf1d71f4f req-076ba87c-c915-4e3b-b883-23284687bd56 service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Received event network-vif-deleted-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:56:06 user nova-compute[75672]: INFO nova.compute.manager [req-c6100db7-d859-4d97-80c9-f8caf1d71f4f req-076ba87c-c915-4e3b-b883-23284687bd56 service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Neutron deleted interface 7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2; detaching it from the instance and deleting it from the info cache
Nov 30 12:56:06 user nova-compute[75672]: DEBUG nova.network.neutron [req-c6100db7-d859-4d97-80c9-f8caf1d71f4f req-076ba87c-c915-4e3b-b883-23284687bd56 service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:56:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-c6100db7-d859-4d97-80c9-f8caf1d71f4f req-076ba87c-c915-4e3b-b883-23284687bd56 service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Detach interface failed, port_id=7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2, reason: Instance c00b64bd-8011-4609-8953-315f1e655930 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:56:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:56:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:56:06 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:56:06 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:56:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:56:06 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Deleted allocations for instance c00b64bd-8011-4609-8953-315f1e655930
Nov 30 12:56:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e824676-2b21-48e8-8170-6c873e15a151 tempest-ServersNegativeTestJSON-69784533 tempest-ServersNegativeTestJSON-69784533-project-member] Lock "c00b64bd-8011-4609-8953-315f1e655930" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.268s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:56:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-0d183c39-c2f7-4474-8699-da6a060f2daf req-34141488-acbf-4a7d-aaf9-c7236d84978f service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Received event network-vif-plugged-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:56:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0d183c39-c2f7-4474-8699-da6a060f2daf req-34141488-acbf-4a7d-aaf9-c7236d84978f service nova] Acquiring lock "c00b64bd-8011-4609-8953-315f1e655930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:56:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0d183c39-c2f7-4474-8699-da6a060f2daf req-34141488-acbf-4a7d-aaf9-c7236d84978f service nova] Lock "c00b64bd-8011-4609-8953-315f1e655930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:56:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0d183c39-c2f7-4474-8699-da6a060f2daf req-34141488-acbf-4a7d-aaf9-c7236d84978f service nova] Lock "c00b64bd-8011-4609-8953-315f1e655930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:56:07 user nova-compute[75672]: DEBUG nova.compute.manager [req-0d183c39-c2f7-4474-8699-da6a060f2daf req-34141488-acbf-4a7d-aaf9-c7236d84978f service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] No waiting events found dispatching network-vif-plugged-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:56:07 user nova-compute[75672]: WARNING nova.compute.manager [req-0d183c39-c2f7-4474-8699-da6a060f2daf req-34141488-acbf-4a7d-aaf9-c7236d84978f service nova] [instance: c00b64bd-8011-4609-8953-315f1e655930] Received unexpected event network-vif-plugged-7b1b4262-1c2b-4f0b-bb74-5a5b524a7be2 for instance with vm_state deleted and task_state None.
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:56:09 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Creating image(s)
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Ensure instance console log exists: /opt/stack/data/nova/instances/b5b3baae-893d-4909-9504-e0be595cbf67/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Start _get_guest_xml network_info=[{"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '51180ace-2e5a-462d-8ec3-a2f53e19c5da', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiPlUDVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b5b3baae-893d-4909-9504-e0be595cbf67', 'attached_at': '', 'detached_at': '', 'volume_id': '1a9701f3-890f-47d7-bfcf-3318810bbd74', 'serial': '1a9701f3-890f-47d7-bfcf-3318810bbd74'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:56:09 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:56:09 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:56:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiPlUDVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:56:10 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:56:10 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:56:10 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[18da3558-09e8-4b73-aaa4-d3ff88972fa6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:56:10 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4f337f-83dc-4b5d-bb6d-80f04e9b8f90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74] added
Nov 30 12:56:10 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f381f76f-1e21-414e-825b-cd80e4a64849]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f2529b-fa9d-4e45-b39e-dfab058a0ecf]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tiPlUDVC {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tiPlUDVC" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2413c5a9-29e9-4848-b008-8aab00ec4492]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tiPlUDVC'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[514a57ab-f275-4fc6-b9d4-e1b5a9e54dd8]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac360ba-844d-42d3-97b5-1bc37e5fb8be]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:56:10 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:56:10 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:56:10 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:56:10 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f881ec-8893-490f-9aae-53b5916f3918]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260]
Nov 30 12:56:10 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260] successful.
Nov 30 12:56:10 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.044s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1763b94f-fa64-45b5-af5e-5ca6ccac0987]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec574a1-2f84-4498-8e29-0e757d5b9f3e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:56:10 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:56:10 user nova-compute[75672]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 12:56:10 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:56:10 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:56:10 user nova-compute[75672]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 12:56:10 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[000d6179-93b9-4add-a73b-7cea90475cdb]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:56:10 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiPlUDVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23165633461666566', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165633461666566', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1955223693',display_name='tempest-TestShelveInstance-server-1955223693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1955223693',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEE16S5Jmpim/WWgi8480VzQNUeAXmRd+XHFuLHXMCcHA7Pxg1LCXhY6yUn0tMy5XRjSOY7yqkaXhbqwT/ZSSAYZ8FRsFzPj9WlkRuUdvbMy/soRBDPLK4BUb5rsSVo3qw==',key_name='tempest-TestShelveInstance-264328173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12dc381a3d4844cc84b470c640b397c7',ramdisk_id='',reservation_id='r-d2xwykph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-802679308',owner_user_name='tempest-TestShelveInstance-802679308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:55:59Z,user_data=None,user_id='e62e4eb6ad444fc3bc0e069c9cc2f921',uuid=b5b3baae-893d-4909-9504-e0be595cbf67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Converting VIF {"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=b432c044-6444-4219-a936-3a8e16d4d3d3,network=Network(4b8e876a-ae88-4a30-bfbe-7fdf5585ea26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb432c044-64') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG nova.objects.instance [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lazy-loading 'pci_devices' on Instance uuid b5b3baae-893d-4909-9504-e0be595cbf67 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:56:11 user nova-compute[75672]:   <uuid>b5b3baae-893d-4909-9504-e0be595cbf67</uuid>
Nov 30 12:56:11 user nova-compute[75672]:   <name>instance-00000031</name>
Nov 30 12:56:11 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:56:11 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:56:11 user nova-compute[75672]:   <metadata>
Nov 30 12:56:11 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:56:11 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:56:11 user nova-compute[75672]:       <nova:name>tempest-TestShelveInstance-server-1955223693</nova:name>
Nov 30 12:56:11 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:56:09</nova:creationTime>
Nov 30 12:56:11 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:56:11 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:56:11 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:56:11 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:56:11 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:56:11 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:56:11 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:56:11 user nova-compute[75672]:       <nova:owner>
Nov 30 12:56:11 user nova-compute[75672]:         <nova:user uuid="e62e4eb6ad444fc3bc0e069c9cc2f921">tempest-TestShelveInstance-802679308-project-member</nova:user>
Nov 30 12:56:11 user nova-compute[75672]:         <nova:project uuid="12dc381a3d4844cc84b470c640b397c7">tempest-TestShelveInstance-802679308</nova:project>
Nov 30 12:56:11 user nova-compute[75672]:       </nova:owner>
Nov 30 12:56:11 user nova-compute[75672]:       <nova:ports>
Nov 30 12:56:11 user nova-compute[75672]:         <nova:port uuid="b432c044-6444-4219-a936-3a8e16d4d3d3">
Nov 30 12:56:11 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 12:56:11 user nova-compute[75672]:         </nova:port>
Nov 30 12:56:11 user nova-compute[75672]:       </nova:ports>
Nov 30 12:56:11 user nova-compute[75672]:     </nova:instance>
Nov 30 12:56:11 user nova-compute[75672]:   </metadata>
Nov 30 12:56:11 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:56:11 user nova-compute[75672]:     <system>
Nov 30 12:56:11 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:56:11 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:56:11 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:56:11 user nova-compute[75672]:       <entry name="serial">b5b3baae-893d-4909-9504-e0be595cbf67</entry>
Nov 30 12:56:11 user nova-compute[75672]:       <entry name="uuid">b5b3baae-893d-4909-9504-e0be595cbf67</entry>
Nov 30 12:56:11 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:56:11 user nova-compute[75672]:     </system>
Nov 30 12:56:11 user nova-compute[75672]:   </sysinfo>
Nov 30 12:56:11 user nova-compute[75672]:   <os>
Nov 30 12:56:11 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:56:11 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:56:11 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:56:11 user nova-compute[75672]:   </os>
Nov 30 12:56:11 user nova-compute[75672]:   <features>
Nov 30 12:56:11 user nova-compute[75672]:     <acpi/>
Nov 30 12:56:11 user nova-compute[75672]:     <apic/>
Nov 30 12:56:11 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:56:11 user nova-compute[75672]:   </features>
Nov 30 12:56:11 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:56:11 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:56:11 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:56:11 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:56:11 user nova-compute[75672]:   </clock>
Nov 30 12:56:11 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:56:11 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:56:11 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:56:11 user nova-compute[75672]:   </cpu>
Nov 30 12:56:11 user nova-compute[75672]:   <devices>
Nov 30 12:56:11 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:56:11 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:56:11 user nova-compute[75672]:       <source dev="/dev/sdb"/>
Nov 30 12:56:11 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:56:11 user nova-compute[75672]:       <serial>1a9701f3-890f-47d7-bfcf-3318810bbd74</serial>
Nov 30 12:56:11 user nova-compute[75672]:     </disk>
Nov 30 12:56:11 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:56:11 user nova-compute[75672]:       <mac address="fa:16:3e:98:ec:8b"/>
Nov 30 12:56:11 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:56:11 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:56:11 user nova-compute[75672]:       <target dev="tapb432c044-64"/>
Nov 30 12:56:11 user nova-compute[75672]:     </interface>
Nov 30 12:56:11 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:56:11 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/b5b3baae-893d-4909-9504-e0be595cbf67/console.log" append="off"/>
Nov 30 12:56:11 user nova-compute[75672]:     </serial>
Nov 30 12:56:11 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:56:11 user nova-compute[75672]:     <video>
Nov 30 12:56:11 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:56:11 user nova-compute[75672]:     </video>
Nov 30 12:56:11 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:56:11 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:56:11 user nova-compute[75672]:     </rng>
Nov 30 12:56:11 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:56:11 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:56:11 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:56:11 user nova-compute[75672]:     </memballoon>
Nov 30 12:56:11 user nova-compute[75672]:   </devices>
Nov 30 12:56:11 user nova-compute[75672]: </domain>
Nov 30 12:56:11 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1955223693',display_name='tempest-TestShelveInstance-server-1955223693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1955223693',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEE16S5Jmpim/WWgi8480VzQNUeAXmRd+XHFuLHXMCcHA7Pxg1LCXhY6yUn0tMy5XRjSOY7yqkaXhbqwT/ZSSAYZ8FRsFzPj9WlkRuUdvbMy/soRBDPLK4BUb5rsSVo3qw==',key_name='tempest-TestShelveInstance-264328173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12dc381a3d4844cc84b470c640b397c7',ramdisk_id='',reservation_id='r-d2xwykph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-802679308',owner_user_name='tempest-TestShelveInstance-802679308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:55:59Z,user_data=None,user_id='e62e4eb6ad444fc3bc0e069c9cc2f921',uuid=b5b3baae-893d-4909-9504-e0be595cbf67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Converting VIF {"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=b432c044-6444-4219-a936-3a8e16d4d3d3,network=Network(4b8e876a-ae88-4a30-bfbe-7fdf5585ea26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb432c044-64') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG os_vif [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=b432c044-6444-4219-a936-3a8e16d4d3d3,network=Network(4b8e876a-ae88-4a30-bfbe-7fdf5585ea26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb432c044-64') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6be3d3ec-4a0e-5db6-807e-a5888abccdef', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb432c044-64, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb432c044-64, col_values=(('qos', UUID('238551ee-df33-49cc-a076-18733fbee45b')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb432c044-64, col_values=(('external_ids', {'iface-id': 'b432c044-6444-4219-a936-3a8e16d4d3d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:ec:8b', 'vm-uuid': 'b5b3baae-893d-4909-9504-e0be595cbf67'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:11 user nova-compute[75672]: INFO os_vif [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=b432c044-6444-4219-a936-3a8e16d4d3d3,network=Network(4b8e876a-ae88-4a30-bfbe-7fdf5585ea26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb432c044-64')
Nov 30 12:56:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] No VIF found with MAC fa:16:3e:98:ec:8b, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:56:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-b9f78a7f-23d4-4c9a-af35-1f1ba578579d req-90195557-b57a-49fb-b189-2e18d59b752a service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:56:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b9f78a7f-23d4-4c9a-af35-1f1ba578579d req-90195557-b57a-49fb-b189-2e18d59b752a service nova] Acquiring lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:56:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b9f78a7f-23d4-4c9a-af35-1f1ba578579d req-90195557-b57a-49fb-b189-2e18d59b752a service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:56:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b9f78a7f-23d4-4c9a-af35-1f1ba578579d req-90195557-b57a-49fb-b189-2e18d59b752a service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:56:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-b9f78a7f-23d4-4c9a-af35-1f1ba578579d req-90195557-b57a-49fb-b189-2e18d59b752a service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] No waiting events found dispatching network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:56:13 user nova-compute[75672]: WARNING nova.compute.manager [req-b9f78a7f-23d4-4c9a-af35-1f1ba578579d req-90195557-b57a-49fb-b189-2e18d59b752a service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received unexpected event network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 for instance with vm_state building and task_state spawning.
Nov 30 12:56:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:15 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:56:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:56:15 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Instance spawned successfully.
Nov 30 12:56:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 12:56:15 user nova-compute[75672]: DEBUG nova.compute.manager [req-8b3544fd-8758-48ed-8014-c78695823fec req-f4a4600f-8364-420d-a12b-ea993c595505 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:56:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8b3544fd-8758-48ed-8014-c78695823fec req-f4a4600f-8364-420d-a12b-ea993c595505 service nova] Acquiring lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:56:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8b3544fd-8758-48ed-8014-c78695823fec req-f4a4600f-8364-420d-a12b-ea993c595505 service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:56:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8b3544fd-8758-48ed-8014-c78695823fec req-f4a4600f-8364-420d-a12b-ea993c595505 service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:56:15 user nova-compute[75672]: DEBUG nova.compute.manager [req-8b3544fd-8758-48ed-8014-c78695823fec req-f4a4600f-8364-420d-a12b-ea993c595505 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] No waiting events found dispatching network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:56:15 user nova-compute[75672]: WARNING nova.compute.manager [req-8b3544fd-8758-48ed-8014-c78695823fec req-f4a4600f-8364-420d-a12b-ea993c595505 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received unexpected event network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 for instance with vm_state building and task_state spawning.
Nov 30 12:56:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:56:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:56:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:56:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:56:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:56:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 12:56:15 user nova-compute[75672]: INFO nova.compute.manager [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 30 12:56:15 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:56:15 user nova-compute[75672]: INFO nova.compute.manager [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Took 16.86 seconds to build instance.
Nov 30 12:56:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9bf88933-78ef-4711-ac09-4ef02f846b46 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "b5b3baae-893d-4909-9504-e0be595cbf67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.068s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:56:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:56:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:47 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:56:48 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:56:48 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:56:48 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Didn't find any instances for network info cache update. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 12:56:51 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:56:51 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:56:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:56:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:56:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:56:51 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:56:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/disk.rescue --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:56:53 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:56:53 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:56:53 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=8186MB free_disk=24.82830810546875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 80050f56-3708-448e-b501-7e930438e94b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 9de1abf0-249e-44c5-bad0-23dd475132e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance b5b3baae-893d-4909-9504-e0be595cbf67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:56:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.345s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:56:55 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:56:55 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:56:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:56 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:56:56 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:56:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:56:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:01 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:57:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:57:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:57:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:57:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:57:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:57:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:57:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:57:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:57:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:57:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:57:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:57:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:57:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:57:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:57:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:57:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:57:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:57:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:57:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:57:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:57:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:57:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:29 user nova-compute[75672]: INFO nova.compute.manager [None req-2c029672-c9a8-45d4-b487-d67ffbd5026f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Unrescuing
Nov 30 12:57:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2c029672-c9a8-45d4-b487-d67ffbd5026f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "refresh_cache-80050f56-3708-448e-b501-7e930438e94b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:57:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2c029672-c9a8-45d4-b487-d67ffbd5026f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquired lock "refresh_cache-80050f56-3708-448e-b501-7e930438e94b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:57:29 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2c029672-c9a8-45d4-b487-d67ffbd5026f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:57:29 user nova-compute[75672]: DEBUG nova.network.neutron [None req-2c029672-c9a8-45d4-b487-d67ffbd5026f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Updating instance_info_cache with network_info: [{"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:57:29 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2c029672-c9a8-45d4-b487-d67ffbd5026f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Releasing lock "refresh_cache-80050f56-3708-448e-b501-7e930438e94b" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:57:29 user nova-compute[75672]: DEBUG nova.objects.instance [None req-2c029672-c9a8-45d4-b487-d67ffbd5026f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'flavor' on Instance uuid 80050f56-3708-448e-b501-7e930438e94b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:57:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:30 user nova-compute[75672]: DEBUG nova.compute.manager [req-767300cd-8ea7-4f63-b744-d5c5e9c1e145 req-7127ad91-44d7-4acd-b411-0cf62abcee68 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-vif-unplugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:57:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-767300cd-8ea7-4f63-b744-d5c5e9c1e145 req-7127ad91-44d7-4acd-b411-0cf62abcee68 service nova] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-767300cd-8ea7-4f63-b744-d5c5e9c1e145 req-7127ad91-44d7-4acd-b411-0cf62abcee68 service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:30 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-767300cd-8ea7-4f63-b744-d5c5e9c1e145 req-7127ad91-44d7-4acd-b411-0cf62abcee68 service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:30 user nova-compute[75672]: DEBUG nova.compute.manager [req-767300cd-8ea7-4f63-b744-d5c5e9c1e145 req-7127ad91-44d7-4acd-b411-0cf62abcee68 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] No waiting events found dispatching network-vif-unplugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:57:30 user nova-compute[75672]: WARNING nova.compute.manager [req-767300cd-8ea7-4f63-b744-d5c5e9c1e145 req-7127ad91-44d7-4acd-b411-0cf62abcee68 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received unexpected event network-vif-unplugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:57:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:30 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 80050f56-3708-448e-b501-7e930438e94b] Instance destroyed successfully.
Nov 30 12:57:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-8d54f280-f867-4a40-a1d6-62ceea5648d0 req-d1e3fbdd-d205-4213-99ea-8da06c526b73 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8d54f280-f867-4a40-a1d6-62ceea5648d0 req-d1e3fbdd-d205-4213-99ea-8da06c526b73 service nova] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8d54f280-f867-4a40-a1d6-62ceea5648d0 req-d1e3fbdd-d205-4213-99ea-8da06c526b73 service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8d54f280-f867-4a40-a1d6-62ceea5648d0 req-d1e3fbdd-d205-4213-99ea-8da06c526b73 service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-8d54f280-f867-4a40-a1d6-62ceea5648d0 req-d1e3fbdd-d205-4213-99ea-8da06c526b73 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] No waiting events found dispatching network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:57:32 user nova-compute[75672]: WARNING nova.compute.manager [req-8d54f280-f867-4a40-a1d6-62ceea5648d0 req-d1e3fbdd-d205-4213-99ea-8da06c526b73 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received unexpected event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:57:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-8d54f280-f867-4a40-a1d6-62ceea5648d0 req-d1e3fbdd-d205-4213-99ea-8da06c526b73 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8d54f280-f867-4a40-a1d6-62ceea5648d0 req-d1e3fbdd-d205-4213-99ea-8da06c526b73 service nova] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8d54f280-f867-4a40-a1d6-62ceea5648d0 req-d1e3fbdd-d205-4213-99ea-8da06c526b73 service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8d54f280-f867-4a40-a1d6-62ceea5648d0 req-d1e3fbdd-d205-4213-99ea-8da06c526b73 service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:32 user nova-compute[75672]: DEBUG nova.compute.manager [req-8d54f280-f867-4a40-a1d6-62ceea5648d0 req-d1e3fbdd-d205-4213-99ea-8da06c526b73 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] No waiting events found dispatching network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:57:32 user nova-compute[75672]: WARNING nova.compute.manager [req-8d54f280-f867-4a40-a1d6-62ceea5648d0 req-d1e3fbdd-d205-4213-99ea-8da06c526b73 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received unexpected event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 for instance with vm_state rescued and task_state unrescuing.
Nov 30 12:57:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-2c029672-c9a8-45d4-b487-d67ffbd5026f tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:34 user nova-compute[75672]: INFO nova.compute.manager [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Unshelving
Nov 30 12:57:34 user nova-compute[75672]: INFO nova.virt.block_device [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Booting with volume 72576457-16ab-4da5-883a-c38b7e634a8d at /dev/vdc
Nov 30 12:57:34 user nova-compute[75672]: DEBUG nova.compute.manager [req-abe37450-8656-4eed-93ff-787055d69b84 req-12a3d502-2f3b-4cf9-b1e4-e5cd1f1166c7 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-abe37450-8656-4eed-93ff-787055d69b84 req-12a3d502-2f3b-4cf9-b1e4-e5cd1f1166c7 service nova] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-abe37450-8656-4eed-93ff-787055d69b84 req-12a3d502-2f3b-4cf9-b1e4-e5cd1f1166c7 service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-abe37450-8656-4eed-93ff-787055d69b84 req-12a3d502-2f3b-4cf9-b1e4-e5cd1f1166c7 service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG nova.compute.manager [req-abe37450-8656-4eed-93ff-787055d69b84 req-12a3d502-2f3b-4cf9-b1e4-e5cd1f1166c7 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] No waiting events found dispatching network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:57:34 user nova-compute[75672]: WARNING nova.compute.manager [req-abe37450-8656-4eed-93ff-787055d69b84 req-12a3d502-2f3b-4cf9-b1e4-e5cd1f1166c7 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received unexpected event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 for instance with vm_state active and task_state None.
Nov 30 12:57:34 user nova-compute[75672]: DEBUG os_brick.utils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb016a26-d3b0-453c-8da9-8e23188c69e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe6685e-176e-4c65-b40c-c88ca344ee62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b26199-45fb-48ae-b2fc-e8816e972166]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a9c7a3-f9ac-46eb-9b10-9a7133088d84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:57:34 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:57:34 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38e1550-d4e6-461c-9927-f2751bbba6ae]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG os_brick.utils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:57:34 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updating existing volume attachment record: c45090ff-fbbe-4f9a-8b22-aac2dc361d43 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:57:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-fcf87de9-a239-4d8c-9194-0a0d441da5c2 req-6d74d2a8-f721-4dd7-93d9-36974b64aea4 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Received event network-changed-d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:57:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-fcf87de9-a239-4d8c-9194-0a0d441da5c2 req-6d74d2a8-f721-4dd7-93d9-36974b64aea4 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Refreshing instance network info cache due to event network-changed-d5f8d326-bf95-442a-b095-500dbc3bfc7c. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:57:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fcf87de9-a239-4d8c-9194-0a0d441da5c2 req-6d74d2a8-f721-4dd7-93d9-36974b64aea4 service nova] Acquiring lock "refresh_cache-9de1abf0-249e-44c5-bad0-23dd475132e0" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:57:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fcf87de9-a239-4d8c-9194-0a0d441da5c2 req-6d74d2a8-f721-4dd7-93d9-36974b64aea4 service nova] Acquired lock "refresh_cache-9de1abf0-249e-44c5-bad0-23dd475132e0" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:57:39 user nova-compute[75672]: DEBUG nova.network.neutron [req-fcf87de9-a239-4d8c-9194-0a0d441da5c2 req-6d74d2a8-f721-4dd7-93d9-36974b64aea4 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Refreshing network info cache for port d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "9de1abf0-249e-44c5-bad0-23dd475132e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG nova.objects.instance [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lazy-loading 'flavor' on Instance uuid 9de1abf0-249e-44c5-bad0-23dd475132e0 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:57:40 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Ignoring supplied device name: /dev/vdb
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "9de1abf0-249e-44c5-bad0-23dd475132e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:40 user nova-compute[75672]: INFO nova.compute.manager [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Attaching volume f778c6ef-b571-461c-a64b-f0f50ede03a8 to /dev/vdb
Nov 30 12:57:40 user nova-compute[75672]: DEBUG nova.network.neutron [req-fcf87de9-a239-4d8c-9194-0a0d441da5c2 req-6d74d2a8-f721-4dd7-93d9-36974b64aea4 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Updated VIF entry in instance network info cache for port d5f8d326-bf95-442a-b095-500dbc3bfc7c. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG nova.network.neutron [req-fcf87de9-a239-4d8c-9194-0a0d441da5c2 req-6d74d2a8-f721-4dd7-93d9-36974b64aea4 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Updating instance_info_cache with network_info: [{"id": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "address": "fa:16:3e:23:b7:cc", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8d326-bf", "ovs_interfaceid": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fcf87de9-a239-4d8c-9194-0a0d441da5c2 req-6d74d2a8-f721-4dd7-93d9-36974b64aea4 service nova] Releasing lock "refresh_cache-9de1abf0-249e-44c5-bad0-23dd475132e0" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG os_brick.utils [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a0d509-78be-45e8-a88d-ce56ef317fe1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.076s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cc7187-b221-4ac0-85bd-0aaa8da783a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.040s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[314818df-c2e5-4521-865c-852bdb941046]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f498b355-5ff7-4198-8377-ae04cf90931e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:57:40 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:57:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f965726-5765-4ff8-b20b-bbe5540df74d]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG os_brick.utils [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] <== get_connector_properties: return (211ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:57:40 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Updating existing volume attachment record: cff9905e-10f4-4702-befa-08583422ae5f {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:57:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:43 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:57:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:45 user nova-compute[75672]: DEBUG nova.objects.instance [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'pci_requests' on Instance uuid f5e20a72-18eb-4e06-a28e-d1bc9f88f64a {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:57:45 user nova-compute[75672]: DEBUG nova.objects.instance [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'numa_topology' on Instance uuid f5e20a72-18eb-4e06-a28e-d1bc9f88f64a {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:57:45 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:57:45 user nova-compute[75672]: INFO nova.compute.claims [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Claim successful on node user
Nov 30 12:57:45 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:57:45 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:57:45 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:45 user nova-compute[75672]: INFO nova.network.neutron [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updating port 0f14b102-12f4-4138-9227-d231693b61e8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquired lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-facea47f-f11b-4563-8f9c-cc3b155d2648 req-7a443d9a-3a7c-4a9e-a108-10d6abc50aff service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received event network-changed-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG nova.compute.manager [req-facea47f-f11b-4563-8f9c-cc3b155d2648 req-7a443d9a-3a7c-4a9e-a108-10d6abc50aff service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Refreshing instance network info cache due to event network-changed-0f14b102-12f4-4138-9227-d231693b61e8. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-facea47f-f11b-4563-8f9c-cc3b155d2648 req-7a443d9a-3a7c-4a9e-a108-10d6abc50aff service nova] Acquiring lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG nova.network.neutron [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updating instance_info_cache with network_info: [{"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Releasing lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:57:46 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Creating image(s)
Nov 30 12:57:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "/opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "/opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG nova.objects.instance [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'trusted_certs' on Instance uuid f5e20a72-18eb-4e06-a28e-d1bc9f88f64a {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-facea47f-f11b-4563-8f9c-cc3b155d2648 req-7a443d9a-3a7c-4a9e-a108-10d6abc50aff service nova] Acquired lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG nova.network.neutron [req-facea47f-f11b-4563-8f9c-cc3b155d2648 req-7a443d9a-3a7c-4a9e-a108-10d6abc50aff service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Refreshing network info cache for port 0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG nova.objects.base [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Object Instance<f5e20a72-18eb-4e06-a28e-d1bc9f88f64a> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "bcf6605eb1fa66f6403844e518aed003cdbc2d41" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "bcf6605eb1fa66f6403844e518aed003cdbc2d41" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41.part --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41.part --force-share --output=json" returned: 0 in 0.222s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:47 user nova-compute[75672]: DEBUG nova.virt.images [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] ccacfb9e-a2e2-4653-9d4e-2b264c27c67e was qcow2, converting to raw {{(pid=75672) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 12:57:47 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 12:57:47 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41.part /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41.converted {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:47 user nova-compute[75672]: DEBUG nova.network.neutron [req-facea47f-f11b-4563-8f9c-cc3b155d2648 req-7a443d9a-3a7c-4a9e-a108-10d6abc50aff service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updated VIF entry in instance network info cache for port 0f14b102-12f4-4138-9227-d231693b61e8. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:57:47 user nova-compute[75672]: DEBUG nova.network.neutron [req-facea47f-f11b-4563-8f9c-cc3b155d2648 req-7a443d9a-3a7c-4a9e-a108-10d6abc50aff service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updating instance_info_cache with network_info: [{"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-facea47f-f11b-4563-8f9c-cc3b155d2648 req-7a443d9a-3a7c-4a9e-a108-10d6abc50aff service nova] Releasing lock "refresh_cache-f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41.part /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41.converted" returned: 0 in 0.231s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41.converted --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "bcf6605eb1fa66f6403844e518aed003cdbc2d41" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.606s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41 --force-share --output=json" returned: 0 in 0.188s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "bcf6605eb1fa66f6403844e518aed003cdbc2d41" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "bcf6605eb1fa66f6403844e518aed003cdbc2d41" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41 --force-share --output=json" returned: 0 in 0.188s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41,backing_fmt=raw /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41,backing_fmt=raw /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk 1073741824" returned: 0 in 0.056s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "bcf6605eb1fa66f6403844e518aed003cdbc2d41" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41 --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG nova.objects.instance [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'migration_context' on Instance uuid f5e20a72-18eb-4e06-a28e-d1bc9f88f64a {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:57:48 user nova-compute[75672]: DEBUG nova.objects.base [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Object Instance<f5e20a72-18eb-4e06-a28e-d1bc9f88f64a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:57:48 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Rebasing disk image.
Nov 30 12:57:48 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.170s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:49 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 -F raw /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG nova.compute.manager [req-de595403-66a4-44f7-a653-40e38aa9d357 req-c6ee2d64-1f05-4894-a516-0a3b55f75df7 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-changed-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG nova.compute.manager [req-de595403-66a4-44f7-a653-40e38aa9d357 req-c6ee2d64-1f05-4894-a516-0a3b55f75df7 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Refreshing instance network info cache due to event network-changed-b432c044-6444-4219-a936-3a8e16d4d3d3. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-de595403-66a4-44f7-a653-40e38aa9d357 req-c6ee2d64-1f05-4894-a516-0a3b55f75df7 service nova] Acquiring lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-de595403-66a4-44f7-a653-40e38aa9d357 req-c6ee2d64-1f05-4894-a516-0a3b55f75df7 service nova] Acquired lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG nova.network.neutron [req-de595403-66a4-44f7-a653-40e38aa9d357 req-c6ee2d64-1f05-4894-a516-0a3b55f75df7 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Refreshing network info cache for port b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG nova.objects.instance [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lazy-loading 'info_cache' on Instance uuid 50ef3313-795a-4797-9a3e-5e85f61d7631 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG nova.network.neutron [req-de595403-66a4-44f7-a653-40e38aa9d357 req-c6ee2d64-1f05-4894-a516-0a3b55f75df7 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updated VIF entry in instance network info cache for port b432c044-6444-4219-a936-3a8e16d4d3d3. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG nova.network.neutron [req-de595403-66a4-44f7-a653-40e38aa9d357 req-c6ee2d64-1f05-4894-a516-0a3b55f75df7 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updating instance_info_cache with network_info: [{"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-de595403-66a4-44f7-a653-40e38aa9d357 req-c6ee2d64-1f05-4894-a516-0a3b55f75df7 service nova] Releasing lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkRmSniU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:57:50 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:57:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:57:50 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:57:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:57:50 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:57:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6fe953-e060-4dc2-997d-c725294a1e7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:57:50 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0905d24-b48d-4f72-a96a-905fe3c58dad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:50 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8] added
Nov 30 12:57:50 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2464e081-bc1b-4be7-ac31-a46a82985d46]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd5c958-d471-4d22-8b7e-efb2446941b3]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NkRmSniU {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NkRmSniU" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[507f0298-afd2-42b0-9c1e-7c8da8bfefe4]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NkRmSniU'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eea7bb1-fd1d-4ec8-bca6-f3b5b32db421]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Updating instance_info_cache with network_info: [{"id": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "address": "fa:16:3e:ce:b3:ac", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b67acff-06", "ovs_interfaceid": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa618f3f-c488-458b-8ad1-b42f4ddbff6f]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:57:51 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:57:51 user nova-compute[75672]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 12:57:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:57:51 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:57:51 user nova-compute[75672]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 12:57:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-50ef3313-795a-4797-9a3e-5e85f61d7631" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[817bc7cc-4a2a-42ca-8863-5c7754625160]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8, portal: 172.16.0.220,3260]
Nov 30 12:57:51 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8, portal: 172.16.0.220,3260] successful.
Nov 30 12:57:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba704560-416f-434d-8b5a-259a4b67749e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fa2449-db07-4252-9bb9-a2d807ee262f]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:57:51 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:57:51 user nova-compute[75672]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 12:57:51 user nova-compute[75672]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)
Nov 30 12:57:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:57:51 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:57:51 user nova-compute[75672]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 12:57:51 user nova-compute[75672]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)
Nov 30 12:57:51 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf268687-e1dc-415c-85f9-e29d612fd336]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 -F raw /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk" returned: 0 in 2.264s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Ensure instance console log exists: /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Start _get_guest_xml network_info=[{"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='5864998e65eed7485ed5e56e7de73399',container_format='bare',created_at=2023-11-30T12:55:42Z,direct_url=<?>,disk_format='qcow2',id=ccacfb9e-a2e2-4653-9d4e-2b264c27c67e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1480779755-shelved',owner='e674749412c04ea3a757ac31928844c6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T12:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c45090ff-fbbe-4f9a-8b22-aac2dc361d43', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YANOuclw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'f5e20a72-18eb-4e06-a28e-d1bc9f88f64a', 'attached_at': '', 'detached_at': '', 'volume_id': '72576457-16ab-4da5-883a-c38b7e634a8d', 'serial': '72576457-16ab-4da5-883a-c38b7e634a8d'}, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:57:51 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:57:51 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5864998e65eed7485ed5e56e7de73399',container_format='bare',created_at=2023-11-30T12:55:42Z,direct_url=<?>,disk_format='qcow2',id=ccacfb9e-a2e2-4653-9d4e-2b264c27c67e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1480779755-shelved',owner='e674749412c04ea3a757ac31928844c6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T12:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.objects.instance [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'vcpu_model' on Instance uuid f5e20a72-18eb-4e06-a28e-d1bc9f88f64a {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.objects.base [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Object Instance<f5e20a72-18eb-4e06-a28e-d1bc9f88f64a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YANOuclw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:57:51 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:57:51 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "b5b3baae-893d-4909-9504-e0be595cbf67" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "b5b3baae-893d-4909-9504-e0be595cbf67" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:51 user nova-compute[75672]: INFO nova.compute.manager [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Shelve offloading
Nov 30 12:57:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG nova.compute.manager [req-7fd6365c-06b2-469a-a346-da857fd04228 req-06a8ef45-e38a-41bc-80ae-2fe91732479e service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-vif-unplugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7fd6365c-06b2-469a-a346-da857fd04228 req-06a8ef45-e38a-41bc-80ae-2fe91732479e service nova] Acquiring lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7fd6365c-06b2-469a-a346-da857fd04228 req-06a8ef45-e38a-41bc-80ae-2fe91732479e service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7fd6365c-06b2-469a-a346-da857fd04228 req-06a8ef45-e38a-41bc-80ae-2fe91732479e service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG nova.compute.manager [req-7fd6365c-06b2-469a-a346-da857fd04228 req-06a8ef45-e38a-41bc-80ae-2fe91732479e service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] No waiting events found dispatching network-vif-unplugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:57:52 user nova-compute[75672]: WARNING nova.compute.manager [req-7fd6365c-06b2-469a-a346-da857fd04228 req-06a8ef45-e38a-41bc-80ae-2fe91732479e service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received unexpected event network-vif-unplugged-b432c044-6444-4219-a936-3a8e16d4d3d3 for instance with vm_state active and task_state shelving.
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkRmSniU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23864343964303762', 'path': '/dev/sdc'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864343964303762', 'path': '/dev/sdc'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.716s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:57:52 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:57:52 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG nova.objects.instance [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lazy-loading 'flavor' on Instance uuid 9de1abf0-249e-44c5-bad0-23dd475132e0 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d7e3e8-2664-47bb-97b7-fde01c1a2b6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:57:52 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 12:57:52 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:57:52 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 12:57:52 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:57:52 user nova-compute[75672]:   <serial>f778c6ef-b571-461c-a64b-f0f50ede03a8</serial>
Nov 30 12:57:52 user nova-compute[75672]: </disk>
Nov 30 12:57:52 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c642cbc-b6ac-49ed-9b42-a10e36e3925b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d] added
Nov 30 12:57:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c549c59-65d5-4bd8-a2c6-f2ed25f0e2fe]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[037757b1-fbe4-4f6a-af32-4c0ca1508e05]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YANOuclw {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YANOuclw" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e88856-9f41-4519-b010-6f2ea971ee72]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YANOuclw'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c010d4-9ef6-4e2f-865a-b62be3a9388e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae7306f-785e-4341-abae-282e8a8c668b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c363cb8a-f7f1-4593-a3f5-f38e8077b0f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d, portal: 172.16.0.220,3260]
Nov 30 12:57:52 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d, portal: 172.16.0.220,3260] successful.
Nov 30 12:57:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81b30d8-5a8f-4aef-8da2-f45d69ffaec7]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5884c0c1-a73f-4639-88a4-032b9c4c30b9]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)
Nov 30 12:57:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)
Nov 30 12:57:52 user nova-compute[75672]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)
Nov 30 12:57:52 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] HCTL ('37', '-', '-', 0) found on session 54 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed81a602-e032-4c76-b708-b473c2106fc8]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Searching for a device in session 54 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YANOuclw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] No VIF found with MAC fa:16:3e:23:b7:cc, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:57:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-573b0f2f-f7df-4e86-9c34-d68d50cffd0c tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.419s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:53 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Instance destroyed successfully.
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquired lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.network.neutron [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.network.neutron [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updating instance_info_cache with network_info: [{"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Releasing lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] <== connect_volume: return (2074ms) {'type': 'block', 'scsi_wwn': '26461646263306638', 'path': '/dev/sdf'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461646263306638', 'path': '/dev/sdf'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T12:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1480779755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1480779755',id=46,image_ref='ccacfb9e-a2e2-4653-9d4e-2b264c27c67e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1872424482',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e674749412c04ea3a757ac31928844c6',ramdisk_id='',reservation_id='r-gjk8zon0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792375540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792375540-project-member',shelved_at='2023-11-30T12:55:47.187103',shelved_host='user',shelved_image_id='ccacfb9e-a2e2-4653-9d4e-2b264c27c67e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e87ad9fef5444b4b0124b0bd71f8324',uuid=f5e20a72-18eb-4e06-a28e-d1bc9f88f64a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converting VIF {"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0f14b102-12f4-4138-9227-d231693b61e8,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f14b102-12') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.objects.instance [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'pci_devices' on Instance uuid f5e20a72-18eb-4e06-a28e-d1bc9f88f64a {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.objects.base [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Object Instance<f5e20a72-18eb-4e06-a28e-d1bc9f88f64a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:57:53 user nova-compute[75672]:   <uuid>f5e20a72-18eb-4e06-a28e-d1bc9f88f64a</uuid>
Nov 30 12:57:53 user nova-compute[75672]:   <name>instance-0000002e</name>
Nov 30 12:57:53 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:57:53 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:57:53 user nova-compute[75672]:   <metadata>
Nov 30 12:57:53 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:57:53 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:57:53 user nova-compute[75672]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1480779755</nova:name>
Nov 30 12:57:53 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:57:51</nova:creationTime>
Nov 30 12:57:53 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:57:53 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:57:53 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:57:53 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:57:53 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:57:53 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:57:53 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:57:53 user nova-compute[75672]:       <nova:owner>
Nov 30 12:57:53 user nova-compute[75672]:         <nova:user uuid="2e87ad9fef5444b4b0124b0bd71f8324">tempest-AttachVolumeShelveTestJSON-1792375540-project-member</nova:user>
Nov 30 12:57:53 user nova-compute[75672]:         <nova:project uuid="e674749412c04ea3a757ac31928844c6">tempest-AttachVolumeShelveTestJSON-1792375540</nova:project>
Nov 30 12:57:53 user nova-compute[75672]:       </nova:owner>
Nov 30 12:57:53 user nova-compute[75672]:       <nova:root type="image" uuid="ccacfb9e-a2e2-4653-9d4e-2b264c27c67e"/>
Nov 30 12:57:53 user nova-compute[75672]:       <nova:ports>
Nov 30 12:57:53 user nova-compute[75672]:         <nova:port uuid="0f14b102-12f4-4138-9227-d231693b61e8">
Nov 30 12:57:53 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 12:57:53 user nova-compute[75672]:         </nova:port>
Nov 30 12:57:53 user nova-compute[75672]:       </nova:ports>
Nov 30 12:57:53 user nova-compute[75672]:     </nova:instance>
Nov 30 12:57:53 user nova-compute[75672]:   </metadata>
Nov 30 12:57:53 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:57:53 user nova-compute[75672]:     <system>
Nov 30 12:57:53 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:57:53 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:57:53 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:57:53 user nova-compute[75672]:       <entry name="serial">f5e20a72-18eb-4e06-a28e-d1bc9f88f64a</entry>
Nov 30 12:57:53 user nova-compute[75672]:       <entry name="uuid">f5e20a72-18eb-4e06-a28e-d1bc9f88f64a</entry>
Nov 30 12:57:53 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:57:53 user nova-compute[75672]:     </system>
Nov 30 12:57:53 user nova-compute[75672]:   </sysinfo>
Nov 30 12:57:53 user nova-compute[75672]:   <os>
Nov 30 12:57:53 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:57:53 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:57:53 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:57:53 user nova-compute[75672]:   </os>
Nov 30 12:57:53 user nova-compute[75672]:   <features>
Nov 30 12:57:53 user nova-compute[75672]:     <acpi/>
Nov 30 12:57:53 user nova-compute[75672]:     <apic/>
Nov 30 12:57:53 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:57:53 user nova-compute[75672]:   </features>
Nov 30 12:57:53 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:57:53 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:57:53 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:57:53 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:57:53 user nova-compute[75672]:   </clock>
Nov 30 12:57:53 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:57:53 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:57:53 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:57:53 user nova-compute[75672]:   </cpu>
Nov 30 12:57:53 user nova-compute[75672]:   <devices>
Nov 30 12:57:53 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 12:57:53 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 12:57:53 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk"/>
Nov 30 12:57:53 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:57:53 user nova-compute[75672]:     </disk>
Nov 30 12:57:53 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:57:53 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:57:53 user nova-compute[75672]:       <source dev="/dev/sdf"/>
Nov 30 12:57:53 user nova-compute[75672]:       <target dev="vdc" bus="virtio"/>
Nov 30 12:57:53 user nova-compute[75672]:       <serial>72576457-16ab-4da5-883a-c38b7e634a8d</serial>
Nov 30 12:57:53 user nova-compute[75672]:     </disk>
Nov 30 12:57:53 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:57:53 user nova-compute[75672]:       <mac address="fa:16:3e:16:4e:b7"/>
Nov 30 12:57:53 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:57:53 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:57:53 user nova-compute[75672]:       <target dev="tap0f14b102-12"/>
Nov 30 12:57:53 user nova-compute[75672]:     </interface>
Nov 30 12:57:53 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:57:53 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/console.log" append="off"/>
Nov 30 12:57:53 user nova-compute[75672]:     </serial>
Nov 30 12:57:53 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:57:53 user nova-compute[75672]:     <video>
Nov 30 12:57:53 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:57:53 user nova-compute[75672]:     </video>
Nov 30 12:57:53 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:57:53 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:57:53 user nova-compute[75672]:     </rng>
Nov 30 12:57:53 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:57:53 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:57:53 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:57:53 user nova-compute[75672]:     </memballoon>
Nov 30 12:57:53 user nova-compute[75672]:   </devices>
Nov 30 12:57:53 user nova-compute[75672]: </domain>
Nov 30 12:57:53 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T12:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1480779755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1480779755',id=46,image_ref='ccacfb9e-a2e2-4653-9d4e-2b264c27c67e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1872424482',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e674749412c04ea3a757ac31928844c6',ramdisk_id='',reservation_id='r-gjk8zon0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792375540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792375540-project-member',shelved_at='2023-11-30T12:55:47.187103',shelved_host='user',shelved_image_id='ccacfb9e-a2e2-4653-9d4e-2b264c27c67e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T12:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e87ad9fef5444b4b0124b0bd71f8324',uuid=f5e20a72-18eb-4e06-a28e-d1bc9f88f64a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converting VIF {"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0f14b102-12f4-4138-9227-d231693b61e8,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f14b102-12') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG os_vif [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0f14b102-12f4-4138-9227-d231693b61e8,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f14b102-12') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6e3bd95-69ac-5028-9c80-1034c3a8a762', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f14b102-12, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f14b102-12, col_values=(('qos', UUID('ad059e21-82a1-4247-8282-609718050a81')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f14b102-12, col_values=(('external_ids', {'iface-id': '0f14b102-12f4-4138-9227-d231693b61e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:4e:b7', 'vm-uuid': 'f5e20a72-18eb-4e06-a28e-d1bc9f88f64a'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:53 user nova-compute[75672]: INFO os_vif [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0f14b102-12f4-4138-9227-d231693b61e8,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f14b102-12')
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] No VIF found with MAC fa:16:3e:16:4e:b7, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Instance destroyed successfully.
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lazy-loading 'resources' on Instance uuid b5b3baae-893d-4909-9504-e0be595cbf67 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1955223693',display_name='tempest-TestShelveInstance-server-1955223693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1955223693',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEE16S5Jmpim/WWgi8480VzQNUeAXmRd+XHFuLHXMCcHA7Pxg1LCXhY6yUn0tMy5XRjSOY7yqkaXhbqwT/ZSSAYZ8FRsFzPj9WlkRuUdvbMy/soRBDPLK4BUb5rsSVo3qw==',key_name='tempest-TestShelveInstance-264328173',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:56:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12dc381a3d4844cc84b470c640b397c7',ramdisk_id='',reservation_id='r-d2xwykph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-802679308',owner_user_name='tempest-TestShelveInstance-802679308-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:56:15Z,user_data=None,user_id='e62e4eb6ad444fc3bc0e069c9cc2f921',uuid=b5b3baae-893d-4909-9504-e0be595cbf67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Converting VIF {"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=b432c044-6444-4219-a936-3a8e16d4d3d3,network=Network(4b8e876a-ae88-4a30-bfbe-7fdf5585ea26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb432c044-64') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_vif [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=b432c044-6444-4219-a936-3a8e16d4d3d3,network=Network(4b8e876a-ae88-4a30-bfbe-7fdf5585ea26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb432c044-64') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb432c044-64, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=238551ee-df33-49cc-a076-18733fbee45b) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:54 user nova-compute[75672]: INFO os_vif [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=b432c044-6444-4219-a936-3a8e16d4d3d3,network=Network(4b8e876a-ae88-4a30-bfbe-7fdf5585ea26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb432c044-64')
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiPlUDVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:57:54 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.011s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5526c0df-7bf9-492a-ace0-9edf8eb04f05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:57:54 user nova-compute[75672]: No targets found.
Nov 30 12:57:54 user nova-compute[75672]: iSNS:
Nov 30 12:57:54 user nova-compute[75672]: No targets found.
Nov 30 12:57:54 user nova-compute[75672]: STATIC:
Nov 30 12:57:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8
Nov 30 12:57:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:57:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:57:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74
Nov 30 12:57:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:57:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:57:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74
Nov 30 12:57:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:57:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:57:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:57:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:57:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:57:54 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d
Nov 30 12:57:54 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:57:54 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:57:54 user nova-compute[75672]: FIRMWARE:
Nov 30 12:57:54 user nova-compute[75672]: No targets found.
Nov 30 12:57:54 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:57:54 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:57:54 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c1a4e9-b35c-4f91-9505-010694a8b4ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd022013-a55e-469d-bb3f-f685a3f07df6]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:57:54 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:57:54 user nova-compute[75672]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 12:57:54 user nova-compute[75672]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)
Nov 30 12:57:54 user nova-compute[75672]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)
Nov 30 12:57:54 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:57:54 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:57:54 user nova-compute[75672]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 12:57:54 user nova-compute[75672]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)
Nov 30 12:57:54 user nova-compute[75672]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)
Nov 30 12:57:54 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd475d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e57f975-3630-4f44-8efd-adecb883740d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7170eec9-9901-4bff-8417-225ad5f02907]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-62aff4da-0132-4dc3-9d52-7fb4772a14e4 req-ee640465-a83a-4f74-87d8-5bccf2df5bb4 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-62aff4da-0132-4dc3-9d52-7fb4772a14e4 req-ee640465-a83a-4f74-87d8-5bccf2df5bb4 service nova] Acquiring lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-62aff4da-0132-4dc3-9d52-7fb4772a14e4 req-ee640465-a83a-4f74-87d8-5bccf2df5bb4 service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-62aff4da-0132-4dc3-9d52-7fb4772a14e4 req-ee640465-a83a-4f74-87d8-5bccf2df5bb4 service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-62aff4da-0132-4dc3-9d52-7fb4772a14e4 req-ee640465-a83a-4f74-87d8-5bccf2df5bb4 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] No waiting events found dispatching network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:57:54 user nova-compute[75672]: WARNING nova.compute.manager [req-62aff4da-0132-4dc3-9d52-7fb4772a14e4 req-ee640465-a83a-4f74-87d8-5bccf2df5bb4 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received unexpected event network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 for instance with vm_state active and task_state shelving.
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-62aff4da-0132-4dc3-9d52-7fb4772a14e4 req-ee640465-a83a-4f74-87d8-5bccf2df5bb4 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-changed-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-62aff4da-0132-4dc3-9d52-7fb4772a14e4 req-ee640465-a83a-4f74-87d8-5bccf2df5bb4 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Refreshing instance network info cache due to event network-changed-b432c044-6444-4219-a936-3a8e16d4d3d3. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-62aff4da-0132-4dc3-9d52-7fb4772a14e4 req-ee640465-a83a-4f74-87d8-5bccf2df5bb4 service nova] Acquiring lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-62aff4da-0132-4dc3-9d52-7fb4772a14e4 req-ee640465-a83a-4f74-87d8-5bccf2df5bb4 service nova] Acquired lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.network.neutron [req-62aff4da-0132-4dc3-9d52-7fb4772a14e4 req-ee640465-a83a-4f74-87d8-5bccf2df5bb4 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Refreshing network info cache for port b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2508eb-7ba5-490b-9c84-7311299336a7]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadb9f80-b6bb-4796-a2fa-c6680d3f6797]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5667c9ce-7e8b-4faa-b426-cb68b1870861]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc24afe-9a4a-45cc-bd6c-023899587127]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260]
Nov 30 12:57:54 user nova-compute[75672]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260] successful.
Nov 30 12:57:54 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f92ff8-d83c-4d42-806f-ce7390a948d0]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] <== disconnect_volume: return (413ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:57:54 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Deleting instance files /opt/stack/data/nova/instances/b5b3baae-893d-4909-9504-e0be595cbf67_del
Nov 30 12:57:54 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Deletion of /opt/stack/data/nova/instances/b5b3baae-893d-4909-9504-e0be595cbf67_del complete
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:57:54 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Error from libvirt while getting description of instance-00000031: [Error Code 42] Domain not found: no domain with matching uuid 'b5b3baae-893d-4909-9504-e0be595cbf67' (instance-00000031): libvirt.libvirtError: Domain not found: no domain with matching uuid 'b5b3baae-893d-4909-9504-e0be595cbf67' (instance-00000031)
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.network.neutron [req-62aff4da-0132-4dc3-9d52-7fb4772a14e4 req-ee640465-a83a-4f74-87d8-5bccf2df5bb4 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updated VIF entry in instance network info cache for port b432c044-6444-4219-a936-3a8e16d4d3d3. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:57:54 user nova-compute[75672]: DEBUG nova.network.neutron [req-62aff4da-0132-4dc3-9d52-7fb4772a14e4 req-ee640465-a83a-4f74-87d8-5bccf2df5bb4 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updating instance_info_cache with network_info: [{"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": null, "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb432c044-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-62aff4da-0132-4dc3-9d52-7fb4772a14e4 req-ee640465-a83a-4f74-87d8-5bccf2df5bb4 service nova] Releasing lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-f7605a13-e3b6-41e8-a2ac-2e3a892a8dc4 req-ecb51d63-4819-4f08-bb7e-4dc9b5329c46 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received event network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f7605a13-e3b6-41e8-a2ac-2e3a892a8dc4 req-ecb51d63-4819-4f08-bb7e-4dc9b5329c46 service nova] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f7605a13-e3b6-41e8-a2ac-2e3a892a8dc4 req-ecb51d63-4819-4f08-bb7e-4dc9b5329c46 service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f7605a13-e3b6-41e8-a2ac-2e3a892a8dc4 req-ecb51d63-4819-4f08-bb7e-4dc9b5329c46 service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-f7605a13-e3b6-41e8-a2ac-2e3a892a8dc4 req-ecb51d63-4819-4f08-bb7e-4dc9b5329c46 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] No waiting events found dispatching network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:57:57 user nova-compute[75672]: WARNING nova.compute.manager [req-f7605a13-e3b6-41e8-a2ac-2e3a892a8dc4 req-ecb51d63-4819-4f08-bb7e-4dc9b5329c46 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received unexpected event network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-f7605a13-e3b6-41e8-a2ac-2e3a892a8dc4 req-ecb51d63-4819-4f08-bb7e-4dc9b5329c46 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received event network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f7605a13-e3b6-41e8-a2ac-2e3a892a8dc4 req-ecb51d63-4819-4f08-bb7e-4dc9b5329c46 service nova] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f7605a13-e3b6-41e8-a2ac-2e3a892a8dc4 req-ecb51d63-4819-4f08-bb7e-4dc9b5329c46 service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f7605a13-e3b6-41e8-a2ac-2e3a892a8dc4 req-ecb51d63-4819-4f08-bb7e-4dc9b5329c46 service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-f7605a13-e3b6-41e8-a2ac-2e3a892a8dc4 req-ecb51d63-4819-4f08-bb7e-4dc9b5329c46 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] No waiting events found dispatching network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:57:57 user nova-compute[75672]: WARNING nova.compute.manager [req-f7605a13-e3b6-41e8-a2ac-2e3a892a8dc4 req-ecb51d63-4819-4f08-bb7e-4dc9b5329c46 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received unexpected event network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 12:57:57 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:57:57 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=8393MB free_disk=24.69562530517578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:57 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Instance spawned successfully.
Nov 30 12:57:57 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Deleted allocations for instance b5b3baae-893d-4909-9504-e0be595cbf67
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 80050f56-3708-448e-b501-7e930438e94b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 9de1abf0-249e-44c5-bad0-23dd475132e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (9d360ecf-be43-4c84-93ca-abc6f9902098): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:57:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing inventories for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating ProviderTree inventory for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating inventory in ProviderTree for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing aggregate associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, aggregates: None {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3a7e54e3-ed49-47c6-92a6-c3b4654c4cbc tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.505s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing trait associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.373s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lazy-loading 'numa_topology' on Instance uuid b5b3baae-893d-4909-9504-e0be595cbf67 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG nova.objects.base [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Object Instance<b5b3baae-893d-4909-9504-e0be595cbf67> lazy-loaded attributes: resources,numa_topology {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d2a47949-518c-4bd4-8e22-2f42d40d0559 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "b5b3baae-893d-4909-9504-e0be595cbf67" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 6.789s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:57:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:57:59 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:57:59 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:57:59 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:57:59 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:58:01 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:58:01 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:58:01 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 12:58:01 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] There are 0 instances to clean {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 12:58:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:05 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:58:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:07 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:58:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75672) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 12:58:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_power_states {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 50ef3313-795a-4797-9a3e-5e85f61d7631 {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 47ac940e-edbd-4732-ac04-e242709ee894 {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 80050f56-3708-448e-b501-7e930438e94b {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid 9de1abf0-249e-44c5-bad0-23dd475132e0 {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid f5e20a72-18eb-4e06-a28e-d1bc9f88f64a {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "50ef3313-795a-4797-9a3e-5e85f61d7631" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "47ac940e-edbd-4732-ac04-e242709ee894" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "80050f56-3708-448e-b501-7e930438e94b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "9de1abf0-249e-44c5-bad0-23dd475132e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "47ac940e-edbd-4732-ac04-e242709ee894" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:58:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "80050f56-3708-448e-b501-7e930438e94b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:58:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "9de1abf0-249e-44c5-bad0-23dd475132e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:58:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:58:15 user nova-compute[75672]: INFO nova.compute.manager [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Detaching volume f778c6ef-b571-461c-a64b-f0f50ede03a8
Nov 30 12:58:15 user nova-compute[75672]: INFO nova.virt.block_device [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Attempting to driver detach volume f778c6ef-b571-461c-a64b-f0f50ede03a8 from mountpoint /dev/vdb
Nov 30 12:58:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Attempting to detach device vdb from instance 9de1abf0-249e-44c5-bad0-23dd475132e0 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:58:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:58:15 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:58:15 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 12:58:15 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:58:15 user nova-compute[75672]:   <serial>f778c6ef-b571-461c-a64b-f0f50ede03a8</serial>
Nov 30 12:58:15 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:58:15 user nova-compute[75672]: </disk>
Nov 30 12:58:15 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:58:15 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Successfully detached device vdb from instance 9de1abf0-249e-44c5-bad0-23dd475132e0 from the persistent domain config.
Nov 30 12:58:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9de1abf0-249e-44c5-bad0-23dd475132e0 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:58:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:58:15 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:58:15 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 12:58:15 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 12:58:15 user nova-compute[75672]:   <serial>f778c6ef-b571-461c-a64b-f0f50ede03a8</serial>
Nov 30 12:58:15 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 12:58:15 user nova-compute[75672]: </disk>
Nov 30 12:58:15 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:58:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "9de1abf0-249e-44c5-bad0-23dd475132e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:58:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9de1abf0-249e-44c5-bad0-23dd475132e0 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:58:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:58:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:58:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:58:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:58:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:35 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9de1abf0-249e-44c5-bad0-23dd475132e0 is timed out.
Nov 30 12:58:35 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Successfully detached device vdb from instance 9de1abf0-249e-44c5-bad0-23dd475132e0 from the live domain config.
Nov 30 12:58:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkRmSniU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:58:35 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55dc361-0159-48b4-8e5e-2674c89003bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:58:35 user nova-compute[75672]: No targets found.
Nov 30 12:58:35 user nova-compute[75672]: iSNS:
Nov 30 12:58:35 user nova-compute[75672]: No targets found.
Nov 30 12:58:35 user nova-compute[75672]: STATIC:
Nov 30 12:58:35 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8
Nov 30 12:58:35 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:58:35 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:58:35 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74
Nov 30 12:58:35 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:58:35 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:58:35 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:58:35 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:58:35 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:58:35 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d
Nov 30 12:58:35 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:58:35 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:58:35 user nova-compute[75672]: FIRMWARE:
Nov 30 12:58:35 user nova-compute[75672]: No targets found.
Nov 30 12:58:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:58:35 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:58:35 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd158ed-c940-436f-b336-1d056b2b1d30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d27f76-1aa9-48e6-b735-e907b1bbe36b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:58:35 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:58:35 user nova-compute[75672]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)
Nov 30 12:58:35 user nova-compute[75672]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)
Nov 30 12:58:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:58:35 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:58:35 user nova-compute[75672]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 (non-flash)
Nov 30 12:58:35 user nova-compute[75672]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)
Nov 30 12:58:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcf44d8550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8'): ({'sdc'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Removing single pathed devices sdc {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[27150cc9-d09e-43a1-97e2-79323f708aae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ccaf7c-ee9e-4485-885a-2e68ea57009b]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Flushing IO for device /dev/sdc {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8b412e-d218-4fca-9cf8-06a3a276e687]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45e2d74-1eb2-49af-b9c6-7320e20dca15]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ed1185-ef90-4ad5-b4aa-2bad5f076587]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0b59bf-2537-4251-8d95-eed1baedf4e5]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8, portal: 172.16.0.220,3260]
Nov 30 12:58:35 user nova-compute[75672]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8, portal: 172.16.0.220,3260] successful.
Nov 30 12:58:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a018e1a-fd4e-41af-8db4-24be5b696ad6]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] <== disconnect_volume: return (303ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:58:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:58:36 user nova-compute[75672]: DEBUG nova.objects.instance [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lazy-loading 'flavor' on Instance uuid 9de1abf0-249e-44c5-bad0-23dd475132e0 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:58:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-777cbb2f-8fee-4e7b-a81d-8199fff8205f tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.746s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:58:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.633s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:58:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:58:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:58:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:58:36 user nova-compute[75672]: INFO nova.compute.manager [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Terminating instance
Nov 30 12:58:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:58:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-7d6852a6-69dd-44d7-bf2f-28110697f15f req-bfd99a60-8bed-40e4-9a97-3e1807c71a19 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Received event network-vif-unplugged-d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7d6852a6-69dd-44d7-bf2f-28110697f15f req-bfd99a60-8bed-40e4-9a97-3e1807c71a19 service nova] Acquiring lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7d6852a6-69dd-44d7-bf2f-28110697f15f req-bfd99a60-8bed-40e4-9a97-3e1807c71a19 service nova] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-7d6852a6-69dd-44d7-bf2f-28110697f15f req-bfd99a60-8bed-40e4-9a97-3e1807c71a19 service nova] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-7d6852a6-69dd-44d7-bf2f-28110697f15f req-bfd99a60-8bed-40e4-9a97-3e1807c71a19 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] No waiting events found dispatching network-vif-unplugged-d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG nova.compute.manager [req-7d6852a6-69dd-44d7-bf2f-28110697f15f req-bfd99a60-8bed-40e4-9a97-3e1807c71a19 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Received event network-vif-unplugged-d5f8d326-bf95-442a-b095-500dbc3bfc7c for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:58:37 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Instance destroyed successfully.
Nov 30 12:58:37 user nova-compute[75672]: DEBUG nova.objects.instance [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lazy-loading 'resources' on Instance uuid 9de1abf0-249e-44c5-bad0-23dd475132e0 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-794027610',display_name='tempest-VolumesSnapshotTestJSON-instance-794027610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-794027610',id=48,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzSwF639o/wEvIb02p/cwfbnE7SxAZKrgLaTSK/pqIKZsLmGreSZrCTzEhGTplof43B6EgiE6NkB/euKYIbBo4uyAMAmUwJqHANIfh484usm6oAekw7zWiZ68fO2XvR6g==',key_name='tempest-keypair-727724207',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:55:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eae82e7799446a4af16b2b239c2003f',ramdisk_id='',reservation_id='r-m5edpysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-453020492',owner_user_name='tempest-VolumesSnapshotTestJSON-453020492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4204698d39994cf8aab1a59ddc16e387',uuid=9de1abf0-249e-44c5-bad0-23dd475132e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "address": "fa:16:3e:23:b7:cc", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8d326-bf", "ovs_interfaceid": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Converting VIF {"id": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "address": "fa:16:3e:23:b7:cc", "network": {"id": "fcb1c4a1-0917-4076-9739-0989986069ad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1279757672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eae82e7799446a4af16b2b239c2003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8d326-bf", "ovs_interfaceid": "d5f8d326-bf95-442a-b095-500dbc3bfc7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:b7:cc,bridge_name='br-int',has_traffic_filtering=True,id=d5f8d326-bf95-442a-b095-500dbc3bfc7c,network=Network(fcb1c4a1-0917-4076-9739-0989986069ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f8d326-bf') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG os_vif [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:b7:cc,bridge_name='br-int',has_traffic_filtering=True,id=d5f8d326-bf95-442a-b095-500dbc3bfc7c,network=Network(fcb1c4a1-0917-4076-9739-0989986069ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f8d326-bf') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5f8d326-bf, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee2eeed3-6d60-4048-bd55-1171a72c204a) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:58:37 user nova-compute[75672]: INFO os_vif [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:b7:cc,bridge_name='br-int',has_traffic_filtering=True,id=d5f8d326-bf95-442a-b095-500dbc3bfc7c,network=Network(fcb1c4a1-0917-4076-9739-0989986069ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f8d326-bf')
Nov 30 12:58:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkRmSniU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:58:37 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:58:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0ffabf-2ecc-4ee2-858d-7d0dac15a61e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:58:37 user nova-compute[75672]: No targets found.
Nov 30 12:58:37 user nova-compute[75672]: iSNS:
Nov 30 12:58:37 user nova-compute[75672]: No targets found.
Nov 30 12:58:37 user nova-compute[75672]: STATIC:
Nov 30 12:58:37 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74
Nov 30 12:58:37 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:58:37 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:58:37 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:58:37 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:58:37 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:58:37 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d
Nov 30 12:58:37 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:58:37 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:58:37 user nova-compute[75672]: FIRMWARE:
Nov 30 12:58:37 user nova-compute[75672]: No targets found.
Nov 30 12:58:37 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:58:37 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:58:37 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f778c6ef-b571-461c-a64b-f0f50ede03a8', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c087df-d09d-405c-bd48-e436eacae6d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d21280-3412-4231-9e08-0ac734418b06]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:58:37 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:58:37 user nova-compute[75672]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)
Nov 30 12:58:37 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:58:37 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:58:37 user nova-compute[75672]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)
Nov 30 12:58:37 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd00bdf880>, {}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Disconnecting from: [] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] <== disconnect_volume: return (75ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:58:37 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Deleting instance files /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0_del
Nov 30 12:58:37 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Deletion of /opt/stack/data/nova/instances/9de1abf0-249e-44c5-bad0-23dd475132e0_del complete
Nov 30 12:58:37 user nova-compute[75672]: INFO nova.compute.manager [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 30 12:58:37 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:58:37 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:58:38 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:58:38 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Took 0.70 seconds to deallocate network for instance.
Nov 30 12:58:38 user nova-compute[75672]: WARNING nova.volume.cinder [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Attachment cff9905e-10f4-4702-befa-08583422ae5f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = cff9905e-10f4-4702-befa-08583422ae5f. (HTTP 404) (Request-ID: req-a5eb1f7c-9e0c-4022-8997-7506a389c3d3)
Nov 30 12:58:38 user nova-compute[75672]: INFO nova.compute.manager [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Took 0.02 seconds to detach 1 volumes for instance.
Nov 30 12:58:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:58:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:58:38 user nova-compute[75672]: DEBUG nova.compute.manager [req-f44eb310-9be4-41cd-b832-025d413c8286 req-68aaca88-ba1b-4665-aeb7-27796c2f9047 service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Received event network-vif-deleted-d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:58:38 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:58:38 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:58:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:58:38 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Deleted allocations for instance 9de1abf0-249e-44c5-bad0-23dd475132e0
Nov 30 12:58:38 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0f832d29-ee66-464a-bf42-3ac6e901e042 tempest-VolumesSnapshotTestJSON-453020492 tempest-VolumesSnapshotTestJSON-453020492-project-member] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.093s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:58:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-bf4236cc-0760-4aa0-a3d5-e5d57a0e01bf req-ed538f31-cbbe-42be-861d-7d66652040dd service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Received event network-vif-plugged-d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:58:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bf4236cc-0760-4aa0-a3d5-e5d57a0e01bf req-ed538f31-cbbe-42be-861d-7d66652040dd service nova] Acquiring lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:58:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bf4236cc-0760-4aa0-a3d5-e5d57a0e01bf req-ed538f31-cbbe-42be-861d-7d66652040dd service nova] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:58:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bf4236cc-0760-4aa0-a3d5-e5d57a0e01bf req-ed538f31-cbbe-42be-861d-7d66652040dd service nova] Lock "9de1abf0-249e-44c5-bad0-23dd475132e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:58:39 user nova-compute[75672]: DEBUG nova.compute.manager [req-bf4236cc-0760-4aa0-a3d5-e5d57a0e01bf req-ed538f31-cbbe-42be-861d-7d66652040dd service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] No waiting events found dispatching network-vif-plugged-d5f8d326-bf95-442a-b095-500dbc3bfc7c {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:58:39 user nova-compute[75672]: WARNING nova.compute.manager [req-bf4236cc-0760-4aa0-a3d5-e5d57a0e01bf req-ed538f31-cbbe-42be-861d-7d66652040dd service nova] [instance: 9de1abf0-249e-44c5-bad0-23dd475132e0] Received unexpected event network-vif-plugged-d5f8d326-bf95-442a-b095-500dbc3bfc7c for instance with vm_state deleted and task_state None.
Nov 30 12:58:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:58:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:58:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:58:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:58:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:58:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:48 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:58:50 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:58:52 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:58:52 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:58:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:58:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:58:52 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:58:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:53 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Updating instance_info_cache with network_info: [{"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:58:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-47ac940e-edbd-4732-ac04-e242709ee894" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:58:53 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:58:54 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:58:54 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:58:54 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:58:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:58:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:58:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:58:54 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:58:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:58:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:58:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:58:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:58:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:58:56 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:58:56 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:58:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=8399MB free_disk=24.81716537475586GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 12:58:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:58:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:58:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:58:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:58:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:58:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 80050f56-3708-448e-b501-7e930438e94b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:58:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f5e20a72-18eb-4e06-a28e-d1bc9f88f64a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 12:58:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 12:58:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 12:58:56 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:58:56 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:58:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 12:58:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:58:57 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:58:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:58:59 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:58:59 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 12:59:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:03 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:59:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:59:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:59:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 12:59:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:59:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 12:59:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "80050f56-3708-448e-b501-7e930438e94b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "80050f56-3708-448e-b501-7e930438e94b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "80050f56-3708-448e-b501-7e930438e94b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:59:20 user nova-compute[75672]: INFO nova.compute.manager [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Terminating instance
Nov 30 12:59:20 user nova-compute[75672]: DEBUG nova.compute.manager [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-5ea8d204-acb6-4359-b844-ffc10a6d3b7e req-87f0081c-2243-4270-884e-8b628f5b6fff service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-vif-unplugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5ea8d204-acb6-4359-b844-ffc10a6d3b7e req-87f0081c-2243-4270-884e-8b628f5b6fff service nova] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5ea8d204-acb6-4359-b844-ffc10a6d3b7e req-87f0081c-2243-4270-884e-8b628f5b6fff service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5ea8d204-acb6-4359-b844-ffc10a6d3b7e req-87f0081c-2243-4270-884e-8b628f5b6fff service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-5ea8d204-acb6-4359-b844-ffc10a6d3b7e req-87f0081c-2243-4270-884e-8b628f5b6fff service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] No waiting events found dispatching network-vif-unplugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG nova.compute.manager [req-5ea8d204-acb6-4359-b844-ffc10a6d3b7e req-87f0081c-2243-4270-884e-8b628f5b6fff service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-vif-unplugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:21 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 80050f56-3708-448e-b501-7e930438e94b] Instance destroyed successfully.
Nov 30 12:59:21 user nova-compute[75672]: DEBUG nova.objects.instance [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'resources' on Instance uuid 80050f56-3708-448e-b501-7e930438e94b {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1229297497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1229297497',id=47,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:55:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47874c48ecea456eac7968640910afba',ramdisk_id='',reservation_id='r-fkioef23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-547265583',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:57:34Z,user_data=None,user_id='aa5b3c989c934220a07aba162e68ea87',uuid=80050f56-3708-448e-b501-7e930438e94b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converting VIF {"id": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "address": "fa:16:3e:7e:65:77", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d245425-35", "ovs_interfaceid": "0d245425-351d-4f32-bc2e-0c4f4cf9c532", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:65:77,bridge_name='br-int',has_traffic_filtering=True,id=0d245425-351d-4f32-bc2e-0c4f4cf9c532,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d245425-35') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_vif [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:65:77,bridge_name='br-int',has_traffic_filtering=True,id=0d245425-351d-4f32-bc2e-0c4f4cf9c532,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d245425-35') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d245425-35, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f865674-0d90-4949-9191-7469d70e6cc6) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:21 user nova-compute[75672]: INFO os_vif [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:65:77,bridge_name='br-int',has_traffic_filtering=True,id=0d245425-351d-4f32-bc2e-0c4f4cf9c532,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d245425-35')
Nov 30 12:59:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unIFSckN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:59:21 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeb5b89-a686-42fc-b25a-fc1f60398fa0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:59:21 user nova-compute[75672]: No targets found.
Nov 30 12:59:21 user nova-compute[75672]: iSNS:
Nov 30 12:59:21 user nova-compute[75672]: No targets found.
Nov 30 12:59:21 user nova-compute[75672]: STATIC:
Nov 30 12:59:21 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74
Nov 30 12:59:21 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:59:21 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:59:21 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:59:21 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:59:21 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:59:21 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d
Nov 30 12:59:21 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:59:21 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:59:21 user nova-compute[75672]: FIRMWARE:
Nov 30 12:59:21 user nova-compute[75672]: No targets found.
Nov 30 12:59:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:59:21 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:59:21 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd692473-8888-4e4e-8c55-dc693916f296]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ed55e7-4be2-4104-9839-ae32faf3bd2c]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:59:21 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:59:21 user nova-compute[75672]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)
Nov 30 12:59:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:59:21 user nova-compute[75672]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 (non-flash)
Nov 30 12:59:21 user nova-compute[75672]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)
Nov 30 12:59:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcb47c8ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74'): ({'sde'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Removing single pathed devices sde {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bbe1e6-4e4d-41a2-b360-d79ce6eea10a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2a143a-761e-4b15-8c05-f39c92334516]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Flushing IO for device /dev/sde {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[384ae8cd-cfb9-4e5e-9536-ffd40a7e6e00]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c763b893-cd8d-4a00-b24c-9689150a6cc1]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] SCSI volumes sde have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_1e7b0669', '/dev/disk/by-id/scsi-23766393130666439', '/dev/disk/by-id/scsi-1SCST_BIO1e7b0669-7f910fd9f4e52f38') {{(pid=86963) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5be230-bdff-4518-934b-9d8546c65543]: (4, None) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[05999da9-9e66-44b0-ae02-32079295d469]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ee8ef7-2938-4117-a926-c18e8d1ba36f]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74, portal: 172.16.0.220,3260]
Nov 30 12:59:21 user nova-compute[75672]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74, portal: 172.16.0.220,3260] successful.
Nov 30 12:59:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5a1108-315a-43cf-9248-ff49b3e57d74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be5e505-e99e-42c5-8bdc-071c6be00218]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] <== disconnect_volume: return (319ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:59:21 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Deleting instance files /opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b_del
Nov 30 12:59:21 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Deletion of /opt/stack/data/nova/instances/80050f56-3708-448e-b501-7e930438e94b_del complete
Nov 30 12:59:21 user nova-compute[75672]: INFO nova.compute.manager [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 30 12:59:21 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 80050f56-3708-448e-b501-7e930438e94b] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 80050f56-3708-448e-b501-7e930438e94b] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 12:59:21 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 80050f56-3708-448e-b501-7e930438e94b] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:59:21 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 80050f56-3708-448e-b501-7e930438e94b] Took 0.44 seconds to deallocate network for instance.
Nov 30 12:59:21 user nova-compute[75672]: DEBUG nova.compute.manager [req-ae3091ca-15b4-4aca-929f-3d61e22a5401 req-d8e6222d-e013-4b14-a8d9-8d32dfde90c9 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-vif-deleted-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:59:21 user nova-compute[75672]: INFO nova.compute.manager [req-ae3091ca-15b4-4aca-929f-3d61e22a5401 req-d8e6222d-e013-4b14-a8d9-8d32dfde90c9 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Neutron deleted interface 0d245425-351d-4f32-bc2e-0c4f4cf9c532; detaching it from the instance and deleting it from the info cache
Nov 30 12:59:21 user nova-compute[75672]: DEBUG nova.network.neutron [req-ae3091ca-15b4-4aca-929f-3d61e22a5401 req-d8e6222d-e013-4b14-a8d9-8d32dfde90c9 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:59:22 user nova-compute[75672]: DEBUG nova.compute.manager [req-ae3091ca-15b4-4aca-929f-3d61e22a5401 req-d8e6222d-e013-4b14-a8d9-8d32dfde90c9 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Detach interface failed, port_id=0d245425-351d-4f32-bc2e-0c4f4cf9c532, reason: Instance 80050f56-3708-448e-b501-7e930438e94b could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 12:59:22 user nova-compute[75672]: DEBUG nova.compute.manager [req-fb626985-7ce4-43d8-b2bc-601ae0e07caf req-f7b71711-0376-44d9-bd9f-3622814c6679 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:59:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fb626985-7ce4-43d8-b2bc-601ae0e07caf req-f7b71711-0376-44d9-bd9f-3622814c6679 service nova] Acquiring lock "80050f56-3708-448e-b501-7e930438e94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:59:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fb626985-7ce4-43d8-b2bc-601ae0e07caf req-f7b71711-0376-44d9-bd9f-3622814c6679 service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:59:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-fb626985-7ce4-43d8-b2bc-601ae0e07caf req-f7b71711-0376-44d9-bd9f-3622814c6679 service nova] Lock "80050f56-3708-448e-b501-7e930438e94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:59:22 user nova-compute[75672]: DEBUG nova.compute.manager [req-fb626985-7ce4-43d8-b2bc-601ae0e07caf req-f7b71711-0376-44d9-bd9f-3622814c6679 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] No waiting events found dispatching network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:59:22 user nova-compute[75672]: WARNING nova.compute.manager [req-fb626985-7ce4-43d8-b2bc-601ae0e07caf req-f7b71711-0376-44d9-bd9f-3622814c6679 service nova] [instance: 80050f56-3708-448e-b501-7e930438e94b] Received unexpected event network-vif-plugged-0d245425-351d-4f32-bc2e-0c4f4cf9c532 for instance with vm_state active and task_state deleting.
Nov 30 12:59:22 user nova-compute[75672]: INFO nova.compute.manager [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 80050f56-3708-448e-b501-7e930438e94b] Took 0.84 seconds to detach 1 volumes for instance.
Nov 30 12:59:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:59:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:59:23 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:59:23 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:59:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:59:23 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Deleted allocations for instance 80050f56-3708-448e-b501-7e930438e94b
Nov 30 12:59:23 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-0e714047-6cc3-492c-9456-0243d1e7eca3 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "80050f56-3708-448e-b501-7e930438e94b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.842s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:59:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:59:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:59:25 user nova-compute[75672]: INFO nova.compute.manager [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Detaching volume 72576457-16ab-4da5-883a-c38b7e634a8d
Nov 30 12:59:25 user nova-compute[75672]: INFO nova.virt.block_device [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Attempting to driver detach volume 72576457-16ab-4da5-883a-c38b7e634a8d from mountpoint /dev/vdc
Nov 30 12:59:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Attempting to detach device vdc from instance f5e20a72-18eb-4e06-a28e-d1bc9f88f64a from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 12:59:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:59:25 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:59:25 user nova-compute[75672]:   <source dev="/dev/sdf"/>
Nov 30 12:59:25 user nova-compute[75672]:   <target dev="vdc" bus="virtio"/>
Nov 30 12:59:25 user nova-compute[75672]:   <serial>72576457-16ab-4da5-883a-c38b7e634a8d</serial>
Nov 30 12:59:25 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 12:59:25 user nova-compute[75672]: </disk>
Nov 30 12:59:25 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:59:25 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Successfully detached device vdc from instance f5e20a72-18eb-4e06-a28e-d1bc9f88f64a from the persistent domain config.
Nov 30 12:59:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f5e20a72-18eb-4e06-a28e-d1bc9f88f64a from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 12:59:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 12:59:25 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:59:25 user nova-compute[75672]:   <source dev="/dev/sdf"/>
Nov 30 12:59:25 user nova-compute[75672]:   <target dev="vdc" bus="virtio"/>
Nov 30 12:59:25 user nova-compute[75672]:   <serial>72576457-16ab-4da5-883a-c38b7e634a8d</serial>
Nov 30 12:59:25 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 12:59:25 user nova-compute[75672]: </disk>
Nov 30 12:59:25 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 12:59:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f5e20a72-18eb-4e06-a28e-d1bc9f88f64a {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 12:59:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "b5b3baae-893d-4909-9504-e0be595cbf67" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "b5b3baae-893d-4909-9504-e0be595cbf67" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:59:43 user nova-compute[75672]: INFO nova.compute.manager [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Unshelving
Nov 30 12:59:43 user nova-compute[75672]: INFO nova.virt.block_device [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Booting with volume 1a9701f3-890f-47d7-bfcf-3318810bbd74 at /dev/vda
Nov 30 12:59:43 user nova-compute[75672]: DEBUG os_brick.utils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c150fb2-c647-4230-bd83-6f4f04cd2f87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d9cbdf-8d06-4e41-a662-03e1cee5b8ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0e6d4e-eb5f-4ce1-ab28-8aea23a9e424]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74e5bf9-9df3-42a5-9c3c-965a0cd6bb3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 12:59:43 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 12:59:44 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 12:59:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca61859-f8cf-4b67-899a-fa2081a9320d]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 12:59:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 12:59:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 12:59:44 user nova-compute[75672]: DEBUG os_brick.utils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:59:44 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updating existing volume attachment record: c9daad17-1ff1-4e01-a818-da8d4ee41b69 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 12:59:45 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f5e20a72-18eb-4e06-a28e-d1bc9f88f64a is timed out.
Nov 30 12:59:45 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Successfully detached device vdc from instance f5e20a72-18eb-4e06-a28e-d1bc9f88f64a from the live domain config.
Nov 30 12:59:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YANOuclw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:59:45 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c455756f-02dc-4d6b-a0e5-00ff3ffb0028]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 12:59:45 user nova-compute[75672]: No targets found.
Nov 30 12:59:45 user nova-compute[75672]: iSNS:
Nov 30 12:59:45 user nova-compute[75672]: No targets found.
Nov 30 12:59:45 user nova-compute[75672]: STATIC:
Nov 30 12:59:45 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 12:59:45 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:59:45 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:59:45 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d
Nov 30 12:59:45 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 12:59:45 user nova-compute[75672]:                 Iface Name: default
Nov 30 12:59:45 user nova-compute[75672]: FIRMWARE:
Nov 30 12:59:45 user nova-compute[75672]: No targets found.
Nov 30 12:59:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 12:59:45 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 12:59:45 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa40563c-7c27-410b-84a3-f7c041fc7b27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9385c6-1028-4ef2-b779-8cff337fd5ea]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:59:45 user nova-compute[75672]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)
Nov 30 12:59:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:59:45 user nova-compute[75672]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d (non-flash)
Nov 30 12:59:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd41063b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d'): ({'sdf'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Removing single pathed devices sdf {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[03506e8e-0564-4484-a91e-296ede3aceac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc6b440-40a5-44bb-b046-8b411527638c]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Flushing IO for device /dev/sdf {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0063da83-7885-429e-9cb5-ff53dff10467]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac9b1e4-b645-42ec-9788-8a4bc79186a6]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] SCSI volumes sdf have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[016dc4e6-2f91-48eb-b74b-185242fcd0a4]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5947950b-2152-4dae-a21d-3f87f61e805c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d, portal: 172.16.0.220,3260]
Nov 30 12:59:45 user nova-compute[75672]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d, portal: 172.16.0.220,3260] successful.
Nov 30 12:59:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72576457-16ab-4da5-883a-c38b7e634a8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[98679575-f5f6-473f-8c29-08a5cbc6c0fb]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] <== disconnect_volume: return (313ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:59:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 12:59:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:48 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:59:49 user nova-compute[75672]: DEBUG nova.objects.instance [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'flavor' on Instance uuid f5e20a72-18eb-4e06-a28e-d1bc9f88f64a {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:59:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-2a89cd07-5fb3-4f78-a807-69490c98608f tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.889s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:59:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:52 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:59:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:59:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:59:53 user nova-compute[75672]: DEBUG nova.objects.instance [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lazy-loading 'pci_requests' on Instance uuid b5b3baae-893d-4909-9504-e0be595cbf67 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:59:53 user nova-compute[75672]: DEBUG nova.objects.instance [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lazy-loading 'numa_topology' on Instance uuid b5b3baae-893d-4909-9504-e0be595cbf67 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:59:53 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 12:59:53 user nova-compute[75672]: INFO nova.compute.claims [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Claim successful on node user
Nov 30 12:59:53 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:59:53 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 12:59:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:59:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:59:53 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 12:59:53 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 12:59:53 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 12:59:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:59:53 user nova-compute[75672]: INFO nova.network.neutron [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updating port b432c044-6444-4219-a936-3a8e16d4d3d3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Updating instance_info_cache with network_info: [{"id": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "address": "fa:16:3e:70:81:44", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc241fa-0a", "ovs_interfaceid": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquired lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-d828e135-c454-4967-91d4-85e01b999ba5 req-d71afcf7-b9df-4e06-bff6-137c1125601a service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-changed-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-d828e135-c454-4967-91d4-85e01b999ba5 req-d71afcf7-b9df-4e06-bff6-137c1125601a service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Refreshing instance network info cache due to event network-changed-b432c044-6444-4219-a936-3a8e16d4d3d3. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d828e135-c454-4967-91d4-85e01b999ba5 req-d71afcf7-b9df-4e06-bff6-137c1125601a service nova] Acquiring lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updating instance_info_cache with network_info: [{"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Releasing lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 12:59:54 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Creating image(s)
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Did not create local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Ensure instance console log exists: /opt/stack/data/nova/instances/b5b3baae-893d-4909-9504-e0be595cbf67/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Start _get_guest_xml network_info=[{"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c9daad17-1ff1-4e01-a818-da8d4ee41b69', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiPlUDVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b5b3baae-893d-4909-9504-e0be595cbf67', 'attached_at': '', 'detached_at': '', 'volume_id': '1a9701f3-890f-47d7-bfcf-3318810bbd74', 'serial': '1a9701f3-890f-47d7-bfcf-3318810bbd74'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d828e135-c454-4967-91d4-85e01b999ba5 req-d71afcf7-b9df-4e06-bff6-137c1125601a service nova] Acquired lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.network.neutron [req-d828e135-c454-4967-91d4-85e01b999ba5 req-d71afcf7-b9df-4e06-bff6-137c1125601a service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Refreshing network info cache for port b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 12:59:54 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:59:54 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.objects.instance [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lazy-loading 'vcpu_model' on Instance uuid b5b3baae-893d-4909-9504-e0be595cbf67 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.objects.base [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Object Instance<b5b3baae-893d-4909-9504-e0be595cbf67> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiPlUDVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 12:59:54 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:59:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:59:54 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 12:59:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 12:59:54 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5be189-7427-4b47-b04e-79a2e8d6e668]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 12:59:54 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ae95ab-5122-41ef-9f70-883a90bde460]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74] added
Nov 30 12:59:54 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[759dba53-f4f0-4624-9d16-d708731d8cad]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dac55c7-5186-46be-8224-039491bc44ed]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tiPlUDVC {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tiPlUDVC" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b50ec42-24f4-496e-a2f1-d2ec2338ee0c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tiPlUDVC'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c654cd-6199-4c09-a1c4-3a83dece1338]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2928ccc5-dc74-4b8f-a8d5-20b5bbb38f60]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:59:54 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:59:54 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:59:54 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce052a2-b1dd-4917-955b-2e2db3ef62b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260]
Nov 30 12:59:55 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260] successful.
Nov 30 12:59:55 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[256cf54b-88b0-44f0-b52b-b23cef169f2e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a29670-8d22-4ef0-8312-7e487bb2a345]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:59:55 user nova-compute[75672]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 12:59:55 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 12:59:55 user nova-compute[75672]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 12:59:55 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff5132c-495f-490f-b511-148d8236c64f]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiPlUDVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG nova.network.neutron [req-d828e135-c454-4967-91d4-85e01b999ba5 req-d71afcf7-b9df-4e06-bff6-137c1125601a service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updated VIF entry in instance network info cache for port b432c044-6444-4219-a936-3a8e16d4d3d3. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG nova.network.neutron [req-d828e135-c454-4967-91d4-85e01b999ba5 req-d71afcf7-b9df-4e06-bff6-137c1125601a service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updating instance_info_cache with network_info: [{"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 12:59:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d828e135-c454-4967-91d4-85e01b999ba5 req-d71afcf7-b9df-4e06-bff6-137c1125601a service nova] Releasing lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23165633461666566', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165633461666566', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T12:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1955223693',display_name='tempest-TestShelveInstance-server-1955223693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1955223693',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-264328173',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:56:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='12dc381a3d4844cc84b470c640b397c7',ramdisk_id='',reservation_id='r-d2xwykph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-802679308',owner_user_name='tempest-TestShelveInstance-802679308-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:59:44Z,user_data=None,user_id='e62e4eb6ad444fc3bc0e069c9cc2f921',uuid=b5b3baae-893d-4909-9504-e0be595cbf67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Converting VIF {"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=b432c044-6444-4219-a936-3a8e16d4d3d3,network=Network(4b8e876a-ae88-4a30-bfbe-7fdf5585ea26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb432c044-64') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG nova.objects.instance [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lazy-loading 'pci_devices' on Instance uuid b5b3baae-893d-4909-9504-e0be595cbf67 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG nova.objects.base [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Object Instance<b5b3baae-893d-4909-9504-e0be595cbf67> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] End _get_guest_xml xml=<domain type="kvm">
Nov 30 12:59:56 user nova-compute[75672]:   <uuid>b5b3baae-893d-4909-9504-e0be595cbf67</uuid>
Nov 30 12:59:56 user nova-compute[75672]:   <name>instance-00000031</name>
Nov 30 12:59:56 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 12:59:56 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 12:59:56 user nova-compute[75672]:   <metadata>
Nov 30 12:59:56 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 12:59:56 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 12:59:56 user nova-compute[75672]:       <nova:name>tempest-TestShelveInstance-server-1955223693</nova:name>
Nov 30 12:59:56 user nova-compute[75672]:       <nova:creationTime>2023-11-30 12:59:54</nova:creationTime>
Nov 30 12:59:56 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 12:59:56 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 12:59:56 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 12:59:56 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 12:59:56 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 12:59:56 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 12:59:56 user nova-compute[75672]:       </nova:flavor>
Nov 30 12:59:56 user nova-compute[75672]:       <nova:owner>
Nov 30 12:59:56 user nova-compute[75672]:         <nova:user uuid="e62e4eb6ad444fc3bc0e069c9cc2f921">tempest-TestShelveInstance-802679308-project-member</nova:user>
Nov 30 12:59:56 user nova-compute[75672]:         <nova:project uuid="12dc381a3d4844cc84b470c640b397c7">tempest-TestShelveInstance-802679308</nova:project>
Nov 30 12:59:56 user nova-compute[75672]:       </nova:owner>
Nov 30 12:59:56 user nova-compute[75672]:       <nova:ports>
Nov 30 12:59:56 user nova-compute[75672]:         <nova:port uuid="b432c044-6444-4219-a936-3a8e16d4d3d3">
Nov 30 12:59:56 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 12:59:56 user nova-compute[75672]:         </nova:port>
Nov 30 12:59:56 user nova-compute[75672]:       </nova:ports>
Nov 30 12:59:56 user nova-compute[75672]:     </nova:instance>
Nov 30 12:59:56 user nova-compute[75672]:   </metadata>
Nov 30 12:59:56 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 12:59:56 user nova-compute[75672]:     <system>
Nov 30 12:59:56 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 12:59:56 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 12:59:56 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 12:59:56 user nova-compute[75672]:       <entry name="serial">b5b3baae-893d-4909-9504-e0be595cbf67</entry>
Nov 30 12:59:56 user nova-compute[75672]:       <entry name="uuid">b5b3baae-893d-4909-9504-e0be595cbf67</entry>
Nov 30 12:59:56 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 12:59:56 user nova-compute[75672]:     </system>
Nov 30 12:59:56 user nova-compute[75672]:   </sysinfo>
Nov 30 12:59:56 user nova-compute[75672]:   <os>
Nov 30 12:59:56 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 12:59:56 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 12:59:56 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 12:59:56 user nova-compute[75672]:   </os>
Nov 30 12:59:56 user nova-compute[75672]:   <features>
Nov 30 12:59:56 user nova-compute[75672]:     <acpi/>
Nov 30 12:59:56 user nova-compute[75672]:     <apic/>
Nov 30 12:59:56 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 12:59:56 user nova-compute[75672]:   </features>
Nov 30 12:59:56 user nova-compute[75672]:   <clock offset="utc">
Nov 30 12:59:56 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 12:59:56 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 12:59:56 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 12:59:56 user nova-compute[75672]:   </clock>
Nov 30 12:59:56 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 12:59:56 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 12:59:56 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 12:59:56 user nova-compute[75672]:   </cpu>
Nov 30 12:59:56 user nova-compute[75672]:   <devices>
Nov 30 12:59:56 user nova-compute[75672]:     <disk type="block" device="disk">
Nov 30 12:59:56 user nova-compute[75672]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 12:59:56 user nova-compute[75672]:       <source dev="/dev/sdb"/>
Nov 30 12:59:56 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 12:59:56 user nova-compute[75672]:       <serial>1a9701f3-890f-47d7-bfcf-3318810bbd74</serial>
Nov 30 12:59:56 user nova-compute[75672]:     </disk>
Nov 30 12:59:56 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 12:59:56 user nova-compute[75672]:       <mac address="fa:16:3e:98:ec:8b"/>
Nov 30 12:59:56 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:59:56 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 12:59:56 user nova-compute[75672]:       <target dev="tapb432c044-64"/>
Nov 30 12:59:56 user nova-compute[75672]:     </interface>
Nov 30 12:59:56 user nova-compute[75672]:     <serial type="pty">
Nov 30 12:59:56 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/b5b3baae-893d-4909-9504-e0be595cbf67/console.log" append="off"/>
Nov 30 12:59:56 user nova-compute[75672]:     </serial>
Nov 30 12:59:56 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 12:59:56 user nova-compute[75672]:     <video>
Nov 30 12:59:56 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 12:59:56 user nova-compute[75672]:     </video>
Nov 30 12:59:56 user nova-compute[75672]:     <rng model="virtio">
Nov 30 12:59:56 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 12:59:56 user nova-compute[75672]:     </rng>
Nov 30 12:59:56 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 12:59:56 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 12:59:56 user nova-compute[75672]:       <stats period="10"/>
Nov 30 12:59:56 user nova-compute[75672]:     </memballoon>
Nov 30 12:59:56 user nova-compute[75672]:   </devices>
Nov 30 12:59:56 user nova-compute[75672]: </domain>
Nov 30 12:59:56 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T12:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1955223693',display_name='tempest-TestShelveInstance-server-1955223693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1955223693',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-264328173',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:56:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='12dc381a3d4844cc84b470c640b397c7',ramdisk_id='',reservation_id='r-d2xwykph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-802679308',owner_user_name='tempest-TestShelveInstance-802679308-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:59:44Z,user_data=None,user_id='e62e4eb6ad444fc3bc0e069c9cc2f921',uuid=b5b3baae-893d-4909-9504-e0be595cbf67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Converting VIF {"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=b432c044-6444-4219-a936-3a8e16d4d3d3,network=Network(4b8e876a-ae88-4a30-bfbe-7fdf5585ea26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb432c044-64') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG os_vif [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=b432c044-6444-4219-a936-3a8e16d4d3d3,network=Network(4b8e876a-ae88-4a30-bfbe-7fdf5585ea26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb432c044-64') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6be3d3ec-4a0e-5db6-807e-a5888abccdef', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb432c044-64, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb432c044-64, col_values=(('qos', UUID('2626dfa5-12da-46fd-9c9a-dc885f61423b')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb432c044-64, col_values=(('external_ids', {'iface-id': 'b432c044-6444-4219-a936-3a8e16d4d3d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:ec:8b', 'vm-uuid': 'b5b3baae-893d-4909-9504-e0be595cbf67'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:56 user nova-compute[75672]: INFO os_vif [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=b432c044-6444-4219-a936-3a8e16d4d3d3,network=Network(4b8e876a-ae88-4a30-bfbe-7fdf5585ea26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb432c044-64')
Nov 30 12:59:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] No VIF found with MAC fa:16:3e:98:ec:8b, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:59:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 12:59:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-a5a243a4-eb3f-4b00-b6a9-db14eb133ee7 req-e4903c44-2aba-4bc7-9543-8a9c3ca6be71 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 12:59:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a5a243a4-eb3f-4b00-b6a9-db14eb133ee7 req-e4903c44-2aba-4bc7-9543-8a9c3ca6be71 service nova] Acquiring lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 12:59:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a5a243a4-eb3f-4b00-b6a9-db14eb133ee7 req-e4903c44-2aba-4bc7-9543-8a9c3ca6be71 service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 12:59:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a5a243a4-eb3f-4b00-b6a9-db14eb133ee7 req-e4903c44-2aba-4bc7-9543-8a9c3ca6be71 service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 12:59:57 user nova-compute[75672]: DEBUG nova.compute.manager [req-a5a243a4-eb3f-4b00-b6a9-db14eb133ee7 req-e4903c44-2aba-4bc7-9543-8a9c3ca6be71 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] No waiting events found dispatching network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 12:59:57 user nova-compute[75672]: WARNING nova.compute.manager [req-a5a243a4-eb3f-4b00-b6a9-db14eb133ee7 req-e4903c44-2aba-4bc7-9543-8a9c3ca6be71 service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received unexpected event network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 12:59:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 12:59:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:59:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 12:59:58 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 12:59:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 12:59:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-4b21a873-cd9d-4b61-a1d6-4527176f20d8 req-de7f4176-6d7d-499d-abf4-2b39bc21332e service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4b21a873-cd9d-4b61-a1d6-4527176f20d8 req-de7f4176-6d7d-499d-abf4-2b39bc21332e service nova] Acquiring lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4b21a873-cd9d-4b61-a1d6-4527176f20d8 req-de7f4176-6d7d-499d-abf4-2b39bc21332e service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-4b21a873-cd9d-4b61-a1d6-4527176f20d8 req-de7f4176-6d7d-499d-abf4-2b39bc21332e service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-4b21a873-cd9d-4b61-a1d6-4527176f20d8 req-de7f4176-6d7d-499d-abf4-2b39bc21332e service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] No waiting events found dispatching network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:00:00 user nova-compute[75672]: WARNING nova.compute.manager [req-4b21a873-cd9d-4b61-a1d6-4527176f20d8 req-de7f4176-6d7d-499d-abf4-2b39bc21332e service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received unexpected event network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 13:00:00 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:00:00 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=8564MB free_disk=24.805416107177734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:00:00 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Instance spawned successfully.
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9908b6ed-2b26-492f-b69a-d5d2f0bbef67 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "b5b3baae-893d-4909-9504-e0be595cbf67" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.358s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f5e20a72-18eb-4e06-a28e-d1bc9f88f64a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (9d360ecf-be43-4c84-93ca-abc6f9902098): {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. Skipping heal of allocations during the task state transition. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 13:00:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:05 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:00:05 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 13:00:05 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:00:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:07 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:11 user nova-compute[75672]: INFO nova.compute.manager [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Terminating instance
Nov 30 13:00:11 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-49df4f15-c41c-4893-8017-7c354f062f86 req-7cfbd72f-6dbd-4455-8ece-3d26aadb44f6 service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Received event network-vif-unplugged-cbc241fa-0a2b-440a-a5f4-12868d7468da {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-49df4f15-c41c-4893-8017-7c354f062f86 req-7cfbd72f-6dbd-4455-8ece-3d26aadb44f6 service nova] Acquiring lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-49df4f15-c41c-4893-8017-7c354f062f86 req-7cfbd72f-6dbd-4455-8ece-3d26aadb44f6 service nova] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-49df4f15-c41c-4893-8017-7c354f062f86 req-7cfbd72f-6dbd-4455-8ece-3d26aadb44f6 service nova] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-49df4f15-c41c-4893-8017-7c354f062f86 req-7cfbd72f-6dbd-4455-8ece-3d26aadb44f6 service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] No waiting events found dispatching network-vif-unplugged-cbc241fa-0a2b-440a-a5f4-12868d7468da {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-49df4f15-c41c-4893-8017-7c354f062f86 req-7cfbd72f-6dbd-4455-8ece-3d26aadb44f6 service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Received event network-vif-unplugged-cbc241fa-0a2b-440a-a5f4-12868d7468da for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:12 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Instance destroyed successfully.
Nov 30 13:00:12 user nova-compute[75672]: DEBUG nova.objects.instance [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'resources' on Instance uuid a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:50:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1861567866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1861567866',id=41,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:50:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47874c48ecea456eac7968640910afba',ramdisk_id='',reservation_id='r-jxb05245',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-547265583',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:52:46Z,user_data=None,user_id='aa5b3c989c934220a07aba162e68ea87',uuid=a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "address": "fa:16:3e:70:81:44", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc241fa-0a", "ovs_interfaceid": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converting VIF {"id": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "address": "fa:16:3e:70:81:44", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc241fa-0a", "ovs_interfaceid": "cbc241fa-0a2b-440a-a5f4-12868d7468da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:81:44,bridge_name='br-int',has_traffic_filtering=True,id=cbc241fa-0a2b-440a-a5f4-12868d7468da,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc241fa-0a') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG os_vif [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:81:44,bridge_name='br-int',has_traffic_filtering=True,id=cbc241fa-0a2b-440a-a5f4-12868d7468da,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc241fa-0a') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbc241fa-0a, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6426d85f-7553-49a8-b55c-0ce9837ad946) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:12 user nova-compute[75672]: INFO os_vif [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:81:44,bridge_name='br-int',has_traffic_filtering=True,id=cbc241fa-0a2b-440a-a5f4-12868d7468da,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc241fa-0a')
Nov 30 13:00:12 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Deleting instance files /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c_del
Nov 30 13:00:12 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Deletion of /opt/stack/data/nova/instances/a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c_del complete
Nov 30 13:00:12 user nova-compute[75672]: INFO nova.compute.manager [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 30 13:00:12 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:00:12 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Took 0.62 seconds to deallocate network for instance.
Nov 30 13:00:12 user nova-compute[75672]: DEBUG nova.compute.manager [req-27a211d3-1e44-43ed-b8ac-f359aa07ea4b req-d90e1261-bd0a-4643-973a-a0f8bf444d2f service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Received event network-vif-deleted-cbc241fa-0a2b-440a-a5f4-12868d7468da {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:00:12 user nova-compute[75672]: INFO nova.compute.manager [req-27a211d3-1e44-43ed-b8ac-f359aa07ea4b req-d90e1261-bd0a-4643-973a-a0f8bf444d2f service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Neutron deleted interface cbc241fa-0a2b-440a-a5f4-12868d7468da; detaching it from the instance and deleting it from the info cache
Nov 30 13:00:12 user nova-compute[75672]: DEBUG nova.network.neutron [req-27a211d3-1e44-43ed-b8ac-f359aa07ea4b req-d90e1261-bd0a-4643-973a-a0f8bf444d2f service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG nova.compute.manager [req-27a211d3-1e44-43ed-b8ac-f359aa07ea4b req-d90e1261-bd0a-4643-973a-a0f8bf444d2f service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Detach interface failed, port_id=cbc241fa-0a2b-440a-a5f4-12868d7468da, reason: Instance a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:00:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:00:13 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:00:13 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:00:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:13 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Deleted allocations for instance a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c
Nov 30 13:00:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f0c634df-f9c3-4af8-9205-bbdb2dca89ff tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.981s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-a4ad17a0-3ed2-4962-9a17-70a66db1210a req-4750dc7c-948b-43db-99b0-8a894686326e service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Received event network-vif-plugged-cbc241fa-0a2b-440a-a5f4-12868d7468da {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:00:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a4ad17a0-3ed2-4962-9a17-70a66db1210a req-4750dc7c-948b-43db-99b0-8a894686326e service nova] Acquiring lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:00:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a4ad17a0-3ed2-4962-9a17-70a66db1210a req-4750dc7c-948b-43db-99b0-8a894686326e service nova] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:00:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-a4ad17a0-3ed2-4962-9a17-70a66db1210a req-4750dc7c-948b-43db-99b0-8a894686326e service nova] Lock "a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-a4ad17a0-3ed2-4962-9a17-70a66db1210a req-4750dc7c-948b-43db-99b0-8a894686326e service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] No waiting events found dispatching network-vif-plugged-cbc241fa-0a2b-440a-a5f4-12868d7468da {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:00:13 user nova-compute[75672]: WARNING nova.compute.manager [req-a4ad17a0-3ed2-4962-9a17-70a66db1210a req-4750dc7c-948b-43db-99b0-8a894686326e service nova] [instance: a077ab1a-2a3f-4d9e-95a6-48a74ea5bf5c] Received unexpected event network-vif-plugged-cbc241fa-0a2b-440a-a5f4-12868d7468da for instance with vm_state deleted and task_state None.
Nov 30 13:00:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:00:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:00:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:00:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:00:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:15 user nova-compute[75672]: INFO nova.compute.manager [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Terminating instance
Nov 30 13:00:15 user nova-compute[75672]: DEBUG nova.compute.manager [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 13:00:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:15 user nova-compute[75672]: DEBUG nova.compute.manager [req-f76ca089-f2b2-4ee1-b51d-4c909da85de3 req-09a44c7f-fd58-41e3-9b64-669bbbb52d33 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received event network-vif-unplugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:00:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f76ca089-f2b2-4ee1-b51d-4c909da85de3 req-09a44c7f-fd58-41e3-9b64-669bbbb52d33 service nova] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:00:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f76ca089-f2b2-4ee1-b51d-4c909da85de3 req-09a44c7f-fd58-41e3-9b64-669bbbb52d33 service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:00:15 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f76ca089-f2b2-4ee1-b51d-4c909da85de3 req-09a44c7f-fd58-41e3-9b64-669bbbb52d33 service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:15 user nova-compute[75672]: DEBUG nova.compute.manager [req-f76ca089-f2b2-4ee1-b51d-4c909da85de3 req-09a44c7f-fd58-41e3-9b64-669bbbb52d33 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] No waiting events found dispatching network-vif-unplugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:00:15 user nova-compute[75672]: DEBUG nova.compute.manager [req-f76ca089-f2b2-4ee1-b51d-4c909da85de3 req-09a44c7f-fd58-41e3-9b64-669bbbb52d33 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received event network-vif-unplugged-0f14b102-12f4-4138-9227-d231693b61e8 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 13:00:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Instance destroyed successfully.
Nov 30 13:00:16 user nova-compute[75672]: DEBUG nova.objects.instance [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'resources' on Instance uuid f5e20a72-18eb-4e06-a28e-d1bc9f88f64a {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T12:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1480779755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1480779755',id=46,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/4Xthbt7YMcriM6AbB5mTwThqufRFxpj1vCBwiqGrbMgOoMPstysotckw2aKh1s4BlRzesc1LcFIVvsri+pJD+cPC5L10MOGW858Yxbt0zmAWlKJ5vEkcZ+NloSW13rg==',key_name='tempest-keypair-1872424482',keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:57:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e674749412c04ea3a757ac31928844c6',ramdisk_id='',reservation_id='r-gjk8zon0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792375540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792375540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:57:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e87ad9fef5444b4b0124b0bd71f8324',uuid=f5e20a72-18eb-4e06-a28e-d1bc9f88f64a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converting VIF {"id": "0f14b102-12f4-4138-9227-d231693b61e8", "address": "fa:16:3e:16:4e:b7", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f14b102-12", "ovs_interfaceid": "0f14b102-12f4-4138-9227-d231693b61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0f14b102-12f4-4138-9227-d231693b61e8,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f14b102-12') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG os_vif [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0f14b102-12f4-4138-9227-d231693b61e8,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f14b102-12') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f14b102-12, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad059e21-82a1-4247-8282-609718050a81) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:00:16 user nova-compute[75672]: INFO os_vif [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0f14b102-12f4-4138-9227-d231693b61e8,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f14b102-12')
Nov 30 13:00:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Deleting instance files /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a_del
Nov 30 13:00:16 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Deletion of /opt/stack/data/nova/instances/f5e20a72-18eb-4e06-a28e-d1bc9f88f64a_del complete
Nov 30 13:00:16 user nova-compute[75672]: INFO nova.compute.manager [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 30 13:00:16 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 13:00:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:17 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:00:17 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Took 0.75 seconds to deallocate network for instance.
Nov 30 13:00:17 user nova-compute[75672]: DEBUG nova.compute.manager [req-2d11c27f-c53a-4cf3-a96e-14d3bead157b req-92471953-3624-43ae-847a-5e257587c99e service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received event network-vif-deleted-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:00:17 user nova-compute[75672]: INFO nova.compute.manager [req-2d11c27f-c53a-4cf3-a96e-14d3bead157b req-92471953-3624-43ae-847a-5e257587c99e service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Neutron deleted interface 0f14b102-12f4-4138-9227-d231693b61e8; detaching it from the instance and deleting it from the info cache
Nov 30 13:00:17 user nova-compute[75672]: DEBUG nova.network.neutron [req-2d11c27f-c53a-4cf3-a96e-14d3bead157b req-92471953-3624-43ae-847a-5e257587c99e service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:00:17 user nova-compute[75672]: DEBUG nova.compute.manager [req-2d11c27f-c53a-4cf3-a96e-14d3bead157b req-92471953-3624-43ae-847a-5e257587c99e service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Detach interface failed, port_id=0f14b102-12f4-4138-9227-d231693b61e8, reason: Instance f5e20a72-18eb-4e06-a28e-d1bc9f88f64a could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 13:00:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:00:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:00:17 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:00:17 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:00:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:17 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Deleted allocations for instance f5e20a72-18eb-4e06-a28e-d1bc9f88f64a
Nov 30 13:00:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-bf9f5396-0f4a-4d52-995c-325a4d4bc4b6 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.008s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:17 user nova-compute[75672]: DEBUG nova.compute.manager [req-f9bd0cf4-5313-48c6-a248-331ad7bfb117 req-1e3ea8e9-1111-4288-b8a9-dd401e77af31 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received event network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:00:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f9bd0cf4-5313-48c6-a248-331ad7bfb117 req-1e3ea8e9-1111-4288-b8a9-dd401e77af31 service nova] Acquiring lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:00:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f9bd0cf4-5313-48c6-a248-331ad7bfb117 req-1e3ea8e9-1111-4288-b8a9-dd401e77af31 service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:00:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-f9bd0cf4-5313-48c6-a248-331ad7bfb117 req-1e3ea8e9-1111-4288-b8a9-dd401e77af31 service nova] Lock "f5e20a72-18eb-4e06-a28e-d1bc9f88f64a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:17 user nova-compute[75672]: DEBUG nova.compute.manager [req-f9bd0cf4-5313-48c6-a248-331ad7bfb117 req-1e3ea8e9-1111-4288-b8a9-dd401e77af31 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] No waiting events found dispatching network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:00:17 user nova-compute[75672]: WARNING nova.compute.manager [req-f9bd0cf4-5313-48c6-a248-331ad7bfb117 req-1e3ea8e9-1111-4288-b8a9-dd401e77af31 service nova] [instance: f5e20a72-18eb-4e06-a28e-d1bc9f88f64a] Received unexpected event network-vif-plugged-0f14b102-12f4-4138-9227-d231693b61e8 for instance with vm_state deleted and task_state None.
Nov 30 13:00:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:00:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:00:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:00:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:00:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:00:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:50 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:00:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:00:52 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:00:55 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:00:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 13:00:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:00:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:00:55 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updating instance_info_cache with network_info: [{"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:00:56 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:00:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:00:57 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:00:57 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:00:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=8754MB free_disk=24.95684814453125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 13:00:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:00:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:00:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:00:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance 47ac940e-edbd-4732-ac04-e242709ee894 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:00:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance b5b3baae-893d-4909-9504-e0be595cbf67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:00:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 13:00:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 13:00:57 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:00:57 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:00:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 13:00:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:00:58 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:00:58 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:01:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:01:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "47ac940e-edbd-4732-ac04-e242709ee894" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:01 user nova-compute[75672]: INFO nova.compute.manager [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Terminating instance
Nov 30 13:01:01 user nova-compute[75672]: DEBUG nova.compute.manager [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 13:01:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-893f2ce5-dee8-48cc-8f6e-77e72b24eb52 req-f1583d20-bf2f-4be6-97d1-4f86bfabe8b4 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-unplugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-893f2ce5-dee8-48cc-8f6e-77e72b24eb52 req-f1583d20-bf2f-4be6-97d1-4f86bfabe8b4 service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-893f2ce5-dee8-48cc-8f6e-77e72b24eb52 req-f1583d20-bf2f-4be6-97d1-4f86bfabe8b4 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-893f2ce5-dee8-48cc-8f6e-77e72b24eb52 req-f1583d20-bf2f-4be6-97d1-4f86bfabe8b4 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-893f2ce5-dee8-48cc-8f6e-77e72b24eb52 req-f1583d20-bf2f-4be6-97d1-4f86bfabe8b4 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-unplugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG nova.compute.manager [req-893f2ce5-dee8-48cc-8f6e-77e72b24eb52 req-f1583d20-bf2f-4be6-97d1-4f86bfabe8b4 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-unplugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 13:01:02 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Instance destroyed successfully.
Nov 30 13:01:02 user nova-compute[75672]: DEBUG nova.objects.instance [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'resources' on Instance uuid 47ac940e-edbd-4732-ac04-e242709ee894 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1500274755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1500274755',id=34,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:47:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47874c48ecea456eac7968640910afba',ramdisk_id='',reservation_id='r-mu7ztrq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-547265583',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:49:02Z,user_data=None,user_id='aa5b3c989c934220a07aba162e68ea87',uuid=47ac940e-edbd-4732-ac04-e242709ee894,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converting VIF {"id": "e153586a-8cf1-4e2d-838d-a0eadd151858", "address": "fa:16:3e:76:3f:ff", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape153586a-8c", "ovs_interfaceid": "e153586a-8cf1-4e2d-838d-a0eadd151858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:3f:ff,bridge_name='br-int',has_traffic_filtering=True,id=e153586a-8cf1-4e2d-838d-a0eadd151858,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153586a-8c') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_vif [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:3f:ff,bridge_name='br-int',has_traffic_filtering=True,id=e153586a-8cf1-4e2d-838d-a0eadd151858,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153586a-8c') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape153586a-8c, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=993ed47e-4a68-417d-b7a9-b543756c20d2) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:01:02 user nova-compute[75672]: INFO os_vif [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:3f:ff,bridge_name='br-int',has_traffic_filtering=True,id=e153586a-8cf1-4e2d-838d-a0eadd151858,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape153586a-8c')
Nov 30 13:01:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdhfyGUb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:01:02 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8b4aa8-a649-4486-b014-5d66bee40d92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 13:01:02 user nova-compute[75672]: No targets found.
Nov 30 13:01:02 user nova-compute[75672]: iSNS:
Nov 30 13:01:02 user nova-compute[75672]: No targets found.
Nov 30 13:01:02 user nova-compute[75672]: STATIC:
Nov 30 13:01:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74
Nov 30 13:01:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 13:01:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 13:01:02 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38
Nov 30 13:01:02 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 13:01:02 user nova-compute[75672]:                 Iface Name: default
Nov 30 13:01:02 user nova-compute[75672]: FIRMWARE:
Nov 30 13:01:02 user nova-compute[75672]: No targets found.
Nov 30 13:01:02 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 13:01:02 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 13:01:02 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b06228a-b09e-48d1-843f-b6cd7b632b5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd55a01-63de-4129-8d17-aa9ed2cf2d4f]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 13:01:02 user nova-compute[75672]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 13:01:02 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 (non-flash)
Nov 30 13:01:02 user nova-compute[75672]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 13:01:02 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcf458f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38'): ({'sdd'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Removing single pathed devices sdd {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[21952a00-3e20-4bfe-a9b0-e87b47be5c47]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9eeb96-9a0c-4f1e-992e-c88a1844d380]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Flushing IO for device /dev/sdd {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b48919-fd70-454c-8828-6e3e5c027ba6]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[db68e198-11f2-4649-af37-aa247e08e47b]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] SCSI volumes sdd have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf95ec1-6292-4fe2-b5af-9bc5acbfb816]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dda5e1-fb70-4c0c-b50d-e8977098b5c5]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38, portal: 172.16.0.220,3260]
Nov 30 13:01:02 user nova-compute[75672]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38, portal: 172.16.0.220,3260] successful.
Nov 30 13:01:02 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fdbfd07-f8d4-4bf9-8102-232b67482e38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cc97db-bf58-410b-b4c2-00e95b730ae9]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] <== disconnect_volume: return (284ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 13:01:02 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Deleting instance files /opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894_del
Nov 30 13:01:02 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Deletion of /opt/stack/data/nova/instances/47ac940e-edbd-4732-ac04-e242709ee894_del complete
Nov 30 13:01:02 user nova-compute[75672]: INFO nova.compute.manager [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 30 13:01:02 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 13:01:02 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 13:01:03 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:01:03 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Took 0.42 seconds to deallocate network for instance.
Nov 30 13:01:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-10b029d7-e9cd-424d-a94b-a79667c8c7e8 req-ee4cefcd-91c2-42bb-8007-936dfda1b644 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:01:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-10b029d7-e9cd-424d-a94b-a79667c8c7e8 req-ee4cefcd-91c2-42bb-8007-936dfda1b644 service nova] Acquiring lock "47ac940e-edbd-4732-ac04-e242709ee894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-10b029d7-e9cd-424d-a94b-a79667c8c7e8 req-ee4cefcd-91c2-42bb-8007-936dfda1b644 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-10b029d7-e9cd-424d-a94b-a79667c8c7e8 req-ee4cefcd-91c2-42bb-8007-936dfda1b644 service nova] Lock "47ac940e-edbd-4732-ac04-e242709ee894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-10b029d7-e9cd-424d-a94b-a79667c8c7e8 req-ee4cefcd-91c2-42bb-8007-936dfda1b644 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] No waiting events found dispatching network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:01:04 user nova-compute[75672]: WARNING nova.compute.manager [req-10b029d7-e9cd-424d-a94b-a79667c8c7e8 req-ee4cefcd-91c2-42bb-8007-936dfda1b644 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received unexpected event network-vif-plugged-e153586a-8cf1-4e2d-838d-a0eadd151858 for instance with vm_state active and task_state deleting.
Nov 30 13:01:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-10b029d7-e9cd-424d-a94b-a79667c8c7e8 req-ee4cefcd-91c2-42bb-8007-936dfda1b644 service nova] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Received event network-vif-deleted-e153586a-8cf1-4e2d-838d-a0eadd151858 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:01:04 user nova-compute[75672]: INFO nova.compute.manager [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 47ac940e-edbd-4732-ac04-e242709ee894] Took 0.84 seconds to detach 1 volumes for instance.
Nov 30 13:01:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:04 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:01:04 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:01:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:04 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Deleted allocations for instance 47ac940e-edbd-4732-ac04-e242709ee894
Nov 30 13:01:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-f49c2835-7d8a-4aeb-8e0d-5998747bfeb2 tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "47ac940e-edbd-4732-ac04-e242709ee894" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.784s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:07 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:01:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:08 user nova-compute[75672]: DEBUG nova.compute.manager [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 13:01:09 user nova-compute[75672]: INFO nova.compute.claims [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Claim successful on node user
Nov 30 13:01:09 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG nova.network.neutron [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 13:01:09 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 13:01:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG nova.policy [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e87ad9fef5444b4b0124b0bd71f8324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e674749412c04ea3a757ac31928844c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 13:01:09 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Creating image(s)
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "/opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "/opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.170s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk 1073741824" returned: 0 in 0.048s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.network.neutron [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Successfully created port: 49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.187s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Cannot resize image /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Ensure instance console log exists: /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.network.neutron [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Successfully updated port: 49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquired lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.network.neutron [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.compute.manager [req-8870fee3-2779-401d-a3bf-61bba03b2d67 req-ea801a12-06c7-479d-8180-5382f25d876d service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received event network-changed-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.compute.manager [req-8870fee3-2779-401d-a3bf-61bba03b2d67 req-ea801a12-06c7-479d-8180-5382f25d876d service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Refreshing instance network info cache due to event network-changed-49a0440d-cdee-4e65-9638-7b8fdf66b3e6. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8870fee3-2779-401d-a3bf-61bba03b2d67 req-ea801a12-06c7-479d-8180-5382f25d876d service nova] Acquiring lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.network.neutron [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.network.neutron [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updating instance_info_cache with network_info: [{"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Releasing lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.compute.manager [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Instance network_info: |[{"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8870fee3-2779-401d-a3bf-61bba03b2d67 req-ea801a12-06c7-479d-8180-5382f25d876d service nova] Acquired lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.network.neutron [req-8870fee3-2779-401d-a3bf-61bba03b2d67 req-ea801a12-06c7-479d-8180-5382f25d876d service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Refreshing network info cache for port 49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Start _get_guest_xml network_info=[{"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 13:01:10 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:01:10 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 13:01:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T13:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-825219135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-825219135',id=50,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzuaBHtkLg+kLm78Koex9bHLaO7Vmx/w0PbyH3cLRi+RfRqlA6vBi+Icnv9MIwdUfvsQrwkhSxTB0J0nFQqKTYuQtXh4Sc1SI+JArqjcaegnCZC9s3eIz6HC+63jtqspA==',key_name='tempest-keypair-1654696523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e674749412c04ea3a757ac31928844c6',ramdisk_id='',reservation_id='r-bo63jblh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792375540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792375540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T13:01:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e87ad9fef5444b4b0124b0bd71f8324',uuid=f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converting VIF {"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=49a0440d-cdee-4e65-9638-7b8fdf66b3e6,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a0440d-cd') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.objects.instance [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'pci_devices' on Instance uuid f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] End _get_guest_xml xml=<domain type="kvm">
Nov 30 13:01:11 user nova-compute[75672]:   <uuid>f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8</uuid>
Nov 30 13:01:11 user nova-compute[75672]:   <name>instance-00000032</name>
Nov 30 13:01:11 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 13:01:11 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 13:01:11 user nova-compute[75672]:   <metadata>
Nov 30 13:01:11 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 13:01:11 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 13:01:11 user nova-compute[75672]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-825219135</nova:name>
Nov 30 13:01:11 user nova-compute[75672]:       <nova:creationTime>2023-11-30 13:01:10</nova:creationTime>
Nov 30 13:01:11 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 13:01:11 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 13:01:11 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 13:01:11 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 13:01:11 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 13:01:11 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 13:01:11 user nova-compute[75672]:       </nova:flavor>
Nov 30 13:01:11 user nova-compute[75672]:       <nova:owner>
Nov 30 13:01:11 user nova-compute[75672]:         <nova:user uuid="2e87ad9fef5444b4b0124b0bd71f8324">tempest-AttachVolumeShelveTestJSON-1792375540-project-member</nova:user>
Nov 30 13:01:11 user nova-compute[75672]:         <nova:project uuid="e674749412c04ea3a757ac31928844c6">tempest-AttachVolumeShelveTestJSON-1792375540</nova:project>
Nov 30 13:01:11 user nova-compute[75672]:       </nova:owner>
Nov 30 13:01:11 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 13:01:11 user nova-compute[75672]:       <nova:ports>
Nov 30 13:01:11 user nova-compute[75672]:         <nova:port uuid="49a0440d-cdee-4e65-9638-7b8fdf66b3e6">
Nov 30 13:01:11 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 13:01:11 user nova-compute[75672]:         </nova:port>
Nov 30 13:01:11 user nova-compute[75672]:       </nova:ports>
Nov 30 13:01:11 user nova-compute[75672]:     </nova:instance>
Nov 30 13:01:11 user nova-compute[75672]:   </metadata>
Nov 30 13:01:11 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 13:01:11 user nova-compute[75672]:     <system>
Nov 30 13:01:11 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 13:01:11 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 13:01:11 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 13:01:11 user nova-compute[75672]:       <entry name="serial">f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8</entry>
Nov 30 13:01:11 user nova-compute[75672]:       <entry name="uuid">f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8</entry>
Nov 30 13:01:11 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 13:01:11 user nova-compute[75672]:     </system>
Nov 30 13:01:11 user nova-compute[75672]:   </sysinfo>
Nov 30 13:01:11 user nova-compute[75672]:   <os>
Nov 30 13:01:11 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 13:01:11 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 13:01:11 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 13:01:11 user nova-compute[75672]:   </os>
Nov 30 13:01:11 user nova-compute[75672]:   <features>
Nov 30 13:01:11 user nova-compute[75672]:     <acpi/>
Nov 30 13:01:11 user nova-compute[75672]:     <apic/>
Nov 30 13:01:11 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 13:01:11 user nova-compute[75672]:   </features>
Nov 30 13:01:11 user nova-compute[75672]:   <clock offset="utc">
Nov 30 13:01:11 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 13:01:11 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 13:01:11 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 13:01:11 user nova-compute[75672]:   </clock>
Nov 30 13:01:11 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 13:01:11 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 13:01:11 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 13:01:11 user nova-compute[75672]:   </cpu>
Nov 30 13:01:11 user nova-compute[75672]:   <devices>
Nov 30 13:01:11 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 13:01:11 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 13:01:11 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk"/>
Nov 30 13:01:11 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 13:01:11 user nova-compute[75672]:     </disk>
Nov 30 13:01:11 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 13:01:11 user nova-compute[75672]:       <mac address="fa:16:3e:36:4d:8d"/>
Nov 30 13:01:11 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 13:01:11 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 13:01:11 user nova-compute[75672]:       <target dev="tap49a0440d-cd"/>
Nov 30 13:01:11 user nova-compute[75672]:     </interface>
Nov 30 13:01:11 user nova-compute[75672]:     <serial type="pty">
Nov 30 13:01:11 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/console.log" append="off"/>
Nov 30 13:01:11 user nova-compute[75672]:     </serial>
Nov 30 13:01:11 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 13:01:11 user nova-compute[75672]:     <video>
Nov 30 13:01:11 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 13:01:11 user nova-compute[75672]:     </video>
Nov 30 13:01:11 user nova-compute[75672]:     <rng model="virtio">
Nov 30 13:01:11 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 13:01:11 user nova-compute[75672]:     </rng>
Nov 30 13:01:11 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 13:01:11 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 13:01:11 user nova-compute[75672]:       <stats period="10"/>
Nov 30 13:01:11 user nova-compute[75672]:     </memballoon>
Nov 30 13:01:11 user nova-compute[75672]:   </devices>
Nov 30 13:01:11 user nova-compute[75672]: </domain>
Nov 30 13:01:11 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T13:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-825219135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-825219135',id=50,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzuaBHtkLg+kLm78Koex9bHLaO7Vmx/w0PbyH3cLRi+RfRqlA6vBi+Icnv9MIwdUfvsQrwkhSxTB0J0nFQqKTYuQtXh4Sc1SI+JArqjcaegnCZC9s3eIz6HC+63jtqspA==',key_name='tempest-keypair-1654696523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e674749412c04ea3a757ac31928844c6',ramdisk_id='',reservation_id='r-bo63jblh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792375540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792375540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T13:01:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e87ad9fef5444b4b0124b0bd71f8324',uuid=f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converting VIF {"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=49a0440d-cdee-4e65-9638-7b8fdf66b3e6,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a0440d-cd') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG os_vif [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=49a0440d-cdee-4e65-9638-7b8fdf66b3e6,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a0440d-cd') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92e3d8a6-a7da-55bc-bf82-9e5401068bb0', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49a0440d-cd, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49a0440d-cd, col_values=(('qos', UUID('ef48a12d-379d-42c1-ab87-1759d0032c22')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49a0440d-cd, col_values=(('external_ids', {'iface-id': '49a0440d-cdee-4e65-9638-7b8fdf66b3e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:4d:8d', 'vm-uuid': 'f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:11 user nova-compute[75672]: INFO os_vif [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=49a0440d-cdee-4e65-9638-7b8fdf66b3e6,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a0440d-cd')
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] No VIF found with MAC fa:16:3e:36:4d:8d, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.network.neutron [req-8870fee3-2779-401d-a3bf-61bba03b2d67 req-ea801a12-06c7-479d-8180-5382f25d876d service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updated VIF entry in instance network info cache for port 49a0440d-cdee-4e65-9638-7b8fdf66b3e6. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG nova.network.neutron [req-8870fee3-2779-401d-a3bf-61bba03b2d67 req-ea801a12-06c7-479d-8180-5382f25d876d service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updating instance_info_cache with network_info: [{"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:01:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8870fee3-2779-401d-a3bf-61bba03b2d67 req-ea801a12-06c7-479d-8180-5382f25d876d service nova] Releasing lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:01:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:12 user nova-compute[75672]: DEBUG nova.compute.manager [req-89578b77-6f95-4966-9ca8-09ac2475bcec req-28044d82-0835-44d2-a87e-27eb922242bb service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received event network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:01:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-89578b77-6f95-4966-9ca8-09ac2475bcec req-28044d82-0835-44d2-a87e-27eb922242bb service nova] Acquiring lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-89578b77-6f95-4966-9ca8-09ac2475bcec req-28044d82-0835-44d2-a87e-27eb922242bb service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-89578b77-6f95-4966-9ca8-09ac2475bcec req-28044d82-0835-44d2-a87e-27eb922242bb service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:12 user nova-compute[75672]: DEBUG nova.compute.manager [req-89578b77-6f95-4966-9ca8-09ac2475bcec req-28044d82-0835-44d2-a87e-27eb922242bb service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] No waiting events found dispatching network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:01:12 user nova-compute[75672]: WARNING nova.compute.manager [req-89578b77-6f95-4966-9ca8-09ac2475bcec req-28044d82-0835-44d2-a87e-27eb922242bb service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received unexpected event network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 for instance with vm_state building and task_state spawning.
Nov 30 13:01:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 13:01:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 13:01:14 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Instance spawned successfully.
Nov 30 13:01:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 13:01:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:01:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:01:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:01:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:01:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:01:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:01:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-b101ec56-f263-41e9-bdee-c0cd5a5847bb req-ccbebe71-3d45-4d8a-b278-76a47d685fd1 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received event network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:01:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b101ec56-f263-41e9-bdee-c0cd5a5847bb req-ccbebe71-3d45-4d8a-b278-76a47d685fd1 service nova] Acquiring lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b101ec56-f263-41e9-bdee-c0cd5a5847bb req-ccbebe71-3d45-4d8a-b278-76a47d685fd1 service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b101ec56-f263-41e9-bdee-c0cd5a5847bb req-ccbebe71-3d45-4d8a-b278-76a47d685fd1 service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:14 user nova-compute[75672]: DEBUG nova.compute.manager [req-b101ec56-f263-41e9-bdee-c0cd5a5847bb req-ccbebe71-3d45-4d8a-b278-76a47d685fd1 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] No waiting events found dispatching network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:01:14 user nova-compute[75672]: WARNING nova.compute.manager [req-b101ec56-f263-41e9-bdee-c0cd5a5847bb req-ccbebe71-3d45-4d8a-b278-76a47d685fd1 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received unexpected event network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 for instance with vm_state building and task_state spawning.
Nov 30 13:01:14 user nova-compute[75672]: INFO nova.compute.manager [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 30 13:01:14 user nova-compute[75672]: DEBUG nova.compute.manager [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 13:01:14 user nova-compute[75672]: INFO nova.compute.manager [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Took 5.77 seconds to build instance.
Nov 30 13:01:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-63ff1c2f-6b7a-4aec-ab5b-702f82528135 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.869s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:34 user nova-compute[75672]: DEBUG nova.compute.manager [req-e52e812a-5cc1-46ce-bbf7-e40910e91cfa req-6a4e2ec9-5729-4497-b7ce-563e00a1d26f service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-changed-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:01:34 user nova-compute[75672]: DEBUG nova.compute.manager [req-e52e812a-5cc1-46ce-bbf7-e40910e91cfa req-6a4e2ec9-5729-4497-b7ce-563e00a1d26f service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Refreshing instance network info cache due to event network-changed-b432c044-6444-4219-a936-3a8e16d4d3d3. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 13:01:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e52e812a-5cc1-46ce-bbf7-e40910e91cfa req-6a4e2ec9-5729-4497-b7ce-563e00a1d26f service nova] Acquiring lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:01:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e52e812a-5cc1-46ce-bbf7-e40910e91cfa req-6a4e2ec9-5729-4497-b7ce-563e00a1d26f service nova] Acquired lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:01:34 user nova-compute[75672]: DEBUG nova.network.neutron [req-e52e812a-5cc1-46ce-bbf7-e40910e91cfa req-6a4e2ec9-5729-4497-b7ce-563e00a1d26f service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Refreshing network info cache for port b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 13:01:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "b5b3baae-893d-4909-9504-e0be595cbf67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "b5b3baae-893d-4909-9504-e0be595cbf67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:34 user nova-compute[75672]: INFO nova.compute.manager [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Terminating instance
Nov 30 13:01:34 user nova-compute[75672]: DEBUG nova.compute.manager [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 13:01:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:35 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Instance destroyed successfully.
Nov 30 13:01:35 user nova-compute[75672]: DEBUG nova.objects.instance [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lazy-loading 'resources' on Instance uuid b5b3baae-893d-4909-9504-e0be595cbf67 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T12:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1955223693',display_name='tempest-TestShelveInstance-server-1955223693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1955223693',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEE16S5Jmpim/WWgi8480VzQNUeAXmRd+XHFuLHXMCcHA7Pxg1LCXhY6yUn0tMy5XRjSOY7yqkaXhbqwT/ZSSAYZ8FRsFzPj9WlkRuUdvbMy/soRBDPLK4BUb5rsSVo3qw==',key_name='tempest-TestShelveInstance-264328173',keypairs=<?>,launch_index=0,launched_at=2023-11-30T13:00:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12dc381a3d4844cc84b470c640b397c7',ramdisk_id='',reservation_id='r-d2xwykph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-802679308',owner_user_name='tempest-TestShelveInstance-802679308-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T13:00:00Z,user_data=None,user_id='e62e4eb6ad444fc3bc0e069c9cc2f921',uuid=b5b3baae-893d-4909-9504-e0be595cbf67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Converting VIF {"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=b432c044-6444-4219-a936-3a8e16d4d3d3,network=Network(4b8e876a-ae88-4a30-bfbe-7fdf5585ea26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb432c044-64') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_vif [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=b432c044-6444-4219-a936-3a8e16d4d3d3,network=Network(4b8e876a-ae88-4a30-bfbe-7fdf5585ea26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb432c044-64') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb432c044-64, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2626dfa5-12da-46fd-9c9a-dc885f61423b) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:01:35 user nova-compute[75672]: INFO os_vif [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=b432c044-6444-4219-a936-3a8e16d4d3d3,network=Network(4b8e876a-ae88-4a30-bfbe-7fdf5585ea26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb432c044-64')
Nov 30 13:01:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiPlUDVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:01:35 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7537d083-251e-454f-a457-b3d6b125b216]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 13:01:35 user nova-compute[75672]: No targets found.
Nov 30 13:01:35 user nova-compute[75672]: iSNS:
Nov 30 13:01:35 user nova-compute[75672]: No targets found.
Nov 30 13:01:35 user nova-compute[75672]: STATIC:
Nov 30 13:01:35 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74
Nov 30 13:01:35 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 13:01:35 user nova-compute[75672]:                 Iface Name: default
Nov 30 13:01:35 user nova-compute[75672]: FIRMWARE:
Nov 30 13:01:35 user nova-compute[75672]: No targets found.
Nov 30 13:01:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 13:01:35 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 13:01:35 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f55bbd-27a3-4b5d-ba50-e57cdfd10c44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a522403c-7c75-4c89-9270-ba3bca089b12]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 13:01:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 (non-flash)
Nov 30 13:01:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd435c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG nova.network.neutron [req-e52e812a-5cc1-46ce-bbf7-e40910e91cfa req-6a4e2ec9-5729-4497-b7ce-563e00a1d26f service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updated VIF entry in instance network info cache for port b432c044-6444-4219-a936-3a8e16d4d3d3. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG nova.network.neutron [req-e52e812a-5cc1-46ce-bbf7-e40910e91cfa req-6a4e2ec9-5729-4497-b7ce-563e00a1d26f service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updating instance_info_cache with network_info: [{"id": "b432c044-6444-4219-a936-3a8e16d4d3d3", "address": "fa:16:3e:98:ec:8b", "network": {"id": "4b8e876a-ae88-4a30-bfbe-7fdf5585ea26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1343779213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12dc381a3d4844cc84b470c640b397c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb432c044-64", "ovs_interfaceid": "b432c044-6444-4219-a936-3a8e16d4d3d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b0f5ac-3744-4d5d-9942-b97fe1cd0801]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e52e812a-5cc1-46ce-bbf7-e40910e91cfa req-6a4e2ec9-5729-4497-b7ce-563e00a1d26f service nova] Releasing lock "refresh_cache-b5b3baae-893d-4909-9504-e0be595cbf67" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c4f41e-6e81-4410-8c05-5c32957522a9]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7528b1da-cb9d-41da-918f-59735e924b3b]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0222ec-2246-46c0-b7b3-e9e1f3a81a1b]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23165633461666566', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9fc4f9a5', '/dev/disk/by-id/scsi-1SCST_BIO9fc4f9a5-1ec4afef5949a48c') {{(pid=86963) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c64bc62-93ba-4919-a712-795bbf792b96]: (4, None) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2906ca-a808-4936-9f58-c73a2b9d41c1]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc892a91-b111-48d4-bbb3-e33a5962686e]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260]
Nov 30 13:01:35 user nova-compute[75672]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74, portal: 172.16.0.220,3260] successful.
Nov 30 13:01:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9701f3-890f-47d7-bfcf-3318810bbd74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6335822a-3285-43d3-aad5-42a00a46b426]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] <== disconnect_volume: return (309ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 13:01:35 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Deleting instance files /opt/stack/data/nova/instances/b5b3baae-893d-4909-9504-e0be595cbf67_del
Nov 30 13:01:35 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Deletion of /opt/stack/data/nova/instances/b5b3baae-893d-4909-9504-e0be595cbf67_del complete
Nov 30 13:01:35 user nova-compute[75672]: INFO nova.compute.manager [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 30 13:01:35 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 13:01:35 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 13:01:36 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:01:36 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Took 0.47 seconds to deallocate network for instance.
Nov 30 13:01:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-5e01d41c-ad07-4861-8621-5b9c51c72e69 req-0d00d56c-2544-4d0f-9e8c-219b1f18a17c service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-vif-deleted-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:01:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-b7967618-e31f-430c-9762-3665dfaad989 req-0979be08-5feb-4df6-a8a1-b49ed1a7fece service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-vif-unplugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:01:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b7967618-e31f-430c-9762-3665dfaad989 req-0979be08-5feb-4df6-a8a1-b49ed1a7fece service nova] Acquiring lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b7967618-e31f-430c-9762-3665dfaad989 req-0979be08-5feb-4df6-a8a1-b49ed1a7fece service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b7967618-e31f-430c-9762-3665dfaad989 req-0979be08-5feb-4df6-a8a1-b49ed1a7fece service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-b7967618-e31f-430c-9762-3665dfaad989 req-0979be08-5feb-4df6-a8a1-b49ed1a7fece service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] No waiting events found dispatching network-vif-unplugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:01:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-b7967618-e31f-430c-9762-3665dfaad989 req-0979be08-5feb-4df6-a8a1-b49ed1a7fece service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-vif-unplugged-b432c044-6444-4219-a936-3a8e16d4d3d3 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 13:01:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-b7967618-e31f-430c-9762-3665dfaad989 req-0979be08-5feb-4df6-a8a1-b49ed1a7fece service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received event network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:01:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b7967618-e31f-430c-9762-3665dfaad989 req-0979be08-5feb-4df6-a8a1-b49ed1a7fece service nova] Acquiring lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b7967618-e31f-430c-9762-3665dfaad989 req-0979be08-5feb-4df6-a8a1-b49ed1a7fece service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-b7967618-e31f-430c-9762-3665dfaad989 req-0979be08-5feb-4df6-a8a1-b49ed1a7fece service nova] Lock "b5b3baae-893d-4909-9504-e0be595cbf67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:36 user nova-compute[75672]: DEBUG nova.compute.manager [req-b7967618-e31f-430c-9762-3665dfaad989 req-0979be08-5feb-4df6-a8a1-b49ed1a7fece service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] No waiting events found dispatching network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:01:36 user nova-compute[75672]: WARNING nova.compute.manager [req-b7967618-e31f-430c-9762-3665dfaad989 req-0979be08-5feb-4df6-a8a1-b49ed1a7fece service nova] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Received unexpected event network-vif-plugged-b432c044-6444-4219-a936-3a8e16d4d3d3 for instance with vm_state active and task_state deleting.
Nov 30 13:01:36 user nova-compute[75672]: INFO nova.compute.manager [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Took 0.84 seconds to detach 1 volumes for instance.
Nov 30 13:01:36 user nova-compute[75672]: DEBUG nova.compute.manager [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] [instance: b5b3baae-893d-4909-9504-e0be595cbf67] Deleting volume: 1a9701f3-890f-47d7-bfcf-3318810bbd74 {{(pid=75672) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 13:01:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:37 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:01:37 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:01:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:37 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Deleted allocations for instance b5b3baae-893d-4909-9504-e0be595cbf67
Nov 30 13:01:37 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-655d3f3b-afa1-4dcc-a5ef-99ffd5387a71 tempest-TestShelveInstance-802679308 tempest-TestShelveInstance-802679308-project-member] Lock "b5b3baae-893d-4909-9504-e0be595cbf67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.867s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:50 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "50ef3313-795a-4797-9a3e-5e85f61d7631" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:52 user nova-compute[75672]: INFO nova.compute.manager [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Terminating instance
Nov 30 13:01:52 user nova-compute[75672]: DEBUG nova.compute.manager [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG nova.compute.manager [req-2b8b8748-2c37-4b59-bf54-60ba64a42ad3 req-5045c9bf-7761-4330-85d2-6ca676494e12 service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Received event network-vif-unplugged-5b67acff-0692-42c4-982c-b893d2cf4f0d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2b8b8748-2c37-4b59-bf54-60ba64a42ad3 req-5045c9bf-7761-4330-85d2-6ca676494e12 service nova] Acquiring lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2b8b8748-2c37-4b59-bf54-60ba64a42ad3 req-5045c9bf-7761-4330-85d2-6ca676494e12 service nova] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2b8b8748-2c37-4b59-bf54-60ba64a42ad3 req-5045c9bf-7761-4330-85d2-6ca676494e12 service nova] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG nova.compute.manager [req-2b8b8748-2c37-4b59-bf54-60ba64a42ad3 req-5045c9bf-7761-4330-85d2-6ca676494e12 service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] No waiting events found dispatching network-vif-unplugged-5b67acff-0692-42c4-982c-b893d2cf4f0d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:01:52 user nova-compute[75672]: DEBUG nova.compute.manager [req-2b8b8748-2c37-4b59-bf54-60ba64a42ad3 req-5045c9bf-7761-4330-85d2-6ca676494e12 service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Received event network-vif-unplugged-5b67acff-0692-42c4-982c-b893d2cf4f0d for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 13:01:53 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Instance destroyed successfully.
Nov 30 13:01:53 user nova-compute[75672]: DEBUG nova.objects.instance [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lazy-loading 'resources' on Instance uuid 50ef3313-795a-4797-9a3e-5e85f61d7631 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T12:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1057936103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1057936103',id=27,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T12:42:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47874c48ecea456eac7968640910afba',ramdisk_id='',reservation_id='r-65t0k5tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-547265583',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T12:44:12Z,user_data=None,user_id='aa5b3c989c934220a07aba162e68ea87',uuid=50ef3313-795a-4797-9a3e-5e85f61d7631,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "address": "fa:16:3e:ce:b3:ac", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b67acff-06", "ovs_interfaceid": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converting VIF {"id": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "address": "fa:16:3e:ce:b3:ac", "network": {"id": "eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1751017798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47874c48ecea456eac7968640910afba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b67acff-06", "ovs_interfaceid": "5b67acff-0692-42c4-982c-b893d2cf4f0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b3:ac,bridge_name='br-int',has_traffic_filtering=True,id=5b67acff-0692-42c4-982c-b893d2cf4f0d,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b67acff-06') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG os_vif [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b3:ac,bridge_name='br-int',has_traffic_filtering=True,id=5b67acff-0692-42c4-982c-b893d2cf4f0d,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b67acff-06') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b67acff-06, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2611929-4057-4028-aae5-15b3cad1aa96) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:53 user nova-compute[75672]: INFO os_vif [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b3:ac,bridge_name='br-int',has_traffic_filtering=True,id=5b67acff-0692-42c4-982c-b893d2cf4f0d,network=Network(eaa7d4ca-bf7b-445e-b5d0-ad26b4e5c3c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b67acff-06')
Nov 30 13:01:53 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Deleting instance files /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631_del
Nov 30 13:01:53 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Deletion of /opt/stack/data/nova/instances/50ef3313-795a-4797-9a3e-5e85f61d7631_del complete
Nov 30 13:01:53 user nova-compute[75672]: INFO nova.compute.manager [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 30 13:01:53 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-4315dcf4-9fca-422b-9915-991db93fd553 req-b6513a66-fde9-42e1-8582-c6a590637b81 service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Received event network-vif-deleted-5b67acff-0692-42c4-982c-b893d2cf4f0d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:01:53 user nova-compute[75672]: INFO nova.compute.manager [req-4315dcf4-9fca-422b-9915-991db93fd553 req-b6513a66-fde9-42e1-8582-c6a590637b81 service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Neutron deleted interface 5b67acff-0692-42c4-982c-b893d2cf4f0d; detaching it from the instance and deleting it from the info cache
Nov 30 13:01:53 user nova-compute[75672]: DEBUG nova.network.neutron [req-4315dcf4-9fca-422b-9915-991db93fd553 req-b6513a66-fde9-42e1-8582-c6a590637b81 service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:01:53 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Took 0.40 seconds to deallocate network for instance.
Nov 30 13:01:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-4315dcf4-9fca-422b-9915-991db93fd553 req-b6513a66-fde9-42e1-8582-c6a590637b81 service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Detach interface failed, port_id=5b67acff-0692-42c4-982c-b893d2cf4f0d, reason: Instance 50ef3313-795a-4797-9a3e-5e85f61d7631 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:01:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:53 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Deleted allocations for instance 50ef3313-795a-4797-9a3e-5e85f61d7631
Nov 30 13:01:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-6b1bc5f9-a58f-4fcc-806a-aed36021da2b tempest-ServerBootFromVolumeStableRescueTest-547265583 tempest-ServerBootFromVolumeStableRescueTest-547265583-project-member] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.584s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-15ff5de0-030b-4911-8fb8-08920baa0216 req-187e48ae-6ae5-4a8f-9c1a-e2a25d840b86 service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Received event network-vif-plugged-5b67acff-0692-42c4-982c-b893d2cf4f0d {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:01:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15ff5de0-030b-4911-8fb8-08920baa0216 req-187e48ae-6ae5-4a8f-9c1a-e2a25d840b86 service nova] Acquiring lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15ff5de0-030b-4911-8fb8-08920baa0216 req-187e48ae-6ae5-4a8f-9c1a-e2a25d840b86 service nova] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:54 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-15ff5de0-030b-4911-8fb8-08920baa0216 req-187e48ae-6ae5-4a8f-9c1a-e2a25d840b86 service nova] Lock "50ef3313-795a-4797-9a3e-5e85f61d7631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:54 user nova-compute[75672]: DEBUG nova.compute.manager [req-15ff5de0-030b-4911-8fb8-08920baa0216 req-187e48ae-6ae5-4a8f-9c1a-e2a25d840b86 service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] No waiting events found dispatching network-vif-plugged-5b67acff-0692-42c4-982c-b893d2cf4f0d {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:01:54 user nova-compute[75672]: WARNING nova.compute.manager [req-15ff5de0-030b-4911-8fb8-08920baa0216 req-187e48ae-6ae5-4a8f-9c1a-e2a25d840b86 service nova] [instance: 50ef3313-795a-4797-9a3e-5e85f61d7631] Received unexpected event network-vif-plugged-5b67acff-0692-42c4-982c-b893d2cf4f0d for instance with vm_state deleted and task_state None.
Nov 30 13:01:55 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:01:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 13:01:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 13:01:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:01:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:01:55 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 13:01:55 user nova-compute[75672]: DEBUG nova.objects.instance [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lazy-loading 'info_cache' on Instance uuid f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:01:55 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updating instance_info_cache with network_info: [{"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:01:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:01:56 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 13:01:57 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:01:57 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:01:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:57 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 13:01:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:01:57 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:01:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:01:58 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:01:58 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:01:58 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=8853MB free_disk=25.051761627197266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 13:01:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:01:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:01:58 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:01:58 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 13:01:58 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 13:01:58 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:01:58 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:01:58 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 13:01:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:01:59 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:01:59 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:02:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:02:04 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:02:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 13:02:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:02:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:02:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:02:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:02:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:08 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:02:11 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:02:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:02:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:02:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:02:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:02:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:02:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:02:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:46 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:02:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:02:49 user nova-compute[75672]: DEBUG nova.compute.manager [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 13:02:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:02:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:02:49 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 13:02:49 user nova-compute[75672]: INFO nova.compute.claims [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Claim successful on node user
Nov 30 13:02:50 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG nova.network.neutron [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 13:02:50 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 13:02:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG nova.policy [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '552695c85f8841369d7d48d301d37ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8848c2cf5c324953b247f90252190094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG nova.compute.manager [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 13:02:50 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Creating image(s)
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "/opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "/opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "/opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.174s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk 1073741824" returned: 0 in 0.047s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.171s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 13:02:50 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Cannot resize image /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Ensure instance console log exists: /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG nova.network.neutron [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Successfully created port: 83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG nova.network.neutron [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Successfully updated port: 83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquired lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG nova.network.neutron [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-d89544db-252b-4029-9523-df8782e7a5b4 req-49e4cec2-617b-412e-9d7d-ab8ae64d3a2f service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Received event network-changed-83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG nova.compute.manager [req-d89544db-252b-4029-9523-df8782e7a5b4 req-49e4cec2-617b-412e-9d7d-ab8ae64d3a2f service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Refreshing instance network info cache due to event network-changed-83060a1e-3151-4aad-98dd-a281c8285d51. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d89544db-252b-4029-9523-df8782e7a5b4 req-49e4cec2-617b-412e-9d7d-ab8ae64d3a2f service nova] Acquiring lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG nova.network.neutron [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 13:02:51 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.network.neutron [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updating instance_info_cache with network_info: [{"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Releasing lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.compute.manager [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Instance network_info: |[{"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d89544db-252b-4029-9523-df8782e7a5b4 req-49e4cec2-617b-412e-9d7d-ab8ae64d3a2f service nova] Acquired lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.network.neutron [req-d89544db-252b-4029-9523-df8782e7a5b4 req-49e4cec2-617b-412e-9d7d-ab8ae64d3a2f service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Refreshing network info cache for port 83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Start _get_guest_xml network_info=[{"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 13:02:52 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:02:52 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T13:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-403696218',display_name='tempest-SnapshotDataIntegrityTests-server-403696218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-403696218',id=51,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXQ84jBH1CMJb3TcKkE/CRpNkFX73b09sQKxmcVXKiQ2YD5ZKk7IPpgZGuCCpaKBH4jSMCij1jWnpNmPcBN2ZENONDGj86y936t1AFm+MMo04c7Qrwv5UdOst0GHqvXJg==',key_name='tempest-keypair-398724710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8848c2cf5c324953b247f90252190094',ramdisk_id='',reservation_id='r-gvdm1sie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1102475418',owner_user_name='tempest-SnapshotDataIntegrityTests-1102475418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T13:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='552695c85f8841369d7d48d301d37ef6',uuid=a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Converting VIF {"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:4b:94,bridge_name='br-int',has_traffic_filtering=True,id=83060a1e-3151-4aad-98dd-a281c8285d51,network=Network(04d16965-23d6-4bbd-9d4a-22a476272fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83060a1e-31') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.objects.instance [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lazy-loading 'pci_devices' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] End _get_guest_xml xml=<domain type="kvm">
Nov 30 13:02:52 user nova-compute[75672]:   <uuid>a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f</uuid>
Nov 30 13:02:52 user nova-compute[75672]:   <name>instance-00000033</name>
Nov 30 13:02:52 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 13:02:52 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 13:02:52 user nova-compute[75672]:   <metadata>
Nov 30 13:02:52 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 13:02:52 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 13:02:52 user nova-compute[75672]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-403696218</nova:name>
Nov 30 13:02:52 user nova-compute[75672]:       <nova:creationTime>2023-11-30 13:02:52</nova:creationTime>
Nov 30 13:02:52 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 13:02:52 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 13:02:52 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 13:02:52 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 13:02:52 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 13:02:52 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 13:02:52 user nova-compute[75672]:       </nova:flavor>
Nov 30 13:02:52 user nova-compute[75672]:       <nova:owner>
Nov 30 13:02:52 user nova-compute[75672]:         <nova:user uuid="552695c85f8841369d7d48d301d37ef6">tempest-SnapshotDataIntegrityTests-1102475418-project-member</nova:user>
Nov 30 13:02:52 user nova-compute[75672]:         <nova:project uuid="8848c2cf5c324953b247f90252190094">tempest-SnapshotDataIntegrityTests-1102475418</nova:project>
Nov 30 13:02:52 user nova-compute[75672]:       </nova:owner>
Nov 30 13:02:52 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 13:02:52 user nova-compute[75672]:       <nova:ports>
Nov 30 13:02:52 user nova-compute[75672]:         <nova:port uuid="83060a1e-3151-4aad-98dd-a281c8285d51">
Nov 30 13:02:52 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 13:02:52 user nova-compute[75672]:         </nova:port>
Nov 30 13:02:52 user nova-compute[75672]:       </nova:ports>
Nov 30 13:02:52 user nova-compute[75672]:     </nova:instance>
Nov 30 13:02:52 user nova-compute[75672]:   </metadata>
Nov 30 13:02:52 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 13:02:52 user nova-compute[75672]:     <system>
Nov 30 13:02:52 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 13:02:52 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 13:02:52 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 13:02:52 user nova-compute[75672]:       <entry name="serial">a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f</entry>
Nov 30 13:02:52 user nova-compute[75672]:       <entry name="uuid">a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f</entry>
Nov 30 13:02:52 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 13:02:52 user nova-compute[75672]:     </system>
Nov 30 13:02:52 user nova-compute[75672]:   </sysinfo>
Nov 30 13:02:52 user nova-compute[75672]:   <os>
Nov 30 13:02:52 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 13:02:52 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 13:02:52 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 13:02:52 user nova-compute[75672]:   </os>
Nov 30 13:02:52 user nova-compute[75672]:   <features>
Nov 30 13:02:52 user nova-compute[75672]:     <acpi/>
Nov 30 13:02:52 user nova-compute[75672]:     <apic/>
Nov 30 13:02:52 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 13:02:52 user nova-compute[75672]:   </features>
Nov 30 13:02:52 user nova-compute[75672]:   <clock offset="utc">
Nov 30 13:02:52 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 13:02:52 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 13:02:52 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 13:02:52 user nova-compute[75672]:   </clock>
Nov 30 13:02:52 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 13:02:52 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 13:02:52 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 13:02:52 user nova-compute[75672]:   </cpu>
Nov 30 13:02:52 user nova-compute[75672]:   <devices>
Nov 30 13:02:52 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 13:02:52 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 13:02:52 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk"/>
Nov 30 13:02:52 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 13:02:52 user nova-compute[75672]:     </disk>
Nov 30 13:02:52 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 13:02:52 user nova-compute[75672]:       <mac address="fa:16:3e:65:4b:94"/>
Nov 30 13:02:52 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 13:02:52 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 13:02:52 user nova-compute[75672]:       <target dev="tap83060a1e-31"/>
Nov 30 13:02:52 user nova-compute[75672]:     </interface>
Nov 30 13:02:52 user nova-compute[75672]:     <serial type="pty">
Nov 30 13:02:52 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/console.log" append="off"/>
Nov 30 13:02:52 user nova-compute[75672]:     </serial>
Nov 30 13:02:52 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 13:02:52 user nova-compute[75672]:     <video>
Nov 30 13:02:52 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 13:02:52 user nova-compute[75672]:     </video>
Nov 30 13:02:52 user nova-compute[75672]:     <rng model="virtio">
Nov 30 13:02:52 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 13:02:52 user nova-compute[75672]:     </rng>
Nov 30 13:02:52 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 13:02:52 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 13:02:52 user nova-compute[75672]:       <stats period="10"/>
Nov 30 13:02:52 user nova-compute[75672]:     </memballoon>
Nov 30 13:02:52 user nova-compute[75672]:   </devices>
Nov 30 13:02:52 user nova-compute[75672]: </domain>
Nov 30 13:02:52 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T13:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-403696218',display_name='tempest-SnapshotDataIntegrityTests-server-403696218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-403696218',id=51,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXQ84jBH1CMJb3TcKkE/CRpNkFX73b09sQKxmcVXKiQ2YD5ZKk7IPpgZGuCCpaKBH4jSMCij1jWnpNmPcBN2ZENONDGj86y936t1AFm+MMo04c7Qrwv5UdOst0GHqvXJg==',key_name='tempest-keypair-398724710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8848c2cf5c324953b247f90252190094',ramdisk_id='',reservation_id='r-gvdm1sie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1102475418',owner_user_name='tempest-SnapshotDataIntegrityTests-1102475418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T13:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='552695c85f8841369d7d48d301d37ef6',uuid=a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Converting VIF {"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:4b:94,bridge_name='br-int',has_traffic_filtering=True,id=83060a1e-3151-4aad-98dd-a281c8285d51,network=Network(04d16965-23d6-4bbd-9d4a-22a476272fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83060a1e-31') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG os_vif [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:4b:94,bridge_name='br-int',has_traffic_filtering=True,id=83060a1e-3151-4aad-98dd-a281c8285d51,network=Network(04d16965-23d6-4bbd-9d4a-22a476272fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83060a1e-31') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b98680bf-1ba7-586c-a2f8-080c066977f9', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83060a1e-31, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83060a1e-31, col_values=(('qos', UUID('9c8f0c86-a709-48d1-b82c-1fa416c06c57')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83060a1e-31, col_values=(('external_ids', {'iface-id': '83060a1e-3151-4aad-98dd-a281c8285d51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:4b:94', 'vm-uuid': 'a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:52 user nova-compute[75672]: INFO os_vif [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:4b:94,bridge_name='br-int',has_traffic_filtering=True,id=83060a1e-3151-4aad-98dd-a281c8285d51,network=Network(04d16965-23d6-4bbd-9d4a-22a476272fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83060a1e-31')
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] No VIF found with MAC fa:16:3e:65:4b:94, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.network.neutron [req-d89544db-252b-4029-9523-df8782e7a5b4 req-49e4cec2-617b-412e-9d7d-ab8ae64d3a2f service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updated VIF entry in instance network info cache for port 83060a1e-3151-4aad-98dd-a281c8285d51. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG nova.network.neutron [req-d89544db-252b-4029-9523-df8782e7a5b4 req-49e4cec2-617b-412e-9d7d-ab8ae64d3a2f service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updating instance_info_cache with network_info: [{"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-d89544db-252b-4029-9523-df8782e7a5b4 req-49e4cec2-617b-412e-9d7d-ab8ae64d3a2f service nova] Releasing lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:02:52 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:02:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-0168ba10-f238-4fdc-bbdc-76210fe043b8 req-82eb0f2a-5ec1-4a92-946d-cc1ef5334a6c service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Received event network-vif-plugged-83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:02:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0168ba10-f238-4fdc-bbdc-76210fe043b8 req-82eb0f2a-5ec1-4a92-946d-cc1ef5334a6c service nova] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:02:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0168ba10-f238-4fdc-bbdc-76210fe043b8 req-82eb0f2a-5ec1-4a92-946d-cc1ef5334a6c service nova] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:02:53 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0168ba10-f238-4fdc-bbdc-76210fe043b8 req-82eb0f2a-5ec1-4a92-946d-cc1ef5334a6c service nova] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:02:53 user nova-compute[75672]: DEBUG nova.compute.manager [req-0168ba10-f238-4fdc-bbdc-76210fe043b8 req-82eb0f2a-5ec1-4a92-946d-cc1ef5334a6c service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] No waiting events found dispatching network-vif-plugged-83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:02:53 user nova-compute[75672]: WARNING nova.compute.manager [req-0168ba10-f238-4fdc-bbdc-76210fe043b8 req-82eb0f2a-5ec1-4a92-946d-cc1ef5334a6c service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Received unexpected event network-vif-plugged-83060a1e-3151-4aad-98dd-a281c8285d51 for instance with vm_state building and task_state spawning.
Nov 30 13:02:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:54 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Skipping network cache update for instance because it is Building. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.objects.instance [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lazy-loading 'info_cache' on Instance uuid f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 13:02:55 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Instance spawned successfully.
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:02:55 user nova-compute[75672]: INFO nova.compute.manager [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.compute.manager [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 13:02:55 user nova-compute[75672]: INFO nova.compute.manager [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Took 5.98 seconds to build instance.
Nov 30 13:02:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-35df92eb-320e-43c0-ac75-4e57bc35b5d0 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.083s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-2a075097-f63c-4f64-922c-5f24b0fecbaf req-5212ceed-b882-4e68-adca-c17c28c1c674 service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Received event network-vif-plugged-83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2a075097-f63c-4f64-922c-5f24b0fecbaf req-5212ceed-b882-4e68-adca-c17c28c1c674 service nova] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2a075097-f63c-4f64-922c-5f24b0fecbaf req-5212ceed-b882-4e68-adca-c17c28c1c674 service nova] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2a075097-f63c-4f64-922c-5f24b0fecbaf req-5212ceed-b882-4e68-adca-c17c28c1c674 service nova] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:02:55 user nova-compute[75672]: DEBUG nova.compute.manager [req-2a075097-f63c-4f64-922c-5f24b0fecbaf req-5212ceed-b882-4e68-adca-c17c28c1c674 service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] No waiting events found dispatching network-vif-plugged-83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:02:55 user nova-compute[75672]: WARNING nova.compute.manager [req-2a075097-f63c-4f64-922c-5f24b0fecbaf req-5212ceed-b882-4e68-adca-c17c28c1c674 service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Received unexpected event network-vif-plugged-83060a1e-3151-4aad-98dd-a281c8285d51 for instance with vm_state active and task_state None.
Nov 30 13:02:56 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updating instance_info_cache with network_info: [{"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:02:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:02:56 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 13:02:56 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:02:58 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:02:59 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:02:59 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:02:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:02:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:02:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:02:59 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 13:02:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:02:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:02:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:03:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:03:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:03:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:03:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:03:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-cfea15fd-ab06-46f9-8888-282861fc7789 req-0f9ca105-6692-49c3-b5ea-46dccc92146b service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received event network-changed-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:03:00 user nova-compute[75672]: DEBUG nova.compute.manager [req-cfea15fd-ab06-46f9-8888-282861fc7789 req-0f9ca105-6692-49c3-b5ea-46dccc92146b service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Refreshing instance network info cache due to event network-changed-49a0440d-cdee-4e65-9638-7b8fdf66b3e6. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 13:03:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cfea15fd-ab06-46f9-8888-282861fc7789 req-0f9ca105-6692-49c3-b5ea-46dccc92146b service nova] Acquiring lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:03:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cfea15fd-ab06-46f9-8888-282861fc7789 req-0f9ca105-6692-49c3-b5ea-46dccc92146b service nova] Acquired lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:03:00 user nova-compute[75672]: DEBUG nova.network.neutron [req-cfea15fd-ab06-46f9-8888-282861fc7789 req-0f9ca105-6692-49c3-b5ea-46dccc92146b service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Refreshing network info cache for port 49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 13:03:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:03:00 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:03:00 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:03:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.040298461914062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 13:03:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:03:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG nova.network.neutron [req-cfea15fd-ab06-46f9-8888-282861fc7789 req-0f9ca105-6692-49c3-b5ea-46dccc92146b service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updated VIF entry in instance network info cache for port 49a0440d-cdee-4e65-9638-7b8fdf66b3e6. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG nova.network.neutron [req-cfea15fd-ab06-46f9-8888-282861fc7789 req-0f9ca105-6692-49c3-b5ea-46dccc92146b service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updating instance_info_cache with network_info: [{"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing inventories for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-cfea15fd-ab06-46f9-8888-282861fc7789 req-0f9ca105-6692-49c3-b5ea-46dccc92146b service nova] Releasing lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating ProviderTree inventory for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating inventory in ProviderTree for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing aggregate associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, aggregates: None {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing trait associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:03:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:02 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:03:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:03:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:03:04 user nova-compute[75672]: INFO nova.compute.manager [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Shelving
Nov 30 13:03:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-5d23cbf4-d5d4-4a7e-8c62-7ffe233d7903 req-4f4f25ab-5d00-4bd6-ae9b-76165c089ba9 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received event network-vif-unplugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:03:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5d23cbf4-d5d4-4a7e-8c62-7ffe233d7903 req-4f4f25ab-5d00-4bd6-ae9b-76165c089ba9 service nova] Acquiring lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:03:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5d23cbf4-d5d4-4a7e-8c62-7ffe233d7903 req-4f4f25ab-5d00-4bd6-ae9b-76165c089ba9 service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:03:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5d23cbf4-d5d4-4a7e-8c62-7ffe233d7903 req-4f4f25ab-5d00-4bd6-ae9b-76165c089ba9 service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:03:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-5d23cbf4-d5d4-4a7e-8c62-7ffe233d7903 req-4f4f25ab-5d00-4bd6-ae9b-76165c089ba9 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] No waiting events found dispatching network-vif-unplugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:03:04 user nova-compute[75672]: WARNING nova.compute.manager [req-5d23cbf4-d5d4-4a7e-8c62-7ffe233d7903 req-4f4f25ab-5d00-4bd6-ae9b-76165c089ba9 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received unexpected event network-vif-unplugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 for instance with vm_state active and task_state shelving.
Nov 30 13:03:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Instance destroyed successfully.
Nov 30 13:03:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Beginning cold snapshot process
Nov 30 13:03:05 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 13:03:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk /opt/stack/data/nova/instances/snapshots/tmpvii5q9v6/cc68fbbb850249718ab46a2c9faf16d5 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:03:05 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:03:05 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 13:03:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk /opt/stack/data/nova/instances/snapshots/tmpvii5q9v6/cc68fbbb850249718ab46a2c9faf16d5" returned: 0 in 0.559s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:03:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Snapshot extracted, beginning image upload
Nov 30 13:03:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-c72b0fd8-9d24-42dc-a75a-c22785b7cc29 req-e8df4c3a-40ac-45ea-8713-0a4a017b8c5f service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received event network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:03:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c72b0fd8-9d24-42dc-a75a-c22785b7cc29 req-e8df4c3a-40ac-45ea-8713-0a4a017b8c5f service nova] Acquiring lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:03:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c72b0fd8-9d24-42dc-a75a-c22785b7cc29 req-e8df4c3a-40ac-45ea-8713-0a4a017b8c5f service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:03:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-c72b0fd8-9d24-42dc-a75a-c22785b7cc29 req-e8df4c3a-40ac-45ea-8713-0a4a017b8c5f service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:03:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-c72b0fd8-9d24-42dc-a75a-c22785b7cc29 req-e8df4c3a-40ac-45ea-8713-0a4a017b8c5f service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] No waiting events found dispatching network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:03:06 user nova-compute[75672]: WARNING nova.compute.manager [req-c72b0fd8-9d24-42dc-a75a-c22785b7cc29 req-e8df4c3a-40ac-45ea-8713-0a4a017b8c5f service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received unexpected event network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 for instance with vm_state active and task_state shelving_image_uploading.
Nov 30 13:03:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:08 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Snapshot image upload complete
Nov 30 13:03:08 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 13:03:08 user nova-compute[75672]: INFO nova.compute.manager [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Shelve offloading
Nov 30 13:03:08 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Instance destroyed successfully.
Nov 30 13:03:08 user nova-compute[75672]: DEBUG nova.compute.manager [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 13:03:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:03:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquired lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:03:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG nova.network.neutron [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updating instance_info_cache with network_info: [{"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Releasing lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75672) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 13:03:09 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Instance destroyed successfully.
Nov 30 13:03:09 user nova-compute[75672]: DEBUG nova.objects.instance [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'resources' on Instance uuid f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T13:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-825219135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-825219135',id=50,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzuaBHtkLg+kLm78Koex9bHLaO7Vmx/w0PbyH3cLRi+RfRqlA6vBi+Icnv9MIwdUfvsQrwkhSxTB0J0nFQqKTYuQtXh4Sc1SI+JArqjcaegnCZC9s3eIz6HC+63jtqspA==',key_name='tempest-keypair-1654696523',keypairs=<?>,launch_index=0,launched_at=2023-11-30T13:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e674749412c04ea3a757ac31928844c6',ramdisk_id='',reservation_id='r-bo63jblh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792375540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792375540-project-member',shelved_at='2023-11-30T13:03:08.490848',shelved_host='user',shelved_image_id='2dba64c4-475e-4e51-a71b-f23f7464aa59'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T13:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e87ad9fef5444b4b0124b0bd71f8324',uuid=f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converting VIF {"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=49a0440d-cdee-4e65-9638-7b8fdf66b3e6,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a0440d-cd') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG os_vif [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=49a0440d-cdee-4e65-9638-7b8fdf66b3e6,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a0440d-cd') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49a0440d-cd, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef48a12d-379d-42c1-ab87-1759d0032c22) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-121987c3-9947-4983-a34c-056f3bfea080 req-a3cc6298-b136-408b-909f-1a27f8783ec5 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received event network-changed-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-121987c3-9947-4983-a34c-056f3bfea080 req-a3cc6298-b136-408b-909f-1a27f8783ec5 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Refreshing instance network info cache due to event network-changed-49a0440d-cdee-4e65-9638-7b8fdf66b3e6. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-121987c3-9947-4983-a34c-056f3bfea080 req-a3cc6298-b136-408b-909f-1a27f8783ec5 service nova] Acquiring lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-121987c3-9947-4983-a34c-056f3bfea080 req-a3cc6298-b136-408b-909f-1a27f8783ec5 service nova] Acquired lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-121987c3-9947-4983-a34c-056f3bfea080 req-a3cc6298-b136-408b-909f-1a27f8783ec5 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Refreshing network info cache for port 49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:03:09 user nova-compute[75672]: INFO os_vif [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=49a0440d-cdee-4e65-9638-7b8fdf66b3e6,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a0440d-cd')
Nov 30 13:03:09 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Deleting instance files /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8_del
Nov 30 13:03:09 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Deletion of /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8_del complete
Nov 30 13:03:09 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Deleted allocations for instance f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8
Nov 30 13:03:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG nova.objects.instance [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'numa_topology' on Instance uuid f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG nova.objects.base [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Object Instance<f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8> lazy-loaded attributes: resources,numa_topology {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:03:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:03:10 user nova-compute[75672]: DEBUG nova.network.neutron [req-121987c3-9947-4983-a34c-056f3bfea080 req-a3cc6298-b136-408b-909f-1a27f8783ec5 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updated VIF entry in instance network info cache for port 49a0440d-cdee-4e65-9638-7b8fdf66b3e6. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 13:03:10 user nova-compute[75672]: DEBUG nova.network.neutron [req-121987c3-9947-4983-a34c-056f3bfea080 req-a3cc6298-b136-408b-909f-1a27f8783ec5 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updating instance_info_cache with network_info: [{"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap49a0440d-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:03:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-9f04fa8f-5c3e-4fac-94ad-060e61846150 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.817s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:03:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-121987c3-9947-4983-a34c-056f3bfea080 req-a3cc6298-b136-408b-909f-1a27f8783ec5 service nova] Releasing lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:03:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:14 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:15 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:03:15 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 13:03:15 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] There are 0 instances to clean {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 13:03:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:19 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:24 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:29 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:34 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:39 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:44 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:53 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:03:54 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:56 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:03:57 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:03:57 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 13:03:57 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 13:03:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:03:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:03:57 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 13:03:57 user nova-compute[75672]: DEBUG nova.objects.instance [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lazy-loading 'info_cache' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:03:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:58 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updating instance_info_cache with network_info: [{"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:03:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:03:58 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 13:03:58 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:03:59 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:03:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:03:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:03:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:03:59 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 13:03:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:03:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:59 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:03:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:03:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:00 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:04:00 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:04:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=8875MB free_disk=24.981151580810547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 13:04:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:04:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:04:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:04:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 13:04:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 13:04:00 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:04:00 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:04:00 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 13:04:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:04:01 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:04:01 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:04:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:06 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:07 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:04:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 13:04:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "a30452e5-6dea-43af-898a-13c58489a0f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:04:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "a30452e5-6dea-43af-898a-13c58489a0f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:04:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Starting instance... {{(pid=75672) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 13:04:08 user nova-compute[75672]: INFO nova.compute.claims [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Claim successful on node user
Nov 30 13:04:08 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Start building networks asynchronously for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Allocating IP information in the background. {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] allocate_for_instance() {{(pid=75672) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 13:04:08 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 13:04:08 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Start building block device mappings for instance. {{(pid=75672) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG nova.policy [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e2cdc51aad149c2ba81bde495cc5f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665d7a64568e432c856ec3bbc925c8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75672) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Start spawning the instance on the hypervisor. {{(pid=75672) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 13:04:08 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Creating image(s)
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "/opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "/opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "/opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.187s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.184s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211,backing_fmt=raw /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk 1073741824" returned: 0 in 0.046s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "cbf5550ff45b30d065a667e1e85fc5474ba08211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Successfully created port: 875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk. size=1073741824 {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.disk.api [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Cannot resize image /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk to a smaller size. {{(pid=75672) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Ensure instance console log exists: /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.network.neutron [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Successfully updated port: 875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "refresh_cache-a30452e5-6dea-43af-898a-13c58489a0f9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquired lock "refresh_cache-a30452e5-6dea-43af-898a-13c58489a0f9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.network.neutron [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-33cc8a56-0c07-4751-95b8-e9774752716b req-403d1461-2b8e-41ee-9ba1-dc08973eece9 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Received event network-changed-875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-33cc8a56-0c07-4751-95b8-e9774752716b req-403d1461-2b8e-41ee-9ba1-dc08973eece9 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Refreshing instance network info cache due to event network-changed-875416f6-00f5-45be-9f27-7d8d3197fc24. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-33cc8a56-0c07-4751-95b8-e9774752716b req-403d1461-2b8e-41ee-9ba1-dc08973eece9 service nova] Acquiring lock "refresh_cache-a30452e5-6dea-43af-898a-13c58489a0f9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.network.neutron [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Instance cache missing network info. {{(pid=75672) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.network.neutron [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Updating instance_info_cache with network_info: [{"id": "875416f6-00f5-45be-9f27-7d8d3197fc24", "address": "fa:16:3e:f3:eb:7a", "network": {"id": "780b1bd5-9b9d-4aaf-9987-81dfdeddc888", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1435678652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665d7a64568e432c856ec3bbc925c8b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875416f6-00", "ovs_interfaceid": "875416f6-00f5-45be-9f27-7d8d3197fc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Releasing lock "refresh_cache-a30452e5-6dea-43af-898a-13c58489a0f9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Instance network_info: |[{"id": "875416f6-00f5-45be-9f27-7d8d3197fc24", "address": "fa:16:3e:f3:eb:7a", "network": {"id": "780b1bd5-9b9d-4aaf-9987-81dfdeddc888", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1435678652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665d7a64568e432c856ec3bbc925c8b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875416f6-00", "ovs_interfaceid": "875416f6-00f5-45be-9f27-7d8d3197fc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75672) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-33cc8a56-0c07-4751-95b8-e9774752716b req-403d1461-2b8e-41ee-9ba1-dc08973eece9 service nova] Acquired lock "refresh_cache-a30452e5-6dea-43af-898a-13c58489a0f9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.network.neutron [req-33cc8a56-0c07-4751-95b8-e9774752716b req-403d1461-2b8e-41ee-9ba1-dc08973eece9 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Refreshing network info cache for port 875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Start _get_guest_xml network_info=[{"id": "875416f6-00f5-45be-9f27-7d8d3197fc24", "address": "fa:16:3e:f3:eb:7a", "network": {"id": "780b1bd5-9b9d-4aaf-9987-81dfdeddc888", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1435678652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665d7a64568e432c856ec3bbc925c8b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875416f6-00", "ovs_interfaceid": "875416f6-00f5-45be-9f27-7d8d3197fc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 13:04:09 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:04:09 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T12:27:55Z,direct_url=<?>,disk_format='qcow2',id=f1bddb75-c432-42ad-9253-e3e4a10e804c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='08b033eb830b4d89adeaa6b52664498e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T12:27:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 13:04:09 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T13:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1941586274',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1941586274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1941586',id=52,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+O3h5n3c3TAwXML4FcJeQ4EAMU2iHNI52LzH2wBGAETD+2F2wC2FQV/BzP+E41WnuTFfjhVicjiMVIfn12uR0zCKSEYCM8O3Ka/1JQMracNSJtjUgpaNMkB9U+HgyIug==',key_name='tempest-keypair-1318571566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='665d7a64568e432c856ec3bbc925c8b9',ramdisk_id='',reservation_id='r-y5wq58d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2081172607',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T13:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e2cdc51aad149c2ba81bde495cc5f47',uuid=a30452e5-6dea-43af-898a-13c58489a0f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "875416f6-00f5-45be-9f27-7d8d3197fc24", "address": "fa:16:3e:f3:eb:7a", "network": {"id": "780b1bd5-9b9d-4aaf-9987-81dfdeddc888", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1435678652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665d7a64568e432c856ec3bbc925c8b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875416f6-00", "ovs_interfaceid": "875416f6-00f5-45be-9f27-7d8d3197fc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Converting VIF {"id": "875416f6-00f5-45be-9f27-7d8d3197fc24", "address": "fa:16:3e:f3:eb:7a", "network": {"id": "780b1bd5-9b9d-4aaf-9987-81dfdeddc888", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1435678652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665d7a64568e432c856ec3bbc925c8b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875416f6-00", "ovs_interfaceid": "875416f6-00f5-45be-9f27-7d8d3197fc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:eb:7a,bridge_name='br-int',has_traffic_filtering=True,id=875416f6-00f5-45be-9f27-7d8d3197fc24,network=Network(780b1bd5-9b9d-4aaf-9987-81dfdeddc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875416f6-00') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.objects.instance [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lazy-loading 'pci_devices' on Instance uuid a30452e5-6dea-43af-898a-13c58489a0f9 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] End _get_guest_xml xml=<domain type="kvm">
Nov 30 13:04:10 user nova-compute[75672]:   <uuid>a30452e5-6dea-43af-898a-13c58489a0f9</uuid>
Nov 30 13:04:10 user nova-compute[75672]:   <name>instance-00000034</name>
Nov 30 13:04:10 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 13:04:10 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 13:04:10 user nova-compute[75672]:   <metadata>
Nov 30 13:04:10 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 13:04:10 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 13:04:10 user nova-compute[75672]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1941586274</nova:name>
Nov 30 13:04:10 user nova-compute[75672]:       <nova:creationTime>2023-11-30 13:04:09</nova:creationTime>
Nov 30 13:04:10 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 13:04:10 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 13:04:10 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 13:04:10 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 13:04:10 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 13:04:10 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 13:04:10 user nova-compute[75672]:       </nova:flavor>
Nov 30 13:04:10 user nova-compute[75672]:       <nova:owner>
Nov 30 13:04:10 user nova-compute[75672]:         <nova:user uuid="5e2cdc51aad149c2ba81bde495cc5f47">tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member</nova:user>
Nov 30 13:04:10 user nova-compute[75672]:         <nova:project uuid="665d7a64568e432c856ec3bbc925c8b9">tempest-TestServerVolumeAttachScenarioOldVersion-2081172607</nova:project>
Nov 30 13:04:10 user nova-compute[75672]:       </nova:owner>
Nov 30 13:04:10 user nova-compute[75672]:       <nova:root type="image" uuid="f1bddb75-c432-42ad-9253-e3e4a10e804c"/>
Nov 30 13:04:10 user nova-compute[75672]:       <nova:ports>
Nov 30 13:04:10 user nova-compute[75672]:         <nova:port uuid="875416f6-00f5-45be-9f27-7d8d3197fc24">
Nov 30 13:04:10 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 13:04:10 user nova-compute[75672]:         </nova:port>
Nov 30 13:04:10 user nova-compute[75672]:       </nova:ports>
Nov 30 13:04:10 user nova-compute[75672]:     </nova:instance>
Nov 30 13:04:10 user nova-compute[75672]:   </metadata>
Nov 30 13:04:10 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 13:04:10 user nova-compute[75672]:     <system>
Nov 30 13:04:10 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 13:04:10 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 13:04:10 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 13:04:10 user nova-compute[75672]:       <entry name="serial">a30452e5-6dea-43af-898a-13c58489a0f9</entry>
Nov 30 13:04:10 user nova-compute[75672]:       <entry name="uuid">a30452e5-6dea-43af-898a-13c58489a0f9</entry>
Nov 30 13:04:10 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 13:04:10 user nova-compute[75672]:     </system>
Nov 30 13:04:10 user nova-compute[75672]:   </sysinfo>
Nov 30 13:04:10 user nova-compute[75672]:   <os>
Nov 30 13:04:10 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 13:04:10 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 13:04:10 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 13:04:10 user nova-compute[75672]:   </os>
Nov 30 13:04:10 user nova-compute[75672]:   <features>
Nov 30 13:04:10 user nova-compute[75672]:     <acpi/>
Nov 30 13:04:10 user nova-compute[75672]:     <apic/>
Nov 30 13:04:10 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 13:04:10 user nova-compute[75672]:   </features>
Nov 30 13:04:10 user nova-compute[75672]:   <clock offset="utc">
Nov 30 13:04:10 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 13:04:10 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 13:04:10 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 13:04:10 user nova-compute[75672]:   </clock>
Nov 30 13:04:10 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 13:04:10 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 13:04:10 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 13:04:10 user nova-compute[75672]:   </cpu>
Nov 30 13:04:10 user nova-compute[75672]:   <devices>
Nov 30 13:04:10 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 13:04:10 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 13:04:10 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk"/>
Nov 30 13:04:10 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 13:04:10 user nova-compute[75672]:     </disk>
Nov 30 13:04:10 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 13:04:10 user nova-compute[75672]:       <mac address="fa:16:3e:f3:eb:7a"/>
Nov 30 13:04:10 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 13:04:10 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 13:04:10 user nova-compute[75672]:       <target dev="tap875416f6-00"/>
Nov 30 13:04:10 user nova-compute[75672]:     </interface>
Nov 30 13:04:10 user nova-compute[75672]:     <serial type="pty">
Nov 30 13:04:10 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/console.log" append="off"/>
Nov 30 13:04:10 user nova-compute[75672]:     </serial>
Nov 30 13:04:10 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 13:04:10 user nova-compute[75672]:     <video>
Nov 30 13:04:10 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 13:04:10 user nova-compute[75672]:     </video>
Nov 30 13:04:10 user nova-compute[75672]:     <rng model="virtio">
Nov 30 13:04:10 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 13:04:10 user nova-compute[75672]:     </rng>
Nov 30 13:04:10 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 13:04:10 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 13:04:10 user nova-compute[75672]:       <stats period="10"/>
Nov 30 13:04:10 user nova-compute[75672]:     </memballoon>
Nov 30 13:04:10 user nova-compute[75672]:   </devices>
Nov 30 13:04:10 user nova-compute[75672]: </domain>
Nov 30 13:04:10 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T13:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1941586274',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1941586274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1941586',id=52,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+O3h5n3c3TAwXML4FcJeQ4EAMU2iHNI52LzH2wBGAETD+2F2wC2FQV/BzP+E41WnuTFfjhVicjiMVIfn12uR0zCKSEYCM8O3Ka/1JQMracNSJtjUgpaNMkB9U+HgyIug==',key_name='tempest-keypair-1318571566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='665d7a64568e432c856ec3bbc925c8b9',ramdisk_id='',reservation_id='r-y5wq58d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2081172607',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T13:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e2cdc51aad149c2ba81bde495cc5f47',uuid=a30452e5-6dea-43af-898a-13c58489a0f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "875416f6-00f5-45be-9f27-7d8d3197fc24", "address": "fa:16:3e:f3:eb:7a", "network": {"id": "780b1bd5-9b9d-4aaf-9987-81dfdeddc888", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1435678652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665d7a64568e432c856ec3bbc925c8b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875416f6-00", "ovs_interfaceid": "875416f6-00f5-45be-9f27-7d8d3197fc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Converting VIF {"id": "875416f6-00f5-45be-9f27-7d8d3197fc24", "address": "fa:16:3e:f3:eb:7a", "network": {"id": "780b1bd5-9b9d-4aaf-9987-81dfdeddc888", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1435678652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665d7a64568e432c856ec3bbc925c8b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875416f6-00", "ovs_interfaceid": "875416f6-00f5-45be-9f27-7d8d3197fc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:eb:7a,bridge_name='br-int',has_traffic_filtering=True,id=875416f6-00f5-45be-9f27-7d8d3197fc24,network=Network(780b1bd5-9b9d-4aaf-9987-81dfdeddc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875416f6-00') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG os_vif [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:eb:7a,bridge_name='br-int',has_traffic_filtering=True,id=875416f6-00f5-45be-9f27-7d8d3197fc24,network=Network(780b1bd5-9b9d-4aaf-9987-81dfdeddc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875416f6-00') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6618572-7f73-5868-9cf3-bf752826aac9', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap875416f6-00, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap875416f6-00, col_values=(('qos', UUID('b1f10dce-3d3f-4816-9628-94fb30ee463f')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap875416f6-00, col_values=(('external_ids', {'iface-id': '875416f6-00f5-45be-9f27-7d8d3197fc24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:eb:7a', 'vm-uuid': 'a30452e5-6dea-43af-898a-13c58489a0f9'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:10 user nova-compute[75672]: INFO os_vif [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:eb:7a,bridge_name='br-int',has_traffic_filtering=True,id=875416f6-00f5-45be-9f27-7d8d3197fc24,network=Network(780b1bd5-9b9d-4aaf-9987-81dfdeddc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875416f6-00')
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] No VIF found with MAC fa:16:3e:f3:eb:7a, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.network.neutron [req-33cc8a56-0c07-4751-95b8-e9774752716b req-403d1461-2b8e-41ee-9ba1-dc08973eece9 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Updated VIF entry in instance network info cache for port 875416f6-00f5-45be-9f27-7d8d3197fc24. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG nova.network.neutron [req-33cc8a56-0c07-4751-95b8-e9774752716b req-403d1461-2b8e-41ee-9ba1-dc08973eece9 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Updating instance_info_cache with network_info: [{"id": "875416f6-00f5-45be-9f27-7d8d3197fc24", "address": "fa:16:3e:f3:eb:7a", "network": {"id": "780b1bd5-9b9d-4aaf-9987-81dfdeddc888", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1435678652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665d7a64568e432c856ec3bbc925c8b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875416f6-00", "ovs_interfaceid": "875416f6-00f5-45be-9f27-7d8d3197fc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:04:10 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-33cc8a56-0c07-4751-95b8-e9774752716b req-403d1461-2b8e-41ee-9ba1-dc08973eece9 service nova] Releasing lock "refresh_cache-a30452e5-6dea-43af-898a-13c58489a0f9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:04:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-91a95ac1-2c16-4f13-9248-08cddf4ffc02 req-ba7aa9da-e324-4425-bda0-0e89db9ec98a service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Received event network-vif-plugged-875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:04:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-91a95ac1-2c16-4f13-9248-08cddf4ffc02 req-ba7aa9da-e324-4425-bda0-0e89db9ec98a service nova] Acquiring lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:04:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-91a95ac1-2c16-4f13-9248-08cddf4ffc02 req-ba7aa9da-e324-4425-bda0-0e89db9ec98a service nova] Lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:04:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-91a95ac1-2c16-4f13-9248-08cddf4ffc02 req-ba7aa9da-e324-4425-bda0-0e89db9ec98a service nova] Lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:04:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-91a95ac1-2c16-4f13-9248-08cddf4ffc02 req-ba7aa9da-e324-4425-bda0-0e89db9ec98a service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] No waiting events found dispatching network-vif-plugged-875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:04:11 user nova-compute[75672]: WARNING nova.compute.manager [req-91a95ac1-2c16-4f13-9248-08cddf4ffc02 req-ba7aa9da-e324-4425-bda0-0e89db9ec98a service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Received unexpected event network-vif-plugged-875416f6-00f5-45be-9f27-7d8d3197fc24 for instance with vm_state building and task_state spawning.
Nov 30 13:04:11 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:13 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 13:04:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 13:04:13 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Instance spawned successfully.
Nov 30 13:04:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Nov 30 13:04:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Found default for hw_cdrom_bus of ide {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:04:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Found default for hw_disk_bus of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:04:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Found default for hw_input_bus of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:04:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Found default for hw_pointer_model of None {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:04:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Found default for hw_video_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:04:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Found default for hw_vif_model of virtio {{(pid=75672) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Nov 30 13:04:13 user nova-compute[75672]: INFO nova.compute.manager [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 30 13:04:13 user nova-compute[75672]: DEBUG nova.compute.manager [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 13:04:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-bf0681fe-41c7-4837-aec5-4f6ac6c71b57 req-ae13b8f1-f847-4cc1-addd-7d0d85af44a6 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Received event network-vif-plugged-875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:04:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bf0681fe-41c7-4837-aec5-4f6ac6c71b57 req-ae13b8f1-f847-4cc1-addd-7d0d85af44a6 service nova] Acquiring lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:04:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bf0681fe-41c7-4837-aec5-4f6ac6c71b57 req-ae13b8f1-f847-4cc1-addd-7d0d85af44a6 service nova] Lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:04:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-bf0681fe-41c7-4837-aec5-4f6ac6c71b57 req-ae13b8f1-f847-4cc1-addd-7d0d85af44a6 service nova] Lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:04:13 user nova-compute[75672]: DEBUG nova.compute.manager [req-bf0681fe-41c7-4837-aec5-4f6ac6c71b57 req-ae13b8f1-f847-4cc1-addd-7d0d85af44a6 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] No waiting events found dispatching network-vif-plugged-875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:04:13 user nova-compute[75672]: WARNING nova.compute.manager [req-bf0681fe-41c7-4837-aec5-4f6ac6c71b57 req-ae13b8f1-f847-4cc1-addd-7d0d85af44a6 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Received unexpected event network-vif-plugged-875416f6-00f5-45be-9f27-7d8d3197fc24 for instance with vm_state building and task_state spawning.
Nov 30 13:04:13 user nova-compute[75672]: INFO nova.compute.manager [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Took 5.79 seconds to build instance.
Nov 30 13:04:13 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-aca98f68-0762-4b51-a2e2-9bfed5045a15 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "a30452e5-6dea-43af-898a-13c58489a0f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.892s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:04:14 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:04:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:16 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:21 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:26 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:31 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:36 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:41 user nova-compute[75672]: DEBUG nova.compute.manager [req-0b150a60-0e06-4aa5-95ec-43d9ba8208b8 req-ed9cb6ef-ac39-4d94-bbbb-045d52e5bc66 service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Received event network-changed-83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:04:41 user nova-compute[75672]: DEBUG nova.compute.manager [req-0b150a60-0e06-4aa5-95ec-43d9ba8208b8 req-ed9cb6ef-ac39-4d94-bbbb-045d52e5bc66 service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Refreshing instance network info cache due to event network-changed-83060a1e-3151-4aad-98dd-a281c8285d51. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 13:04:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0b150a60-0e06-4aa5-95ec-43d9ba8208b8 req-ed9cb6ef-ac39-4d94-bbbb-045d52e5bc66 service nova] Acquiring lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:04:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0b150a60-0e06-4aa5-95ec-43d9ba8208b8 req-ed9cb6ef-ac39-4d94-bbbb-045d52e5bc66 service nova] Acquired lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:04:41 user nova-compute[75672]: DEBUG nova.network.neutron [req-0b150a60-0e06-4aa5-95ec-43d9ba8208b8 req-ed9cb6ef-ac39-4d94-bbbb-045d52e5bc66 service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Refreshing network info cache for port 83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 13:04:41 user nova-compute[75672]: DEBUG nova.network.neutron [req-0b150a60-0e06-4aa5-95ec-43d9ba8208b8 req-ed9cb6ef-ac39-4d94-bbbb-045d52e5bc66 service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updated VIF entry in instance network info cache for port 83060a1e-3151-4aad-98dd-a281c8285d51. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 13:04:41 user nova-compute[75672]: DEBUG nova.network.neutron [req-0b150a60-0e06-4aa5-95ec-43d9ba8208b8 req-ed9cb6ef-ac39-4d94-bbbb-045d52e5bc66 service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updating instance_info_cache with network_info: [{"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:04:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0b150a60-0e06-4aa5-95ec-43d9ba8208b8 req-ed9cb6ef-ac39-4d94-bbbb-045d52e5bc66 service nova] Releasing lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:04:41 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG nova.objects.instance [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lazy-loading 'flavor' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:04:44 user nova-compute[75672]: INFO nova.compute.manager [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Attaching volume 3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 to /dev/vdb
Nov 30 13:04:44 user nova-compute[75672]: DEBUG os_brick.utils [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aa33b3-bbdc-4275-9743-2dc70376585f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[291abef3-4b7a-4168-856f-57081e4e0c58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[89280862-383e-4fd4-a31c-17202180723d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7911485e-4de1-455c-94ad-c616a0fa03c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 13:04:44 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 13:04:44 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a237a96-4177-4425-8bab-ce28acfaf3cc]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG os_brick.utils [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:04:44 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updating existing volume attachment record: 6eacfeab-af75-4ec0-8cc3-b7a957db249f {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 13:04:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCYvApkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:04:53 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:04:53 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:04:53 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7d9d8b-ce52-47d5-aff1-ceb429dc136a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 13:04:53 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e94571-2c62-4843-9f34-c0f067ca3846]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7] added
Nov 30 13:04:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c055849-fd5f-4606-8f6d-24b8fab4b093]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[623e691f-8491-4cff-8328-052587e0369c]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uCYvApkX {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uCYvApkX" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e410e5d2-ed33-4b5c-ab46-37216f957730]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uCYvApkX'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2326495e-279f-4809-bac1-1a81d80208c9]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[10da2324-0956-4ad5-9ce2-ee37fad08446]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 13:04:53 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 13:04:53 user nova-compute[75672]:  {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:04:53 user nova-compute[75672]: WARNING os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 13:04:53 user nova-compute[75672]: 
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6325ca-bacd-4663-8cbc-1f190a4ba686]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7, portal: 172.16.0.220,3260]
Nov 30 13:04:53 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7, portal: 172.16.0.220,3260] successful.
Nov 30 13:04:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e83a33-cc75-42f6-adca-caceeeb1d3c9]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04dd63f-0f72-4300-b361-a8aca77cf0fc]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 (non-flash)
Nov 30 13:04:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 (non-flash)
Nov 30 13:04:53 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[af24add3-cf7a-446d-9c27-a2541754984d]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:04:53 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 13:04:54 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:04:54 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 13:04:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCYvApkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 13:04:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:04:54 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26563613433383065', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:04:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563613433383065', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 13:04:54 user nova-compute[75672]: DEBUG nova.objects.instance [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lazy-loading 'flavor' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:04:54 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 13:04:54 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:04:54 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 13:04:54 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:04:54 user nova-compute[75672]:   <serial>3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7</serial>
Nov 30 13:04:54 user nova-compute[75672]: </disk>
Nov 30 13:04:54 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 13:04:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 13:04:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 13:04:55 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] No VIF found with MAC fa:16:3e:65:4b:94, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 13:04:55 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-ad2a8064-a0af-444e-9780-5b6e2004f00d tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.547s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:04:56 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:04:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:04:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:04:56 user nova-compute[75672]: INFO nova.compute.manager [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Unshelving
Nov 30 13:04:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:04:56 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:04:56 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'pci_requests' on Instance uuid f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:04:57 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'numa_topology' on Instance uuid f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:04:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:57 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75672) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Nov 30 13:04:57 user nova-compute[75672]: INFO nova.compute.claims [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Claim successful on node user
Nov 30 13:04:57 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:04:57 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:04:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:04:57 user nova-compute[75672]: INFO nova.network.neutron [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updating port 49a0440d-cdee-4e65-9638-7b8fdf66b3e6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 30 13:04:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:04:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:04:57 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquired lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:04:57 user nova-compute[75672]: DEBUG nova.network.neutron [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Building network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 13:04:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-8f7d76bc-84a5-4898-8768-3a7b183bfde6 req-e1f26c56-5ad2-4bfa-b012-cf866be3ceae service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received event network-changed-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:04:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-8f7d76bc-84a5-4898-8768-3a7b183bfde6 req-e1f26c56-5ad2-4bfa-b012-cf866be3ceae service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Refreshing instance network info cache due to event network-changed-49a0440d-cdee-4e65-9638-7b8fdf66b3e6. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 13:04:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8f7d76bc-84a5-4898-8768-3a7b183bfde6 req-e1f26c56-5ad2-4bfa-b012-cf866be3ceae service nova] Acquiring lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:04:58 user nova-compute[75672]: DEBUG nova.network.neutron [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updating instance_info_cache with network_info: [{"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:04:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Releasing lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:04:58 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Creating instance directory {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 13:04:58 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Creating image(s)
Nov 30 13:04:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:04:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "/opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:04:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "/opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:04:58 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'trusted_certs' on Instance uuid f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:04:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8f7d76bc-84a5-4898-8768-3a7b183bfde6 req-e1f26c56-5ad2-4bfa-b012-cf866be3ceae service nova] Acquired lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:04:58 user nova-compute[75672]: DEBUG nova.network.neutron [req-8f7d76bc-84a5-4898-8768-3a7b183bfde6 req-e1f26c56-5ad2-4bfa-b012-cf866be3ceae service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Refreshing network info cache for port 49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 13:04:58 user nova-compute[75672]: DEBUG nova.objects.base [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Object Instance<f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 13:04:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "a96d3577bdebde7c4d172d4530c0c1bf688df2b7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:04:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "a96d3577bdebde7c4d172d4530c0c1bf688df2b7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7.part --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG nova.virt.images [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] 2dba64c4-475e-4e51-a71b-f23f7464aa59 was qcow2, converting to raw {{(pid=75672) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG nova.privsep.utils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75672) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7.part /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7.converted {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG nova.network.neutron [req-8f7d76bc-84a5-4898-8768-3a7b183bfde6 req-e1f26c56-5ad2-4bfa-b012-cf866be3ceae service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updated VIF entry in instance network info cache for port 49a0440d-cdee-4e65-9638-7b8fdf66b3e6. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG nova.network.neutron [req-8f7d76bc-84a5-4898-8768-3a7b183bfde6 req-e1f26c56-5ad2-4bfa-b012-cf866be3ceae service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updating instance_info_cache with network_info: [{"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-8f7d76bc-84a5-4898-8768-3a7b183bfde6 req-e1f26c56-5ad2-4bfa-b012-cf866be3ceae service nova] Releasing lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG nova.objects.instance [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lazy-loading 'info_cache' on Instance uuid f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7.part /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7.converted" returned: 0 in 0.308s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:04:59 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7.converted --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "a96d3577bdebde7c4d172d4530c0c1bf688df2b7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.749s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7 --force-share --output=json" returned: 0 in 0.196s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "a96d3577bdebde7c4d172d4530c0c1bf688df2b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "a96d3577bdebde7c4d172d4530c0c1bf688df2b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updating instance_info_cache with network_info: [{"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7 --force-share --output=json" returned: 0 in 0.182s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7,backing_fmt=raw /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk 1073741824 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7,backing_fmt=raw /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk 1073741824" returned: 0 in 0.048s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "a96d3577bdebde7c4d172d4530c0c1bf688df2b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7 --force-share --output=json" returned: 0 in 0.168s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'migration_context' on Instance uuid f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG nova.objects.base [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Object Instance<f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 13:05:00 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Rebasing disk image.
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:00 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 -F raw /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:01 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:05:01 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:05:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:05:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:05:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:05:01 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 13:05:01 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:01 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:01 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75672) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211 -F raw /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk" returned: 0 in 1.910s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Created local disks {{(pid=75672) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Ensure instance console log exists: /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/console.log {{(pid=75672) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Start _get_guest_xml network_info=[{"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d4a226a615f2f5fa40fefd236d276857',container_format='bare',created_at=2023-11-30T13:03:04Z,direct_url=<?>,disk_format='qcow2',id=2dba64c4-475e-4e51-a71b-f23f7464aa59,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-825219135-shelved',owner='e674749412c04ea3a757ac31928844c6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T13:03:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'image_id': 'f1bddb75-c432-42ad-9253-e3e4a10e804c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Nov 30 13:05:02 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:05:02 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=24.82863998413086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:05:02 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:05:02 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CPU controller missing on host. {{(pid=75672) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.host [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CPU controller found on host. {{(pid=75672) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75672) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T12:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d4a226a615f2f5fa40fefd236d276857',container_format='bare',created_at=2023-11-30T13:03:04Z,direct_url=<?>,disk_format='qcow2',id=2dba64c4-475e-4e51-a71b-f23f7464aa59,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-825219135-shelved',owner='e674749412c04ea3a757ac31928844c6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T13:03:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Flavor limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Image limits 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Flavor pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Image pref 0:0:0 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Got 1 possible topologies {{(pid=75672) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.hardware [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75672) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'vcpu_model' on Instance uuid f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.objects.base [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Object Instance<f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T13:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-825219135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-825219135',id=50,image_ref='2dba64c4-475e-4e51-a71b-f23f7464aa59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1654696523',keypairs=<?>,launch_index=0,launched_at=2023-11-30T13:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e674749412c04ea3a757ac31928844c6',ramdisk_id='',reservation_id='r-bo63jblh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792375540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792375540-project-member',shelved_at='2023-11-30T13:03:08.490848',shelved_host='user',shelved_image_id='2dba64c4-475e-4e51-a71b-f23f7464aa59'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T13:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e87ad9fef5444b4b0124b0bd71f8324',uuid=f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75672) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converting VIF {"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=49a0440d-cdee-4e65-9638-7b8fdf66b3e6,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a0440d-cd') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.objects.instance [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'pci_devices' on Instance uuid f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.objects.base [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Object Instance<f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75672) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] End _get_guest_xml xml=<domain type="kvm">
Nov 30 13:05:02 user nova-compute[75672]:   <uuid>f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8</uuid>
Nov 30 13:05:02 user nova-compute[75672]:   <name>instance-00000032</name>
Nov 30 13:05:02 user nova-compute[75672]:   <memory>524288</memory>
Nov 30 13:05:02 user nova-compute[75672]:   <vcpu>1</vcpu>
Nov 30 13:05:02 user nova-compute[75672]:   <metadata>
Nov 30 13:05:02 user nova-compute[75672]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 13:05:02 user nova-compute[75672]:       <nova:package version="0.0.0"/>
Nov 30 13:05:02 user nova-compute[75672]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-825219135</nova:name>
Nov 30 13:05:02 user nova-compute[75672]:       <nova:creationTime>2023-11-30 13:05:02</nova:creationTime>
Nov 30 13:05:02 user nova-compute[75672]:       <nova:flavor name="m1.tiny">
Nov 30 13:05:02 user nova-compute[75672]:         <nova:memory>512</nova:memory>
Nov 30 13:05:02 user nova-compute[75672]:         <nova:disk>1</nova:disk>
Nov 30 13:05:02 user nova-compute[75672]:         <nova:swap>0</nova:swap>
Nov 30 13:05:02 user nova-compute[75672]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 13:05:02 user nova-compute[75672]:         <nova:vcpus>1</nova:vcpus>
Nov 30 13:05:02 user nova-compute[75672]:       </nova:flavor>
Nov 30 13:05:02 user nova-compute[75672]:       <nova:owner>
Nov 30 13:05:02 user nova-compute[75672]:         <nova:user uuid="2e87ad9fef5444b4b0124b0bd71f8324">tempest-AttachVolumeShelveTestJSON-1792375540-project-member</nova:user>
Nov 30 13:05:02 user nova-compute[75672]:         <nova:project uuid="e674749412c04ea3a757ac31928844c6">tempest-AttachVolumeShelveTestJSON-1792375540</nova:project>
Nov 30 13:05:02 user nova-compute[75672]:       </nova:owner>
Nov 30 13:05:02 user nova-compute[75672]:       <nova:root type="image" uuid="2dba64c4-475e-4e51-a71b-f23f7464aa59"/>
Nov 30 13:05:02 user nova-compute[75672]:       <nova:ports>
Nov 30 13:05:02 user nova-compute[75672]:         <nova:port uuid="49a0440d-cdee-4e65-9638-7b8fdf66b3e6">
Nov 30 13:05:02 user nova-compute[75672]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 13:05:02 user nova-compute[75672]:         </nova:port>
Nov 30 13:05:02 user nova-compute[75672]:       </nova:ports>
Nov 30 13:05:02 user nova-compute[75672]:     </nova:instance>
Nov 30 13:05:02 user nova-compute[75672]:   </metadata>
Nov 30 13:05:02 user nova-compute[75672]:   <sysinfo type="smbios">
Nov 30 13:05:02 user nova-compute[75672]:     <system>
Nov 30 13:05:02 user nova-compute[75672]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 13:05:02 user nova-compute[75672]:       <entry name="product">OpenStack Nova</entry>
Nov 30 13:05:02 user nova-compute[75672]:       <entry name="version">0.0.0</entry>
Nov 30 13:05:02 user nova-compute[75672]:       <entry name="serial">f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8</entry>
Nov 30 13:05:02 user nova-compute[75672]:       <entry name="uuid">f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8</entry>
Nov 30 13:05:02 user nova-compute[75672]:       <entry name="family">Virtual Machine</entry>
Nov 30 13:05:02 user nova-compute[75672]:     </system>
Nov 30 13:05:02 user nova-compute[75672]:   </sysinfo>
Nov 30 13:05:02 user nova-compute[75672]:   <os>
Nov 30 13:05:02 user nova-compute[75672]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 13:05:02 user nova-compute[75672]:     <boot dev="hd"/>
Nov 30 13:05:02 user nova-compute[75672]:     <smbios mode="sysinfo"/>
Nov 30 13:05:02 user nova-compute[75672]:   </os>
Nov 30 13:05:02 user nova-compute[75672]:   <features>
Nov 30 13:05:02 user nova-compute[75672]:     <acpi/>
Nov 30 13:05:02 user nova-compute[75672]:     <apic/>
Nov 30 13:05:02 user nova-compute[75672]:     <vmcoreinfo/>
Nov 30 13:05:02 user nova-compute[75672]:   </features>
Nov 30 13:05:02 user nova-compute[75672]:   <clock offset="utc">
Nov 30 13:05:02 user nova-compute[75672]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 13:05:02 user nova-compute[75672]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 13:05:02 user nova-compute[75672]:     <timer name="hpet" present="no"/>
Nov 30 13:05:02 user nova-compute[75672]:   </clock>
Nov 30 13:05:02 user nova-compute[75672]:   <cpu mode="custom" match="exact">
Nov 30 13:05:02 user nova-compute[75672]:     <model>Nehalem</model>
Nov 30 13:05:02 user nova-compute[75672]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 13:05:02 user nova-compute[75672]:   </cpu>
Nov 30 13:05:02 user nova-compute[75672]:   <devices>
Nov 30 13:05:02 user nova-compute[75672]:     <disk type="file" device="disk">
Nov 30 13:05:02 user nova-compute[75672]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 13:05:02 user nova-compute[75672]:       <source file="/opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk"/>
Nov 30 13:05:02 user nova-compute[75672]:       <target dev="vda" bus="virtio"/>
Nov 30 13:05:02 user nova-compute[75672]:     </disk>
Nov 30 13:05:02 user nova-compute[75672]:     <interface type="ethernet">
Nov 30 13:05:02 user nova-compute[75672]:       <mac address="fa:16:3e:36:4d:8d"/>
Nov 30 13:05:02 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 13:05:02 user nova-compute[75672]:       <mtu size="1442"/>
Nov 30 13:05:02 user nova-compute[75672]:       <target dev="tap49a0440d-cd"/>
Nov 30 13:05:02 user nova-compute[75672]:     </interface>
Nov 30 13:05:02 user nova-compute[75672]:     <serial type="pty">
Nov 30 13:05:02 user nova-compute[75672]:       <log file="/opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/console.log" append="off"/>
Nov 30 13:05:02 user nova-compute[75672]:     </serial>
Nov 30 13:05:02 user nova-compute[75672]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 13:05:02 user nova-compute[75672]:     <video>
Nov 30 13:05:02 user nova-compute[75672]:       <model type="virtio"/>
Nov 30 13:05:02 user nova-compute[75672]:     </video>
Nov 30 13:05:02 user nova-compute[75672]:     <rng model="virtio">
Nov 30 13:05:02 user nova-compute[75672]:       <backend model="random">/dev/urandom</backend>
Nov 30 13:05:02 user nova-compute[75672]:     </rng>
Nov 30 13:05:02 user nova-compute[75672]:     <controller type="usb" index="0" model="none"/>
Nov 30 13:05:02 user nova-compute[75672]:     <memballoon model="virtio">
Nov 30 13:05:02 user nova-compute[75672]:       <stats period="10"/>
Nov 30 13:05:02 user nova-compute[75672]:     </memballoon>
Nov 30 13:05:02 user nova-compute[75672]:   </devices>
Nov 30 13:05:02 user nova-compute[75672]: </domain>
Nov 30 13:05:02 user nova-compute[75672]:  {{(pid=75672) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T13:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-825219135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-825219135',id=50,image_ref='2dba64c4-475e-4e51-a71b-f23f7464aa59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1654696523',keypairs=<?>,launch_index=0,launched_at=2023-11-30T13:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e674749412c04ea3a757ac31928844c6',ramdisk_id='',reservation_id='r-bo63jblh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792375540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792375540-project-member',shelved_at='2023-11-30T13:03:08.490848',shelved_host='user',shelved_image_id='2dba64c4-475e-4e51-a71b-f23f7464aa59'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T13:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e87ad9fef5444b4b0124b0bd71f8324',uuid=f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converting VIF {"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=49a0440d-cdee-4e65-9638-7b8fdf66b3e6,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a0440d-cd') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG os_vif [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=49a0440d-cdee-4e65-9638-7b8fdf66b3e6,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a0440d-cd') {{(pid=75672) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92e3d8a6-a7da-55bc-bf82-9e5401068bb0', '_type': 'linux-noop'}}, row=False) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49a0440d-cd, may_exist=True, interface_attrs={}) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49a0440d-cd, col_values=(('qos', UUID('d24788bd-3ae8-4f81-b8d8-2ffbe0bb7143')),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49a0440d-cd, col_values=(('external_ids', {'iface-id': '49a0440d-cdee-4e65-9638-7b8fdf66b3e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:4d:8d', 'vm-uuid': 'f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8'}),), if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a30452e5-6dea-43af-898a-13c58489a0f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (9d360ecf-be43-4c84-93ca-abc6f9902098): {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 13:05:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:02 user nova-compute[75672]: INFO os_vif [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=49a0440d-cdee-4e65-9638-7b8fdf66b3e6,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a0440d-cd')
Nov 30 13:05:03 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 13:05:03 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] No VIF found with MAC fa:16:3e:36:4d:8d, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 13:05:03 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:05:03 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:05:03 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 13:05:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:05:04 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:05:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-83b0966c-5b09-4223-9cc6-20f45d9f32cb req-b68c3e9d-5912-46aa-93d2-9739e6967c46 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received event network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:05:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-83b0966c-5b09-4223-9cc6-20f45d9f32cb req-b68c3e9d-5912-46aa-93d2-9739e6967c46 service nova] Acquiring lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:05:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-83b0966c-5b09-4223-9cc6-20f45d9f32cb req-b68c3e9d-5912-46aa-93d2-9739e6967c46 service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:05:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-83b0966c-5b09-4223-9cc6-20f45d9f32cb req-b68c3e9d-5912-46aa-93d2-9739e6967c46 service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:05:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-83b0966c-5b09-4223-9cc6-20f45d9f32cb req-b68c3e9d-5912-46aa-93d2-9739e6967c46 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] No waiting events found dispatching network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:05:04 user nova-compute[75672]: WARNING nova.compute.manager [req-83b0966c-5b09-4223-9cc6-20f45d9f32cb req-b68c3e9d-5912-46aa-93d2-9739e6967c46 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received unexpected event network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 13:05:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:06 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Instance event wait completed in 0 seconds for  {{(pid=75672) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 13:05:06 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Guest created on hypervisor {{(pid=75672) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Nov 30 13:05:06 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Instance spawned successfully.
Nov 30 13:05:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-0571e532-d72c-4943-86ea-e61b197d8bf6 req-b8dfb601-3566-4514-b0f9-170695189b90 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received event network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:05:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0571e532-d72c-4943-86ea-e61b197d8bf6 req-b8dfb601-3566-4514-b0f9-170695189b90 service nova] Acquiring lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:05:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0571e532-d72c-4943-86ea-e61b197d8bf6 req-b8dfb601-3566-4514-b0f9-170695189b90 service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:05:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-0571e532-d72c-4943-86ea-e61b197d8bf6 req-b8dfb601-3566-4514-b0f9-170695189b90 service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:05:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-0571e532-d72c-4943-86ea-e61b197d8bf6 req-b8dfb601-3566-4514-b0f9-170695189b90 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] No waiting events found dispatching network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:05:06 user nova-compute[75672]: WARNING nova.compute.manager [req-0571e532-d72c-4943-86ea-e61b197d8bf6 req-b8dfb601-3566-4514-b0f9-170695189b90 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received unexpected event network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 13:05:06 user nova-compute[75672]: DEBUG nova.compute.manager [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Checking state {{(pid=75672) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 13:05:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-d7e78521-cc23-4c09-b17e-369875f71573 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.354s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:05:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:09 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:05:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 13:05:11 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:05:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:05:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:05:12 user nova-compute[75672]: INFO nova.compute.manager [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Detaching volume 3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7
Nov 30 13:05:12 user nova-compute[75672]: INFO nova.virt.block_device [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Attempting to driver detach volume 3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 from mountpoint /dev/vdb
Nov 30 13:05:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Attempting to detach device vdb from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 13:05:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 13:05:12 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:05:12 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 13:05:12 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:05:12 user nova-compute[75672]:   <serial>3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7</serial>
Nov 30 13:05:12 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 13:05:12 user nova-compute[75672]: </disk>
Nov 30 13:05:12 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 13:05:12 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Successfully detached device vdb from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the persistent domain config.
Nov 30 13:05:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 13:05:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 13:05:12 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:05:12 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 13:05:12 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:05:12 user nova-compute[75672]:   <serial>3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7</serial>
Nov 30 13:05:12 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 13:05:12 user nova-compute[75672]: </disk>
Nov 30 13:05:12 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 13:05:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:13 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 13:05:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:05:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:05:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:05:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:05:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:33 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f is timed out.
Nov 30 13:05:33 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Successfully detached device vdb from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the live domain config.
Nov 30 13:05:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCYvApkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:05:33 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[01508c8c-1af7-426b-8749-d8f818fcc68e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 13:05:33 user nova-compute[75672]: No targets found.
Nov 30 13:05:33 user nova-compute[75672]: iSNS:
Nov 30 13:05:33 user nova-compute[75672]: No targets found.
Nov 30 13:05:33 user nova-compute[75672]: STATIC:
Nov 30 13:05:33 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7
Nov 30 13:05:33 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 13:05:33 user nova-compute[75672]:                 Iface Name: default
Nov 30 13:05:33 user nova-compute[75672]: FIRMWARE:
Nov 30 13:05:33 user nova-compute[75672]: No targets found.
Nov 30 13:05:33 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 13:05:33 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 13:05:33 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0071d173-b09a-439a-9d54-b2bb6cfc3d1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8deb42-78d2-49cc-bd2f-d7962ea2c34d]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 (non-flash)
Nov 30 13:05:33 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 (non-flash)
Nov 30 13:05:33 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcf7e04d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f0cc6d-89b6-4c9c-ad35-5b30b36314de]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[76070ba6-be14-404c-a4af-be030b2012e0]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6fd8a1-fbe8-452a-9a84-8d4e441c1cc4]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd6dea-41df-4e63-9cb6-e559933f9b9f]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6dfa3b-f2d5-44bc-a88e-3d4b71febe8f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b77f2ae-d348-435f-9467-fcb4aac3034f]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7, portal: 172.16.0.220,3260]
Nov 30 13:05:33 user nova-compute[75672]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7, portal: 172.16.0.220,3260] successful.
Nov 30 13:05:33 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc385f0-d95e-40a2-a5bf-7a7fef7c3bd7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c97e75-acef-42b6-9ca6-2b8d1f3ff23e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] <== disconnect_volume: return (285ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:05:33 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 13:05:34 user nova-compute[75672]: DEBUG nova.objects.instance [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lazy-loading 'flavor' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:05:34 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-64a8ef62-226c-4b70-8351-c5c6b6f4efb6 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.623s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:05:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:37 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:05:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:05:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:05:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:05:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:05:54 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:05:57 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:05:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:05:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:05:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:05:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:05:57 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:05:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-e609e64a-ecbe-400c-b7a9-c7aa03cc65e5 req-61cf6cf0-09e3-486a-8041-3ec1d649f158 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Received event network-changed-875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:05:58 user nova-compute[75672]: DEBUG nova.compute.manager [req-e609e64a-ecbe-400c-b7a9-c7aa03cc65e5 req-61cf6cf0-09e3-486a-8041-3ec1d649f158 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Refreshing instance network info cache due to event network-changed-875416f6-00f5-45be-9f27-7d8d3197fc24. {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 13:05:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e609e64a-ecbe-400c-b7a9-c7aa03cc65e5 req-61cf6cf0-09e3-486a-8041-3ec1d649f158 service nova] Acquiring lock "refresh_cache-a30452e5-6dea-43af-898a-13c58489a0f9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:05:58 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e609e64a-ecbe-400c-b7a9-c7aa03cc65e5 req-61cf6cf0-09e3-486a-8041-3ec1d649f158 service nova] Acquired lock "refresh_cache-a30452e5-6dea-43af-898a-13c58489a0f9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:05:58 user nova-compute[75672]: DEBUG nova.network.neutron [req-e609e64a-ecbe-400c-b7a9-c7aa03cc65e5 req-61cf6cf0-09e3-486a-8041-3ec1d649f158 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Refreshing network info cache for port 875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 13:05:59 user nova-compute[75672]: DEBUG nova.network.neutron [req-e609e64a-ecbe-400c-b7a9-c7aa03cc65e5 req-61cf6cf0-09e3-486a-8041-3ec1d649f158 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Updated VIF entry in instance network info cache for port 875416f6-00f5-45be-9f27-7d8d3197fc24. {{(pid=75672) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 13:05:59 user nova-compute[75672]: DEBUG nova.network.neutron [req-e609e64a-ecbe-400c-b7a9-c7aa03cc65e5 req-61cf6cf0-09e3-486a-8041-3ec1d649f158 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Updating instance_info_cache with network_info: [{"id": "875416f6-00f5-45be-9f27-7d8d3197fc24", "address": "fa:16:3e:f3:eb:7a", "network": {"id": "780b1bd5-9b9d-4aaf-9987-81dfdeddc888", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1435678652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665d7a64568e432c856ec3bbc925c8b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875416f6-00", "ovs_interfaceid": "875416f6-00f5-45be-9f27-7d8d3197fc24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:05:59 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e609e64a-ecbe-400c-b7a9-c7aa03cc65e5 req-61cf6cf0-09e3-486a-8041-3ec1d649f158 service nova] Releasing lock "refresh_cache-a30452e5-6dea-43af-898a-13c58489a0f9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:06:01 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:06:01 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 13:06:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:06:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:06:01 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 13:06:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "a30452e5-6dea-43af-898a-13c58489a0f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:06:01 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "a30452e5-6dea-43af-898a-13c58489a0f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:06:01 user nova-compute[75672]: DEBUG nova.objects.instance [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lazy-loading 'flavor' on Instance uuid a30452e5-6dea-43af-898a-13c58489a0f9 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "a30452e5-6dea-43af-898a-13c58489a0f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updating instance_info_cache with network_info: [{"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "a30452e5-6dea-43af-898a-13c58489a0f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "a30452e5-6dea-43af-898a-13c58489a0f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:06:02 user nova-compute[75672]: INFO nova.compute.manager [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Attaching volume 73d16619-5db6-4f71-8fe5-d82c097b3e1e to /dev/vdb
Nov 30 13:06:02 user nova-compute[75672]: DEBUG os_brick.utils [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fc32e3-f435-4c1b-8336-2869b82f2781]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b15591-f5de-40bf-9b8f-15cfa4c55cfb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[023763c8-51dc-4d44-b9f2-1bc04d88c8b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c96e2e-3515-4518-848e-7d3d53dbc7e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 13:06:02 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 13:06:02 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48527b6-2bf2-4cb6-940e-19eefaaa7a58]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG os_brick.utils [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Updating existing volume attachment record: 6306d6af-7897-45bd-aeee-b1bc0a212fff {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 13:06:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:03 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:06:03 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:06:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:06:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:06:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:06:03 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 13:06:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:04 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:05 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:06:05 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:06:05 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=8658MB free_disk=24.923686981201172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a30452e5-6dea-43af-898a-13c58489a0f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lazy-loading 'flavor' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:06:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:06:06 user nova-compute[75672]: INFO nova.compute.manager [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Attaching volume 1c5965d6-f327-4c75-86f9-21fd2dddbee9 to /dev/vdb
Nov 30 13:06:06 user nova-compute[75672]: DEBUG os_brick.utils [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e557b1-41cc-4cd6-9e87-7c3fbebcbc91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1c7351-f683-45f9-8c5f-71e515e2a60f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a56ec0-20aa-496e-b428-125c8ddf3e67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbd3944-8f3a-4b87-b40f-3072ae05f9bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 13:06:06 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 13:06:06 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[23aabe74-58a3-44be-a815-1f0dfd494469]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG os_brick.utils [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:06:06 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updating existing volume attachment record: 89ae444c-fda0-42c7-97d5-55c29da58920 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 13:06:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:07 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjhRcPlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:06:11 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:06:11 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:06:11 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c722d5-04d6-43d7-9201-7fcc417c4ca4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 13:06:11 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[083889a4-4b48-4ec9-8e65-ca034dc8ddac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e] added
Nov 30 13:06:11 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2ebd44-0455-4e18-a0b1-ce630f2ffd77]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eac6fb1-b669-4cce-b5d6-32dc572c4a28]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KjhRcPlG {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KjhRcPlG" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e70d13-d9f5-4e51-8600-84ea1c13efa0]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KjhRcPlG'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55f4c5c-b82b-45cf-8a15-cb9fd5623625]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7609c5-0b30-427f-a67e-4fd970e33b40]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 13:06:11 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 13:06:11 user nova-compute[75672]:  {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:06:11 user nova-compute[75672]: WARNING os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 13:06:11 user nova-compute[75672]: 
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b56d5e-188e-43e1-a154-58079c122e35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e, portal: 172.16.0.220,3260]
Nov 30 13:06:11 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e, portal: 172.16.0.220,3260] successful.
Nov 30 13:06:11 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaa8d01-bb98-43b6-89f4-1c479fd61262]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f65acdc-658c-4412-8493-0d4485d51ed0]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e (non-flash)
Nov 30 13:06:11 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e (non-flash)
Nov 30 13:06:11 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8c7e24-d06d-4edc-9b32-b0d0e9fd3415]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjhRcPlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:06:11 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23633303465316138', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633303465316138', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG nova.objects.instance [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lazy-loading 'flavor' on Instance uuid a30452e5-6dea-43af-898a-13c58489a0f9 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 13:06:12 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:06:12 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 13:06:12 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:06:12 user nova-compute[75672]:   <serial>73d16619-5db6-4f71-8fe5-d82c097b3e1e</serial>
Nov 30 13:06:12 user nova-compute[75672]: </disk>
Nov 30 13:06:12 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] No VIF found with MAC fa:16:3e:f3:eb:7a, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b938219e-5518-45c7-a193-9a0ea2fae99d tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "a30452e5-6dea-43af-898a-13c58489a0f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.750s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:06:12 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:13 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:06:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "a30452e5-6dea-43af-898a-13c58489a0f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:06:14 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "a30452e5-6dea-43af-898a-13c58489a0f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:06:14 user nova-compute[75672]: INFO nova.compute.manager [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Detaching volume 73d16619-5db6-4f71-8fe5-d82c097b3e1e
Nov 30 13:06:14 user nova-compute[75672]: INFO nova.virt.block_device [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Attempting to driver detach volume 73d16619-5db6-4f71-8fe5-d82c097b3e1e from mountpoint /dev/vdb
Nov 30 13:06:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Attempting to detach device vdb from instance a30452e5-6dea-43af-898a-13c58489a0f9 from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 13:06:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 13:06:14 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:06:14 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 13:06:14 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:06:14 user nova-compute[75672]:   <serial>73d16619-5db6-4f71-8fe5-d82c097b3e1e</serial>
Nov 30 13:06:14 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 13:06:14 user nova-compute[75672]: </disk>
Nov 30 13:06:14 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 13:06:14 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Successfully detached device vdb from instance a30452e5-6dea-43af-898a-13c58489a0f9 from the persistent domain config.
Nov 30 13:06:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a30452e5-6dea-43af-898a-13c58489a0f9 from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 13:06:14 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 13:06:14 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:06:14 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 13:06:14 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:06:14 user nova-compute[75672]:   <serial>73d16619-5db6-4f71-8fe5-d82c097b3e1e</serial>
Nov 30 13:06:14 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 13:06:14 user nova-compute[75672]: </disk>
Nov 30 13:06:14 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sALWgBFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:06:15 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:06:15 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:06:15 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[545a0d33-37df-46a9-bbcf-77b110963276]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 13:06:15 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ef752e-5759-44ab-b195-ae1773d28aac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9] added
Nov 30 13:06:15 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd61cae-dfc3-4435-9b72-4c11d5fbaa08]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7faef4b-190f-4151-a5f2-c4c5cf4c5738]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sALWgBFh {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sALWgBFh" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9adecdb-4e21-4ebc-b94a-a5a19390ca0a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sALWgBFh'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8b7af9-ba21-4888-bede-f9fce503ed12]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad50501-f522-4efd-a970-bbf5db4e57d8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e (non-flash)
Nov 30 13:06:15 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e (non-flash)
Nov 30 13:06:15 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[062eb657-e5e3-4c44-8f22-8a6ccdb55f26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9, portal: 172.16.0.220,3260]
Nov 30 13:06:15 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9, portal: 172.16.0.220,3260] successful.
Nov 30 13:06:15 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f1e800-4dd9-4644-8c9c-51165334b69e]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae1c298-f5aa-43a1-83c2-2cb1fc2f5c28]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e (non-flash)
Nov 30 13:06:15 user nova-compute[75672]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 (non-flash)
Nov 30 13:06:15 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e (non-flash)
Nov 30 13:06:15 user nova-compute[75672]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 (non-flash)
Nov 30 13:06:15 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e69450-062f-409c-8873-b97c9102c513]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sALWgBFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a30452e5-6dea-43af-898a-13c58489a0f9 {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 13:06:15 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:06:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:06:16 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23635613764643238', 'path': '/dev/sdc'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:06:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635613764643238', 'path': '/dev/sdc'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 13:06:16 user nova-compute[75672]: DEBUG nova.objects.instance [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lazy-loading 'flavor' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:06:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 13:06:16 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:06:16 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 13:06:16 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:06:16 user nova-compute[75672]:   <serial>1c5965d6-f327-4c75-86f9-21fd2dddbee9</serial>
Nov 30 13:06:16 user nova-compute[75672]: </disk>
Nov 30 13:06:16 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 13:06:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 13:06:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 13:06:16 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] No VIF found with MAC fa:16:3e:65:4b:94, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 13:06:17 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-e530a96f-d938-46ad-9f70-51524ba5faa1 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.008s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:06:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:18 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:06:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:06:19 user nova-compute[75672]: INFO nova.compute.manager [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Detaching volume 1c5965d6-f327-4c75-86f9-21fd2dddbee9
Nov 30 13:06:19 user nova-compute[75672]: INFO nova.virt.block_device [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Attempting to driver detach volume 1c5965d6-f327-4c75-86f9-21fd2dddbee9 from mountpoint /dev/vdb
Nov 30 13:06:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Attempting to detach device vdb from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 13:06:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 13:06:19 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:06:19 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 13:06:19 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:06:19 user nova-compute[75672]:   <serial>1c5965d6-f327-4c75-86f9-21fd2dddbee9</serial>
Nov 30 13:06:19 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 13:06:19 user nova-compute[75672]: </disk>
Nov 30 13:06:19 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 13:06:19 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Successfully detached device vdb from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the persistent domain config.
Nov 30 13:06:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 13:06:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 13:06:19 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:06:19 user nova-compute[75672]:   <source dev="/dev/sdc"/>
Nov 30 13:06:19 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:06:19 user nova-compute[75672]:   <serial>1c5965d6-f327-4c75-86f9-21fd2dddbee9</serial>
Nov 30 13:06:19 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 13:06:19 user nova-compute[75672]: </disk>
Nov 30 13:06:19 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 13:06:19 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 13:06:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:23 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:28 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:06:32 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:33 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:35 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a30452e5-6dea-43af-898a-13c58489a0f9 is timed out.
Nov 30 13:06:35 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Successfully detached device vdb from instance a30452e5-6dea-43af-898a-13c58489a0f9 from the live domain config.
Nov 30 13:06:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjhRcPlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:06:35 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[169286fb-690a-4231-bf79-4f3a583e5485]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 13:06:35 user nova-compute[75672]: No targets found.
Nov 30 13:06:35 user nova-compute[75672]: iSNS:
Nov 30 13:06:35 user nova-compute[75672]: No targets found.
Nov 30 13:06:35 user nova-compute[75672]: STATIC:
Nov 30 13:06:35 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9
Nov 30 13:06:35 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 13:06:35 user nova-compute[75672]:                 Iface Name: default
Nov 30 13:06:35 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e
Nov 30 13:06:35 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 13:06:35 user nova-compute[75672]:                 Iface Name: default
Nov 30 13:06:35 user nova-compute[75672]: FIRMWARE:
Nov 30 13:06:35 user nova-compute[75672]: No targets found.
Nov 30 13:06:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 13:06:35 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 13:06:35 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a921502e-643b-43a0-8738-40245fb243ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ff603e-6832-4cc5-a30b-8217fd9c5bd4]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e (non-flash)
Nov 30 13:06:35 user nova-compute[75672]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 (non-flash)
Nov 30 13:06:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e (non-flash)
Nov 30 13:06:35 user nova-compute[75672]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 (non-flash)
Nov 30 13:06:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcf448a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[463a45ea-47c4-4b9c-aa60-9932d3333063]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fcfa1e-0c77-4db4-89b6-3568243e9659]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d35bac9-7182-4ab6-a8cd-1cfa0655583f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[960df67a-d348-47b8-9c32-a3168ec8c2fc]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cf3961-c865-406c-9417-e8efe7919cb1]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57ddd8c-7278-489e-8038-183a312b729d]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e, portal: 172.16.0.220,3260]
Nov 30 13:06:35 user nova-compute[75672]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e, portal: 172.16.0.220,3260] successful.
Nov 30 13:06:35 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d16619-5db6-4f71-8fe5-d82c097b3e1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[799e95aa-fdc1-4189-90e8-2eb013ad8c1d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] <== disconnect_volume: return (291ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:06:35 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 13:06:36 user nova-compute[75672]: DEBUG nova.objects.instance [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lazy-loading 'flavor' on Instance uuid a30452e5-6dea-43af-898a-13c58489a0f9 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:06:36 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-3cd7c7f3-f855-4819-a950-8a74831368b5 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "a30452e5-6dea-43af-898a-13c58489a0f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.647s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:06:38 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:06:39 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f is timed out.
Nov 30 13:06:39 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Successfully detached device vdb from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the live domain config.
Nov 30 13:06:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sALWgBFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:06:39 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:06:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de6e324-2426-488c-9b6d-13ec4e4763b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 13:06:39 user nova-compute[75672]: No targets found.
Nov 30 13:06:39 user nova-compute[75672]: iSNS:
Nov 30 13:06:39 user nova-compute[75672]: No targets found.
Nov 30 13:06:39 user nova-compute[75672]: STATIC:
Nov 30 13:06:39 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9
Nov 30 13:06:39 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 13:06:39 user nova-compute[75672]:                 Iface Name: default
Nov 30 13:06:39 user nova-compute[75672]: FIRMWARE:
Nov 30 13:06:39 user nova-compute[75672]: No targets found.
Nov 30 13:06:39 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 13:06:39 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 13:06:39 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca35ad6-72d4-4a14-a217-03fb7e0710b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1d179a-7c83-4d2d-b3e8-1bc2d571cda8]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 (non-flash)
Nov 30 13:06:39 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 (non-flash)
Nov 30 13:06:39 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcf4488820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9'): ({'sdc'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Removing single pathed devices sdc {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[adad1cb3-6fac-423c-851e-cd1e036223ae]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:39 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba03dfa8-4979-4bb3-b181-a0bcc2996795]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Flushing IO for device /dev/sdc {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7e28f3-ddf2-49c6-b7d1-fd89268ececd]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[819ed3a9-ce5e-49e7-8152-48b12ff7cd48]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] SCSI volumes sdc have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f7704c-f66f-412c-894e-ca0b6ef009b4]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b71b940-87fb-4926-8fe5-cd1fc4ec9cac]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9, portal: 172.16.0.220,3260]
Nov 30 13:06:40 user nova-compute[75672]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9, portal: 172.16.0.220,3260] successful.
Nov 30 13:06:40 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5965d6-f327-4c75-86f9-21fd2dddbee9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3b56d8-8c70-4333-897c-56ffffa79ece]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] <== disconnect_volume: return (314ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 13:06:40 user nova-compute[75672]: DEBUG nova.objects.instance [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lazy-loading 'flavor' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:06:41 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-c0b72dd2-9fd5-445c-94f6-4992eae416ae tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.698s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:06:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:06:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:06:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:06:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:06:43 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:06:47 user nova-compute[75672]: INFO nova.compute.manager [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Terminating instance
Nov 30 13:06:47 user nova-compute[75672]: DEBUG nova.compute.manager [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-e754426a-1644-4f0b-999e-e853426ac405 req-2edf5d6f-7f46-435c-98f7-97b9add2e66d service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received event network-vif-unplugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e754426a-1644-4f0b-999e-e853426ac405 req-2edf5d6f-7f46-435c-98f7-97b9add2e66d service nova] Acquiring lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e754426a-1644-4f0b-999e-e853426ac405 req-2edf5d6f-7f46-435c-98f7-97b9add2e66d service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-e754426a-1644-4f0b-999e-e853426ac405 req-2edf5d6f-7f46-435c-98f7-97b9add2e66d service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-e754426a-1644-4f0b-999e-e853426ac405 req-2edf5d6f-7f46-435c-98f7-97b9add2e66d service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] No waiting events found dispatching network-vif-unplugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG nova.compute.manager [req-e754426a-1644-4f0b-999e-e853426ac405 req-2edf5d6f-7f46-435c-98f7-97b9add2e66d service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received event network-vif-unplugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 13:06:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:48 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Instance destroyed successfully.
Nov 30 13:06:48 user nova-compute[75672]: DEBUG nova.objects.instance [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lazy-loading 'resources' on Instance uuid f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T13:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-825219135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-825219135',id=50,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzuaBHtkLg+kLm78Koex9bHLaO7Vmx/w0PbyH3cLRi+RfRqlA6vBi+Icnv9MIwdUfvsQrwkhSxTB0J0nFQqKTYuQtXh4Sc1SI+JArqjcaegnCZC9s3eIz6HC+63jtqspA==',key_name='tempest-keypair-1654696523',keypairs=<?>,launch_index=0,launched_at=2023-11-30T13:05:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e674749412c04ea3a757ac31928844c6',ramdisk_id='',reservation_id='r-bo63jblh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792375540',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792375540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T13:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e87ad9fef5444b4b0124b0bd71f8324',uuid=f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converting VIF {"id": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "address": "fa:16:3e:36:4d:8d", "network": {"id": "6e7b935a-3f07-41f3-809b-b16f4ab3119b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-384698430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e674749412c04ea3a757ac31928844c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a0440d-cd", "ovs_interfaceid": "49a0440d-cdee-4e65-9638-7b8fdf66b3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=49a0440d-cdee-4e65-9638-7b8fdf66b3e6,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a0440d-cd') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG os_vif [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=49a0440d-cdee-4e65-9638-7b8fdf66b3e6,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a0440d-cd') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49a0440d-cd, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d24788bd-3ae8-4f81-b8d8-2ffbe0bb7143) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:06:48 user nova-compute[75672]: INFO os_vif [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:4d:8d,bridge_name='br-int',has_traffic_filtering=True,id=49a0440d-cdee-4e65-9638-7b8fdf66b3e6,network=Network(6e7b935a-3f07-41f3-809b-b16f4ab3119b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a0440d-cd')
Nov 30 13:06:48 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Deleting instance files /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8_del
Nov 30 13:06:48 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Deletion of /opt/stack/data/nova/instances/f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8_del complete
Nov 30 13:06:48 user nova-compute[75672]: INFO nova.compute.manager [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 30 13:06:48 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:06:48 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Took 0.76 seconds to deallocate network for instance.
Nov 30 13:06:48 user nova-compute[75672]: DEBUG nova.compute.manager [req-22e6cf7c-13d2-4c85-a23a-a813a3ef1ac2 req-f809c27c-28f9-41a9-bfd8-e06e52822692 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received event network-vif-deleted-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:06:48 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:06:49 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:06:49 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:06:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:06:49 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Deleted allocations for instance f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8
Nov 30 13:06:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-30eee06b-d2b9-4638-8226-a146ee9890e8 tempest-AttachVolumeShelveTestJSON-1792375540 tempest-AttachVolumeShelveTestJSON-1792375540-project-member] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.976s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:06:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-3a2ee70b-cda2-4d16-adc3-0d2723c47f86 req-95b42c5e-1113-4d69-8609-86aa573de0d7 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received event network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:06:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3a2ee70b-cda2-4d16-adc3-0d2723c47f86 req-95b42c5e-1113-4d69-8609-86aa573de0d7 service nova] Acquiring lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:06:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3a2ee70b-cda2-4d16-adc3-0d2723c47f86 req-95b42c5e-1113-4d69-8609-86aa573de0d7 service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:06:49 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-3a2ee70b-cda2-4d16-adc3-0d2723c47f86 req-95b42c5e-1113-4d69-8609-86aa573de0d7 service nova] Lock "f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:06:49 user nova-compute[75672]: DEBUG nova.compute.manager [req-3a2ee70b-cda2-4d16-adc3-0d2723c47f86 req-95b42c5e-1113-4d69-8609-86aa573de0d7 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] No waiting events found dispatching network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:06:49 user nova-compute[75672]: WARNING nova.compute.manager [req-3a2ee70b-cda2-4d16-adc3-0d2723c47f86 req-95b42c5e-1113-4d69-8609-86aa573de0d7 service nova] [instance: f6b3bea2-84c3-4647-881b-1d5e5fd4b1b8] Received unexpected event network-vif-plugged-49a0440d-cdee-4e65-9638-7b8fdf66b3e6 for instance with vm_state deleted and task_state None.
Nov 30 13:06:52 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:53 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:06:55 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:06:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:06:59 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:07:02 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:07:02 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 13:07:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-a30452e5-6dea-43af-898a-13c58489a0f9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:07:02 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-a30452e5-6dea-43af-898a-13c58489a0f9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:07:02 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 13:07:03 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Updating instance_info_cache with network_info: [{"id": "875416f6-00f5-45be-9f27-7d8d3197fc24", "address": "fa:16:3e:f3:eb:7a", "network": {"id": "780b1bd5-9b9d-4aaf-9987-81dfdeddc888", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1435678652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665d7a64568e432c856ec3bbc925c8b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875416f6-00", "ovs_interfaceid": "875416f6-00f5-45be-9f27-7d8d3197fc24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:07:03 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-a30452e5-6dea-43af-898a-13c58489a0f9" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:07:03 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 13:07:03 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:07:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:07:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:07:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:07:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:07:03 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:03 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:07:03 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:07:05 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:07:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:07:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:07:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:07:05 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 13:07:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:06 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:07:06 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:07:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=24.95003890991211GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a30452e5-6dea-43af-898a-13c58489a0f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 13:07:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:07:08 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "a30452e5-6dea-43af-898a-13c58489a0f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "a30452e5-6dea-43af-898a-13c58489a0f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:07:09 user nova-compute[75672]: INFO nova.compute.manager [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Terminating instance
Nov 30 13:07:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-eeff7f11-96d8-478d-b028-1273cf489090 req-15392ed8-336f-40bb-b2f6-d5dca01bf85e service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Received event network-vif-unplugged-875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-eeff7f11-96d8-478d-b028-1273cf489090 req-15392ed8-336f-40bb-b2f6-d5dca01bf85e service nova] Acquiring lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-eeff7f11-96d8-478d-b028-1273cf489090 req-15392ed8-336f-40bb-b2f6-d5dca01bf85e service nova] Lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-eeff7f11-96d8-478d-b028-1273cf489090 req-15392ed8-336f-40bb-b2f6-d5dca01bf85e service nova] Lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-eeff7f11-96d8-478d-b028-1273cf489090 req-15392ed8-336f-40bb-b2f6-d5dca01bf85e service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] No waiting events found dispatching network-vif-unplugged-875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:07:09 user nova-compute[75672]: DEBUG nova.compute.manager [req-eeff7f11-96d8-478d-b028-1273cf489090 req-15392ed8-336f-40bb-b2f6-d5dca01bf85e service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Received event network-vif-unplugged-875416f6-00f5-45be-9f27-7d8d3197fc24 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 13:07:10 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Instance destroyed successfully.
Nov 30 13:07:10 user nova-compute[75672]: DEBUG nova.objects.instance [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lazy-loading 'resources' on Instance uuid a30452e5-6dea-43af-898a-13c58489a0f9 {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:07:10 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T13:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1941586274',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1941586274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1941586',id=52,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+O3h5n3c3TAwXML4FcJeQ4EAMU2iHNI52LzH2wBGAETD+2F2wC2FQV/BzP+E41WnuTFfjhVicjiMVIfn12uR0zCKSEYCM8O3Ka/1JQMracNSJtjUgpaNMkB9U+HgyIug==',key_name='tempest-keypair-1318571566',keypairs=<?>,launch_index=0,launched_at=2023-11-30T13:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='665d7a64568e432c856ec3bbc925c8b9',ramdisk_id='',reservation_id='r-y5wq58d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2081172607',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T13:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e2cdc51aad149c2ba81bde495cc5f47',uuid=a30452e5-6dea-43af-898a-13c58489a0f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "875416f6-00f5-45be-9f27-7d8d3197fc24", "address": "fa:16:3e:f3:eb:7a", "network": {"id": "780b1bd5-9b9d-4aaf-9987-81dfdeddc888", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1435678652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665d7a64568e432c856ec3bbc925c8b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875416f6-00", "ovs_interfaceid": "875416f6-00f5-45be-9f27-7d8d3197fc24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 13:07:10 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Converting VIF {"id": "875416f6-00f5-45be-9f27-7d8d3197fc24", "address": "fa:16:3e:f3:eb:7a", "network": {"id": "780b1bd5-9b9d-4aaf-9987-81dfdeddc888", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1435678652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665d7a64568e432c856ec3bbc925c8b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875416f6-00", "ovs_interfaceid": "875416f6-00f5-45be-9f27-7d8d3197fc24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:07:10 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:eb:7a,bridge_name='br-int',has_traffic_filtering=True,id=875416f6-00f5-45be-9f27-7d8d3197fc24,network=Network(780b1bd5-9b9d-4aaf-9987-81dfdeddc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875416f6-00') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:07:10 user nova-compute[75672]: DEBUG os_vif [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:eb:7a,bridge_name='br-int',has_traffic_filtering=True,id=875416f6-00f5-45be-9f27-7d8d3197fc24,network=Network(780b1bd5-9b9d-4aaf-9987-81dfdeddc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875416f6-00') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 13:07:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap875416f6-00, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:07:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:07:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1f10dce-3d3f-4816-9628-94fb30ee463f) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:07:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:07:10 user nova-compute[75672]: INFO os_vif [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:eb:7a,bridge_name='br-int',has_traffic_filtering=True,id=875416f6-00f5-45be-9f27-7d8d3197fc24,network=Network(780b1bd5-9b9d-4aaf-9987-81dfdeddc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875416f6-00')
Nov 30 13:07:10 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Deleting instance files /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9_del
Nov 30 13:07:10 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Deletion of /opt/stack/data/nova/instances/a30452e5-6dea-43af-898a-13c58489a0f9_del complete
Nov 30 13:07:10 user nova-compute[75672]: INFO nova.compute.manager [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 30 13:07:10 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 13:07:10 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 13:07:10 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 13:07:11 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:07:11 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Took 0.80 seconds to deallocate network for instance.
Nov 30 13:07:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-f5b90e9b-16be-464b-8a2a-f6a5b7447869 req-16b0be91-007b-480e-8da8-94360cfcd4e8 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Received event network-vif-deleted-875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:07:11 user nova-compute[75672]: INFO nova.compute.manager [req-f5b90e9b-16be-464b-8a2a-f6a5b7447869 req-16b0be91-007b-480e-8da8-94360cfcd4e8 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Neutron deleted interface 875416f6-00f5-45be-9f27-7d8d3197fc24; detaching it from the instance and deleting it from the info cache
Nov 30 13:07:11 user nova-compute[75672]: DEBUG nova.network.neutron [req-f5b90e9b-16be-464b-8a2a-f6a5b7447869 req-16b0be91-007b-480e-8da8-94360cfcd4e8 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:07:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-f5b90e9b-16be-464b-8a2a-f6a5b7447869 req-16b0be91-007b-480e-8da8-94360cfcd4e8 service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Detach interface failed, port_id=875416f6-00f5-45be-9f27-7d8d3197fc24, reason: Instance a30452e5-6dea-43af-898a-13c58489a0f9 could not be found. {{(pid=75672) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 13:07:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:07:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:07:11 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:07:11 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:07:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:07:11 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Deleted allocations for instance a30452e5-6dea-43af-898a-13c58489a0f9
Nov 30 13:07:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-a697025c-adb5-4289-9bc2-f327bf2c6e78 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607 tempest-TestServerVolumeAttachScenarioOldVersion-2081172607-project-member] Lock "a30452e5-6dea-43af-898a-13c58489a0f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.227s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:07:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-6dd81575-7dbc-435d-b23e-e5991a43f5d3 req-232ee366-a3de-45ca-ba68-0709d72b131a service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Received event network-vif-plugged-875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:07:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6dd81575-7dbc-435d-b23e-e5991a43f5d3 req-232ee366-a3de-45ca-ba68-0709d72b131a service nova] Acquiring lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:07:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6dd81575-7dbc-435d-b23e-e5991a43f5d3 req-232ee366-a3de-45ca-ba68-0709d72b131a service nova] Lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:07:11 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-6dd81575-7dbc-435d-b23e-e5991a43f5d3 req-232ee366-a3de-45ca-ba68-0709d72b131a service nova] Lock "a30452e5-6dea-43af-898a-13c58489a0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:07:11 user nova-compute[75672]: DEBUG nova.compute.manager [req-6dd81575-7dbc-435d-b23e-e5991a43f5d3 req-232ee366-a3de-45ca-ba68-0709d72b131a service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] No waiting events found dispatching network-vif-plugged-875416f6-00f5-45be-9f27-7d8d3197fc24 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:07:11 user nova-compute[75672]: WARNING nova.compute.manager [req-6dd81575-7dbc-435d-b23e-e5991a43f5d3 req-232ee366-a3de-45ca-ba68-0709d72b131a service nova] [instance: a30452e5-6dea-43af-898a-13c58489a0f9] Received unexpected event network-vif-plugged-875416f6-00f5-45be-9f27-7d8d3197fc24 for instance with vm_state deleted and task_state None.
Nov 30 13:07:11 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:07:11 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG nova.objects.instance [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lazy-loading 'flavor' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:07:12 user nova-compute[75672]: INFO nova.compute.manager [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Attaching volume 51d4e948-e1e9-408d-a9ea-c31b87b37cf5 to /dev/vdb
Nov 30 13:07:12 user nova-compute[75672]: DEBUG os_brick.utils [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b586e0d1-8e8f-46a0-875e-7df3a12c2abd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3656564-deee-42ae-8e27-2ee794f9f5b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd3bfcd-e193-43af-bb12-99b464f11b07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c9a2fe-8a04-4f38-b70f-3c8589843a5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 13:07:12 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 13:07:12 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[868b2e05-26bc-4509-b99a-b4b43e1b2c5e]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG os_brick.utils [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:07:12 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updating existing volume attachment record: e28532f2-6e6f-48df-bc4f-ca26b5fdd294 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 13:07:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:15 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:07:17 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvwNOWBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:07:21 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:07:21 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:07:21 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9cac4a-38f3-4331-8966-66738312cd0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 13:07:21 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27973a5-d364-4ac9-87b6-12faf008be72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5] added
Nov 30 13:07:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0482c0f-3bfb-45fe-8326-c4bf71e2d441]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ff9986-3bcc-4796-bcdc-97dd6e7eb01a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvwNOWBb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvwNOWBb" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec923f7-9730-4b05-ada1-d471769ae92a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cvwNOWBb'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[381e601a-6558-486f-ba49-f70b94e1347a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2d16c8-07a5-4422-b676-4f81160594b2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 13:07:21 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 13:07:21 user nova-compute[75672]:  {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:07:21 user nova-compute[75672]: WARNING os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 13:07:21 user nova-compute[75672]: 
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc8085a-5bdc-4a0d-96f4-e633ea744577]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5, portal: 172.16.0.220,3260]
Nov 30 13:07:21 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5, portal: 172.16.0.220,3260] successful.
Nov 30 13:07:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d7d277-ee7f-4813-b780-11f01a6ec0b1]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b27e11-56e1-43ec-8257-b1b7ea33da2e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 (non-flash)
Nov 30 13:07:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 (non-flash)
Nov 30 13:07:21 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[7903b149-a502-4673-bb27-bda94b1eefc1]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 13:07:21 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvwNOWBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 13:07:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:07:22 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23164353863646434', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:07:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164353863646434', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 13:07:22 user nova-compute[75672]: DEBUG nova.objects.instance [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lazy-loading 'flavor' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:07:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 13:07:22 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:07:22 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 13:07:22 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:07:22 user nova-compute[75672]:   <serial>51d4e948-e1e9-408d-a9ea-c31b87b37cf5</serial>
Nov 30 13:07:22 user nova-compute[75672]: </disk>
Nov 30 13:07:22 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 13:07:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 13:07:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 13:07:22 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] No VIF found with MAC fa:16:3e:65:4b:94, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 13:07:22 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-fd01e303-613a-416b-9487-c5e80baf3359 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.276s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:07:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:07:24 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:07:24 user nova-compute[75672]: INFO nova.compute.manager [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Detaching volume 51d4e948-e1e9-408d-a9ea-c31b87b37cf5
Nov 30 13:07:24 user nova-compute[75672]: INFO nova.virt.block_device [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Attempting to driver detach volume 51d4e948-e1e9-408d-a9ea-c31b87b37cf5 from mountpoint /dev/vdb
Nov 30 13:07:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Attempting to detach device vdb from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 13:07:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 13:07:24 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:07:24 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 13:07:24 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:07:24 user nova-compute[75672]:   <serial>51d4e948-e1e9-408d-a9ea-c31b87b37cf5</serial>
Nov 30 13:07:24 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 13:07:24 user nova-compute[75672]: </disk>
Nov 30 13:07:24 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 13:07:24 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Successfully detached device vdb from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the persistent domain config.
Nov 30 13:07:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 13:07:24 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 13:07:24 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:07:24 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 13:07:24 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:07:24 user nova-compute[75672]:   <serial>51d4e948-e1e9-408d-a9ea-c31b87b37cf5</serial>
Nov 30 13:07:24 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 13:07:24 user nova-compute[75672]: </disk>
Nov 30 13:07:24 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Verify base images {{(pid=75672) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Image id f1bddb75-c432-42ad-9253-e3e4a10e804c yields fingerprint cbf5550ff45b30d065a667e1e85fc5474ba08211 {{(pid=75672) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 30 13:07:25 user nova-compute[75672]: INFO nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] image f1bddb75-c432-42ad-9253-e3e4a10e804c at (/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211): checking
Nov 30 13:07:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] image f1bddb75-c432-42ad-9253-e3e4a10e804c at (/opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211): image is in use {{(pid=75672) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75672) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f is a valid instance name {{(pid=75672) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f has a disk file {{(pid=75672) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f is backed by cbf5550ff45b30d065a667e1e85fc5474ba08211 {{(pid=75672) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 30 13:07:25 user nova-compute[75672]: WARNING nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Unknown base file: /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523
Nov 30 13:07:25 user nova-compute[75672]: WARNING nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Unknown base file: /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2
Nov 30 13:07:25 user nova-compute[75672]: WARNING nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Unknown base file: /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea
Nov 30 13:07:25 user nova-compute[75672]: WARNING nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Unknown base file: /opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed
Nov 30 13:07:25 user nova-compute[75672]: WARNING nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Unknown base file: /opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44
Nov 30 13:07:25 user nova-compute[75672]: WARNING nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Unknown base file: /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668
Nov 30 13:07:25 user nova-compute[75672]: WARNING nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Unknown base file: /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41
Nov 30 13:07:25 user nova-compute[75672]: WARNING nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Unknown base file: /opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431
Nov 30 13:07:25 user nova-compute[75672]: WARNING nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Unknown base file: /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7
Nov 30 13:07:25 user nova-compute[75672]: INFO nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Active base files: /opt/stack/data/nova/instances/_base/cbf5550ff45b30d065a667e1e85fc5474ba08211
Nov 30 13:07:25 user nova-compute[75672]: INFO nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Removable base files: /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523 /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2 /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea /opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed /opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44 /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668 /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41 /opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431 /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7
Nov 30 13:07:25 user nova-compute[75672]: INFO nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/342f1ee9119e06497ce22204355f1d3ccc684523
Nov 30 13:07:25 user nova-compute[75672]: INFO nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4f113774bb562d3fbf93daae1a1ed2e0d05d96e2
Nov 30 13:07:25 user nova-compute[75672]: INFO nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5beb14e4e5b923226b92c7a2e63a4cb23fdcd7ea
Nov 30 13:07:25 user nova-compute[75672]: INFO nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3b2c432575e4670c01f2042260debefcfd7582ed
Nov 30 13:07:25 user nova-compute[75672]: INFO nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/185a84359485fd1e8ee42f7859997ee85af80f44
Nov 30 13:07:25 user nova-compute[75672]: INFO nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1a73065f6704064a36ac0c0fe3513221a2fda668
Nov 30 13:07:25 user nova-compute[75672]: INFO nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bcf6605eb1fa66f6403844e518aed003cdbc2d41
Nov 30 13:07:25 user nova-compute[75672]: INFO nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/32c3f14dc97a3ae8f2dddba42d82066dea3a3431
Nov 30 13:07:25 user nova-compute[75672]: INFO nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a96d3577bdebde7c4d172d4530c0c1bf688df2b7
Nov 30 13:07:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Verification complete {{(pid=75672) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Verify swap images {{(pid=75672) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 30 13:07:25 user nova-compute[75672]: DEBUG nova.virt.libvirt.imagecache [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Verify ephemeral images {{(pid=75672) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 30 13:07:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:07:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:07:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:07:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:07:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:45 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f is timed out.
Nov 30 13:07:45 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Successfully detached device vdb from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the live domain config.
Nov 30 13:07:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvwNOWBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:07:45 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae7feca-7c95-4b19-acd9-beb5584aa016]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 13:07:45 user nova-compute[75672]: No targets found.
Nov 30 13:07:45 user nova-compute[75672]: iSNS:
Nov 30 13:07:45 user nova-compute[75672]: No targets found.
Nov 30 13:07:45 user nova-compute[75672]: STATIC:
Nov 30 13:07:45 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5
Nov 30 13:07:45 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 13:07:45 user nova-compute[75672]:                 Iface Name: default
Nov 30 13:07:45 user nova-compute[75672]: FIRMWARE:
Nov 30 13:07:45 user nova-compute[75672]: No targets found.
Nov 30 13:07:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 13:07:45 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 13:07:45 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba5535a-6a5c-46d0-a07f-b146a98e2a6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2115f2ec-ed21-4223-aa00-2f68eee03cb1]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 (non-flash)
Nov 30 13:07:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 (non-flash)
Nov 30 13:07:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcf7e07d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bbc2e7-0feb-4929-97c6-cae833eea85c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad92707c-a742-47b5-8bdf-cccd00d68d50]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd4432d-d219-41bc-9597-255b14221ab8]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fc9e18-50c7-4976-a202-ad051f71952e]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b44d8e2-b2bd-490f-8aa3-a4765588f4fc]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5e2227-963b-485d-a03c-aaa374384f28]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5, portal: 172.16.0.220,3260]
Nov 30 13:07:45 user nova-compute[75672]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5, portal: 172.16.0.220,3260] successful.
Nov 30 13:07:45 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d4e948-e1e9-408d-a9ea-c31b87b37cf5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec4f108-e295-4446-b69f-bbce6ff77b1a]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] <== disconnect_volume: return (257ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:07:45 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 13:07:46 user nova-compute[75672]: DEBUG nova.objects.instance [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lazy-loading 'flavor' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:07:46 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-77340fbd-0ba8-40dc-b03b-00912956ff02 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.795s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:07:49 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:07:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:07:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:07:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:07:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:07:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:07:56 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:08:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:00 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:08:02 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:04 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:08:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 13:08:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 13:08:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:08:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:08:04 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 13:08:04 user nova-compute[75672]: DEBUG nova.objects.instance [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lazy-loading 'info_cache' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updating instance_info_cache with network_info: [{"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:06 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:08:06 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:08:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=8867MB free_disk=24.967731475830078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing inventories for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating ProviderTree inventory for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Updating inventory in ProviderTree for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing aggregate associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, aggregates: None {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Refreshing trait associations for resource provider 9d360ecf-be43-4c84-93ca-abc6f9902098, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75672) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 13:08:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:08:08 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:08:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:11 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:08:11 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 13:08:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:08:15 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:08:16 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:08:16 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:08:16 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances with incomplete migration  {{(pid=75672) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 13:08:19 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_power_states {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:08:19 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Triggering sync for uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 13:08:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:08:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:08:19 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG nova.objects.instance [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lazy-loading 'flavor' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:08:20 user nova-compute[75672]: INFO nova.compute.manager [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Attaching volume 64b4dc76-40c3-4818-bdfa-2d600534e307 to /dev/vdb
Nov 30 13:08:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG os_brick.utils [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dd789e-0f18-4289-84a8-0325c0b61d76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d6d646e25aa7\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3054c41-7a60-46ff-b678-bf625a90fc9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d259313-92a3-4b30-94a0-d13c974a7a67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[9825812a-73f5-4783-afa4-8284fe1dc0e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Running cmd (subprocess): nvme version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] 'nvme version' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] nvme not present on system {{(pid=75672) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 13:08:20 user nova-compute[75672]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 13:08:20 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbec5be8-8a7a-4a18-993f-810c34b10cb9]: (4, '') {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75672) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.lightos [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] LIGHTOS: no hostnqn found. {{(pid=75672) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG os_brick.utils [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d6d646e25aa7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:08:20 user nova-compute[75672]: DEBUG nova.virt.block_device [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updating existing volume attachment record: c45e70f7-08a0-4fb2-9fa6-c54e22935486 {{(pid=75672) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 13:08:22 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:25 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:08:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Cleaning up deleted instances {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 13:08:25 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] There are 0 instances to clean {{(pid=75672) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 13:08:27 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Calling os-brick to attach iSCSI Volume {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxksIKAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:08:37 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:08:37 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:08:37 user nova-compute[75672]: INFO os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20b25dc-9237-499c-b458-ab284780efe7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 13:08:37 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --interface default --op new {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae292aa-d93e-4b31-a192-7517293c7960]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307] added\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307] added
Nov 30 13:08:37 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e26acf-6402-49b2-9dce-4c3dd8b532cb]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dea3224-3d0d-4b20-8feb-d3ed06eb9b57]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxksIKAv {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxksIKAv" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[015f886b-576b-4d73-9ef9-62fd4a370484]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YxksIKAv'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a9806d-f0ac-4ee7-8209-e3f88591ce7d]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f8978c-2896-4beb-9219-b0534d8ca4db]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 13:08:37 user nova-compute[75672]:  {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 13:08:37 user nova-compute[75672]:  {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:08:37 user nova-compute[75672]: WARNING os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 13:08:37 user nova-compute[75672]: 
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --login {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea6aaf9-f5bf-44e3-93c6-447194b98026]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307, portal: 172.16.0.220,3260]
Nov 30 13:08:37 user nova-compute[75672]: Login to [iface: default, target: iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307, portal: 172.16.0.220,3260] successful.
Nov 30 13:08:37 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[a294a7b2-7986-4c52-bc69-f9acbf42a9fd]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[918ce528-deb7-46c9-b307-4604e6fddc85]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 (non-flash)
Nov 30 13:08:37 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 (non-flash)
Nov 30 13:08:37 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Connected to 172.16.0.220:3260 {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75672) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75672) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8a44ce-b92c-42dd-9f9e-8b1bfb00206b]: (4, ('- - 0', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75672) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 13:08:37 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxksIKAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75672) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 13:08:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:08:38 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23365656434656339', 'path': '/dev/sdb'} {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:08:38 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365656434656339', 'path': '/dev/sdb'} {{(pid=75672) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 13:08:38 user nova-compute[75672]: DEBUG nova.objects.instance [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lazy-loading 'flavor' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:08:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 13:08:39 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:08:39 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 13:08:39 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:08:39 user nova-compute[75672]:   <serial>64b4dc76-40c3-4818-bdfa-2d600534e307</serial>
Nov 30 13:08:39 user nova-compute[75672]: </disk>
Nov 30 13:08:39 user nova-compute[75672]:  {{(pid=75672) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 13:08:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] No BDM found with device name vda, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 13:08:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75672) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Nov 30 13:08:39 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] No VIF found with MAC fa:16:3e:65:4b:94, not building metadata {{(pid=75672) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Nov 30 13:08:39 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-74f4dcd7-57ed-4eee-8dd6-f0c05687d180 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.181s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:08:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:08:42 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:08:42 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:08:42 user nova-compute[75672]: INFO nova.compute.manager [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Detaching volume 64b4dc76-40c3-4818-bdfa-2d600534e307
Nov 30 13:08:42 user nova-compute[75672]: INFO nova.virt.block_device [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Attempting to driver detach volume 64b4dc76-40c3-4818-bdfa-2d600534e307 from mountpoint /dev/vdb
Nov 30 13:08:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Attempting to detach device vdb from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the persistent domain config. {{(pid=75672) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Nov 30 13:08:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 13:08:42 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:08:42 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 13:08:42 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:08:42 user nova-compute[75672]:   <serial>64b4dc76-40c3-4818-bdfa-2d600534e307</serial>
Nov 30 13:08:42 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 13:08:42 user nova-compute[75672]: </disk>
Nov 30 13:08:42 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 13:08:42 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Successfully detached device vdb from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the persistent domain config.
Nov 30 13:08:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the live domain config. {{(pid=75672) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Nov 30 13:08:42 user nova-compute[75672]: DEBUG nova.virt.libvirt.guest [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 13:08:42 user nova-compute[75672]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 13:08:42 user nova-compute[75672]:   <source dev="/dev/sdb"/>
Nov 30 13:08:42 user nova-compute[75672]:   <target dev="vdb" bus="virtio"/>
Nov 30 13:08:42 user nova-compute[75672]:   <serial>64b4dc76-40c3-4818-bdfa-2d600534e307</serial>
Nov 30 13:08:42 user nova-compute[75672]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 13:08:42 user nova-compute[75672]: </disk>
Nov 30 13:08:42 user nova-compute[75672]:  {{(pid=75672) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 13:08:43 user nova-compute[75672]: DEBUG nova.virt.libvirt.driver [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Nov 30 13:08:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:47 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:08:58 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:09:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:09:02 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:09:03 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f is timed out.
Nov 30 13:09:03 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Successfully detached device vdb from instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f from the live domain config.
Nov 30 13:09:03 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] calling os-brick to detach iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdcd4521c60>, {'target_iqn': 'iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxksIKAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 13:09:03 user nova-compute[75672]: WARNING os_brick.initiator.connectors.base [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8489fd-2ab9-42f3-b04e-a3196d291a06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 13:09:03 user nova-compute[75672]: No targets found.
Nov 30 13:09:03 user nova-compute[75672]: iSNS:
Nov 30 13:09:03 user nova-compute[75672]: No targets found.
Nov 30 13:09:03 user nova-compute[75672]: STATIC:
Nov 30 13:09:03 user nova-compute[75672]: Target: iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307
Nov 30 13:09:03 user nova-compute[75672]:         Portal: 172.16.0.220:3260,-1
Nov 30 13:09:03 user nova-compute[75672]:                 Iface Name: default
Nov 30 13:09:03 user nova-compute[75672]: FIRMWARE:
Nov 30 13:09:03 user nova-compute[75672]: No targets found.
Nov 30 13:09:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 13:09:03 user nova-compute[75672]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 13:09:03 user nova-compute[75672]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75672) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307', 0)] {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[763c9847-53be-4575-8f18-468bc3f7116e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7191950-f4ac-475d-a433-c0fffdc0ac6c]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 (non-flash)\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 (non-flash)
Nov 30 13:09:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 (non-flash)
Nov 30 13:09:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdcd466a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307'): ({'sdb'}, set())}) {{(pid=75672) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Removing single pathed devices sdb {{(pid=75672) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c401de8-5d7e-46d5-ad48-124e65822f5e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05554bb-dcc5-42f6-8a26-3c51137f3d3c]: (4, ('ok\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Flushing IO for device /dev/sdb {{(pid=75672) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49c1d5f-449a-464a-8c4e-4f2bc3af07f7]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75672) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[2912fb53-b066-4dbd-b8cb-e851a00787eb]: (4, ('1', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.linuxscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] SCSI volumes sdb have been removed. {{(pid=75672) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307')] {{(pid=75672) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd9102c-5d2b-496b-8f87-97d79298452f]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --logout {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db8b32a-460b-4b65-b68a-ccdcd1a8d253]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307, portal: 172.16.0.220,3260]
Nov 30 13:09:03 user nova-compute[75672]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307, portal: 172.16.0.220,3260] successful.
Nov 30 13:09:03 user nova-compute[75672]:  stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --op delete {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b4dc76-40c3-4818-bdfa-2d600534e307 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbacc3a0-5763-4e50-b9b2-8628f57fe539]: (4, ('', '')) {{(pid=86963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75672) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.base [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG os_brick.initiator.connectors.iscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] <== disconnect_volume: return (311ms) None {{(pid=75672) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 13:09:03 user nova-compute[75672]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Disconnected iSCSI Volume {{(pid=75672) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 13:09:04 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:09:05 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 13:09:06 user nova-compute[75672]: DEBUG oslo_concurrency.processutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 13:09:06 user nova-compute[75672]: DEBUG nova.objects.instance [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lazy-loading 'flavor' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:09:06 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:09:06 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:09:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=24.96438217163086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 13:09:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:09:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:09:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-48053334-00e4-4313-ae20-4b697e6430f2 tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.920s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:09:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75672) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 13:09:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 13:09:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 13:09:06 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:09:06 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:09:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 13:09:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:09:07 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:09:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 13:09:07 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 13:09:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 13:09:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquired lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 13:09:07 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Forcefully refreshing network info cache for instance {{(pid=75672) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 13:09:07 user nova-compute[75672]: DEBUG nova.objects.instance [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lazy-loading 'info_cache' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:09:08 user nova-compute[75672]: DEBUG nova.network.neutron [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updating instance_info_cache with network_info: [{"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:09:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Releasing lock "refresh_cache-a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 13:09:08 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updated the network info_cache for instance {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 13:09:08 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:09:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:09:11 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:09:11 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 13:09:13 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:09:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:09:15 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:09:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:09:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:09:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:09:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:09:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:09:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:09:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:09:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:09:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:09:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:09:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:09:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:09:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:00 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:10:04 user nova-compute[75672]: INFO nova.compute.manager [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Terminating instance
Nov 30 13:10:04 user nova-compute[75672]: DEBUG nova.compute.manager [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Start destroying the instance on the hypervisor. {{(pid=75672) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-2c58c811-14a7-4d54-a746-c53245daef18 req-dcf94725-cd99-40e1-a347-d41438658f6b service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Received event network-vif-unplugged-83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2c58c811-14a7-4d54-a746-c53245daef18 req-dcf94725-cd99-40e1-a347-d41438658f6b service nova] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2c58c811-14a7-4d54-a746-c53245daef18 req-dcf94725-cd99-40e1-a347-d41438658f6b service nova] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-2c58c811-14a7-4d54-a746-c53245daef18 req-dcf94725-cd99-40e1-a347-d41438658f6b service nova] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-2c58c811-14a7-4d54-a746-c53245daef18 req-dcf94725-cd99-40e1-a347-d41438658f6b service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] No waiting events found dispatching network-vif-unplugged-83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:10:04 user nova-compute[75672]: DEBUG nova.compute.manager [req-2c58c811-14a7-4d54-a746-c53245daef18 req-dcf94725-cd99-40e1-a347-d41438658f6b service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Received event network-vif-unplugged-83060a1e-3151-4aad-98dd-a281c8285d51 for instance with task_state deleting. {{(pid=75672) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 13:10:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [-] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Instance destroyed successfully.
Nov 30 13:10:05 user nova-compute[75672]: DEBUG nova.objects.instance [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lazy-loading 'resources' on Instance uuid a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f {{(pid=75672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG nova.virt.libvirt.vif [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T13:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-403696218',display_name='tempest-SnapshotDataIntegrityTests-server-403696218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-403696218',id=51,image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXQ84jBH1CMJb3TcKkE/CRpNkFX73b09sQKxmcVXKiQ2YD5ZKk7IPpgZGuCCpaKBH4jSMCij1jWnpNmPcBN2ZENONDGj86y936t1AFm+MMo04c7Qrwv5UdOst0GHqvXJg==',key_name='tempest-keypair-398724710',keypairs=<?>,launch_index=0,launched_at=2023-11-30T13:02:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8848c2cf5c324953b247f90252190094',ramdisk_id='',reservation_id='r-gvdm1sie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bddb75-c432-42ad-9253-e3e4a10e804c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1102475418',owner_user_name='tempest-SnapshotDataIntegrityTests-1102475418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T13:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='552695c85f8841369d7d48d301d37ef6',uuid=a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Converting VIF {"id": "83060a1e-3151-4aad-98dd-a281c8285d51", "address": "fa:16:3e:65:4b:94", "network": {"id": "04d16965-23d6-4bbd-9d4a-22a476272fdd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294476489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8848c2cf5c324953b247f90252190094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83060a1e-31", "ovs_interfaceid": "83060a1e-3151-4aad-98dd-a281c8285d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG nova.network.os_vif_util [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:4b:94,bridge_name='br-int',has_traffic_filtering=True,id=83060a1e-3151-4aad-98dd-a281c8285d51,network=Network(04d16965-23d6-4bbd-9d4a-22a476272fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83060a1e-31') {{(pid=75672) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG os_vif [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:4b:94,bridge_name='br-int',has_traffic_filtering=True,id=83060a1e-3151-4aad-98dd-a281c8285d51,network=Network(04d16965-23d6-4bbd-9d4a-22a476272fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83060a1e-31') {{(pid=75672) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83060a1e-31, bridge=br-int, if_exists=True) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c8f0c86-a709-48d1-b82c-1fa416c06c57) {{(pid=75672) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:05 user nova-compute[75672]: INFO os_vif [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:4b:94,bridge_name='br-int',has_traffic_filtering=True,id=83060a1e-3151-4aad-98dd-a281c8285d51,network=Network(04d16965-23d6-4bbd-9d4a-22a476272fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83060a1e-31')
Nov 30 13:10:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Deleting instance files /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f_del
Nov 30 13:10:05 user nova-compute[75672]: INFO nova.virt.libvirt.driver [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Deletion of /opt/stack/data/nova/instances/a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f_del complete
Nov 30 13:10:05 user nova-compute[75672]: INFO nova.compute.manager [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 30 13:10:05 user nova-compute[75672]: DEBUG oslo.service.loopingcall [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75672) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG nova.compute.manager [-] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Deallocating network for instance {{(pid=75672) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] deallocate_for_instance() {{(pid=75672) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG nova.network.neutron [-] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Updating instance_info_cache with network_info: [] {{(pid=75672) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 13:10:05 user nova-compute[75672]: INFO nova.compute.manager [-] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Took 0.74 seconds to deallocate network for instance.
Nov 30 13:10:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:10:05 user nova-compute[75672]: DEBUG nova.compute.manager [req-fd523f7d-f1c1-497c-8a61-0d2d6d31b182 req-d47c0551-0284-45e8-baac-7bd7cb113cbc service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Received event network-vif-deleted-83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:10:06 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:10:06 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:10:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:10:06 user nova-compute[75672]: INFO nova.scheduler.client.report [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Deleted allocations for instance a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f
Nov 30 13:10:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-b5a848f8-f061-423b-b381-eacfa5f2d4fc tempest-SnapshotDataIntegrityTests-1102475418 tempest-SnapshotDataIntegrityTests-1102475418-project-member] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.907s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:10:06 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:10:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:10:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:10:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:10:06 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 13:10:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-5e63feff-ba62-4fde-9684-093eee945805 req-c87590db-9246-415e-b7e3-98e3c56e84a4 service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Received event network-vif-plugged-83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 13:10:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5e63feff-ba62-4fde-9684-093eee945805 req-c87590db-9246-415e-b7e3-98e3c56e84a4 service nova] Acquiring lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:10:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5e63feff-ba62-4fde-9684-093eee945805 req-c87590db-9246-415e-b7e3-98e3c56e84a4 service nova] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:10:06 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [req-5e63feff-ba62-4fde-9684-093eee945805 req-c87590db-9246-415e-b7e3-98e3c56e84a4 service nova] Lock "a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:10:06 user nova-compute[75672]: DEBUG nova.compute.manager [req-5e63feff-ba62-4fde-9684-093eee945805 req-c87590db-9246-415e-b7e3-98e3c56e84a4 service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] No waiting events found dispatching network-vif-plugged-83060a1e-3151-4aad-98dd-a281c8285d51 {{(pid=75672) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 13:10:06 user nova-compute[75672]: WARNING nova.compute.manager [req-5e63feff-ba62-4fde-9684-093eee945805 req-c87590db-9246-415e-b7e3-98e3c56e84a4 service nova] [instance: a47fbfbf-d30b-4acf-b26d-70b3f2e48a6f] Received unexpected event network-vif-plugged-83060a1e-3151-4aad-98dd-a281c8285d51 for instance with vm_state deleted and task_state None.
Nov 30 13:10:07 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:10:07 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:10:07 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=9054MB free_disk=24.989917755126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 13:10:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:10:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:10:07 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 13:10:07 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 13:10:07 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:10:07 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:10:07 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 13:10:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:10:09 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:10:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 13:10:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 13:10:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Didn't find any instances for network info cache update. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 13:10:09 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:10:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:11 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:10:11 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 13:10:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:16 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:10:18 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:10:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:25 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:30 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:35 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:40 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:45 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:50 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:10:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:55 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:10:58 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:11:00 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:11:01 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:11:01 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:11:05 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:11:06 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:11:06 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:11:06 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:11:07 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager.update_available_resource {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:11:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:11:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:11:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:11:07 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Auditing locally available compute resources for user (node: user) {{(pid=75672) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 13:11:07 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:11:07 user nova-compute[75672]: WARNING nova.virt.libvirt.driver [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 13:11:07 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Hypervisor/Node resource view: name=user free_ram=9249MB free_disk=24.978130340576172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75672) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 13:11:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 13:11:07 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 13:11:07 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 13:11:07 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75672) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 13:11:07 user nova-compute[75672]: DEBUG nova.compute.provider_tree [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed in ProviderTree for provider: 9d360ecf-be43-4c84-93ca-abc6f9902098 {{(pid=75672) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 13:11:08 user nova-compute[75672]: DEBUG nova.scheduler.client.report [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Inventory has not changed for provider 9d360ecf-be43-4c84-93ca-abc6f9902098 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75672) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 13:11:08 user nova-compute[75672]: DEBUG nova.compute.resource_tracker [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Compute_service record updated for user:user {{(pid=75672) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 13:11:08 user nova-compute[75672]: DEBUG oslo_concurrency.lockutils [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=75672) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 13:11:09 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:11:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Starting heal instance info cache {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 13:11:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Rebuilding the list of instances to heal {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 13:11:09 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Didn't find any instances for network info cache update. {{(pid=75672) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 13:11:09 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:11:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:11:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:11:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75672) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 13:11:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:11:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75672) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 13:11:10 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 13:11:12 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:11:12 user nova-compute[75672]: DEBUG nova.compute.manager [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75672) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 13:11:15 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 13:11:16 user nova-compute[75672]: DEBUG oslo_service.periodic_task [None req-dd9bff8f-9333-4514-8b9c-646bb74433fd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 13:11:20 user nova-compute[75672]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75672) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}